WP30: E3 transfer complete, all results sections, abstract, conclusion, claim ledger, FINAL_REPORT draft, page inspection
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
101 changed files +5,283 −104
added
FINAL_REPORT.md
+63 −0
@@ -0,0 +1,63 @@ | |||||
| 1 | +# WP30 — FINAL REPORT | ||||
| 2 | + | ||||
| 3 | +**Status: COMPLETE_WITHIN_DECLARED_SCOPE** (with the explicit exclusion of cross-family cache transfer; see "Not executed"). | ||||
| 4 | + | ||||
| 5 | +Paper: `paper/WP30_Boucher_Cache_Compression_Knowledge_Transfer.pdf` (LaTeX in `paper/`). Protocol frozen 2026-10-30 04:32 UTC | ||||
| 6 | +(`protocol/frozen.json`, hash `404c52b3…`); amendments A-001–A-004 in `protocol/hypotheses.md`; dated decisions D-001–D-019 in `DECISIONS.md`. | ||||
| 7 | + | ||||
| 8 | +## What was actually executed (all from Claude Code, real model inference) | ||||
| 9 | + | ||||
| 10 | +| Campaign | What | Trials / runs | Where | Status | | ||||
| 11 | +|---|---|---|---|---| | ||||
| 12 | +| E0 | cache correctness suite (identity, prefix equivalence, positions, packed bytes, loader rejection, isolation) | 12 tests + 20 unit tests | laptop | 32/32 pass | | ||||
| 13 | +| E1_pilot | dev calibration, 31 conditions × 2 pairs | 1 037 | laptop | done (dev only) | | ||||
| 14 | +| E1_core | 22 conditions × 2 pairs × 160 test documents | 13 280 (+240 A8 retries) | laptop (Qwen pair, Llama public) + M3U96a (Llama synthetic/exec) | complete | | ||||
| 15 | +| E3_core (+sender) | Qwen2.5-1.5B→3B ridge mapper v2, identity control, text handoffs, sender-alone | 1 536 + 512 | M3U96a | complete | | ||||
| 16 | +| E4_core | relays 1/2/4/8 handoffs, closed/repairable, Qwen and Qwen/Llama, fact ledger | 7 200 | laptop + M3U96b (document parity shards) | complete | | ||||
| 17 | +| E5_core | fan-in k=2,4 with superseded revision + irrelevant source; 5 compositions incl. cache-concat negative control | 1 600 | laptop | complete | | ||||
| 18 | +| E6_core | genuine two-node transfer M3U96a→M3U96b (1 GbE, 940 Mbit/s): bf16/zstd/8-bit/4-bit caches vs remote text prefill vs local | 324 | cluster | complete | | ||||
| 19 | +| ED_hosted_core | A0–A6 messages → claude-haiku-4-5 and gpt-5-nano, provider prefix caching | 672 (0.53 USD; pilots 0.19 USD) | M3U96b + APIs | complete | | ||||
| 20 | +| E8 | router fitted on dev pilot, evaluated off-policy on the full-factorial test records | 640 instances × 2 regimes | laptop | complete | | ||||
| 21 | +| E9 | minimal reproduction from a clean process | 64 trials | laptop | 64/64 identical outputs and scores | | ||||
| 22 | +| E7_qtypes | EXPLORATORY: question types 6–15 (negation, revision, temporal, aggregation, units, unanswerable) | 5 600 planned | laptop | see STATUS | | ||||
| 23 | + | ||||
| 24 | +Models: `mlx-community/Qwen2.5-3B-Instruct-bf16`, `Llama-3.2-3B-Instruct-bf16`, `Qwen2.5-1.5B-Instruct-bf16` (revisions and weight hashes in | ||||
| 25 | +`evidence/models.json`). Hardware: MacBook Pro M5 Max 48 GB (laptop), two Mac Studio M3 Ultra 96 GB (M3U96a/b) on a wired 1 GbE LAN. | ||||
| 26 | +Runtimes: mlx 0.32.4, mlx-lm 0.32.2, torch 2.15 (MPS, LLMLingua-2 only), Python 3.12.13. Total wall time ≈ 10 h of campaigns (2026-10-29 23:00 → | ||||
| 27 | +2026-10-30 09:30 UTC) plus development; API spend 0.72 USD (cap 25 USD). | ||||
| 28 | + | ||||
| 29 | +## Principal findings (each with a claim-ledger row in `results/claim_ledger.csv`) | ||||
| 30 | +1. Lossless representations (text, zstd text, native cache, reloaded cache, 8-bit packed cache) are indistinguishable in quality; their cost | ||||
| 31 | + ranking inverts between cold (text wins) and reused (cache wins) regimes. | ||||
| 32 | +2. 4-bit packed KV quantization: Llama-3.2-3B ≥ 97 %, Qwen2.5-3B 0 % (native mlx-lm path reproduces it) — H2 confirmed. | ||||
| 33 | +3. SnapKV-style eviction at 1/4 with the question keeps 78–98 % of private-fact accuracy; with a generic window 12–19 %; sink+recent 18–20 %; | ||||
| 34 | + random 0 %; every eviction scores 0 on executable tasks. | ||||
| 35 | +4. At a 512-token sender budget, prose summaries (38–44 %) beat structured evidence with spans (12–15 %): the budget is spent on quotes — H1 rejected. | ||||
| 36 | +5. Relays: loss at hop 1, then nearly lossless to hop 8 (H5 rejected); no invented identifiers; metered repair +6 pts retention for 5.9 kB. | ||||
| 37 | +6. Fan-in: concatenated summaries ≈ full context on joins; merged structured records fail; cache concatenation (invalid) still answers 70 % at k=2 — a warning. | ||||
| 38 | +7. Two-node: bf16 cache 215 MB at 8k tokens moves in 1.8 s; 8-bit cache answers in 1.7 s vs 3.7 s for remote text prefill on an M3 Ultra receiver. | ||||
| 39 | +8. Same-family ridge mapper: 68 % of value variance reconstructed, 0–4 % content transfer, coherent "unknown" abstention — H10 confirmed. | ||||
| 40 | +9. Hosted receivers recover everything from full text and the same ~30 % from the local summary; Anthropic caching needs ≥ 4 096 tokens. | ||||
| 41 | +10. Router: equal quality at half the amortized latency (blind); no gain and higher cost (aware). | ||||
| 42 | + | ||||
| 43 | +## Not executed / limitations | ||||
| 44 | +- Cross-family cache transfer (SwaT: no checkpoint, no licence; training a 300M mapper exceeded the budget) → the transfer study is same-family only. | ||||
| 45 | +- Attention-Matching compaction, C2C, LatentMAS, H2O, KIVI kernels: audited, not run (CUDA/vLLM code; see Table 1 and `literature/method_notes.md`). | ||||
| 46 | +- One sender budget (512), one retention ratio (1/4) in the confirmatory family; 2-bit dropped from the core; public QA subsets of 40 documents. | ||||
| 47 | +- Llama-pair latencies for synthetic/exec come from M3U96a, public from the laptop (hardware recorded per record; within-pair, within-family comparisons only). | ||||
| 48 | +- Hosted sampling is provider default (temperature not accepted); A8 for the Llama pair was retried on the laptop after a missing-runtime failure on M3U96a. | ||||
| 49 | +- No human validation, no LLM judge; deterministic scorers only. Synthetic facts are new; public texts may be in pre-training corpora. | ||||
| 50 | + | ||||
| 51 | +## Reproduction | ||||
| 52 | +```bash | ||||
| 53 | +uv venv --python 3.12 .venv && source .venv/bin/activate && uv pip install -r reproduction/requirements-lock.txt && uv pip install -e . | ||||
| 54 | +make reproduce-analysis # tables, figures, provenance, audit (no inference) | ||||
| 55 | +python -m wp30 reproduce --profile reproduction/minimal.yaml # re-run 64 trials, compare outputs (needs the two checkpoints, ~15 GB) | ||||
| 56 | +make paper | ||||
| 57 | +``` | ||||
| 58 | +Full campaigns: `configs/core*.yaml`, `chains_core*.yaml`, `fanin_core.yaml`, `hosted_core.yaml`; two-node: `scripts/run_e6_core.sh`. | ||||
| 59 | + | ||||
| 60 | +## Execution disclosure | ||||
| 61 | +Operator: Claude Code (claude-fable-5-1). Human interventions: none during execution (brief provided at start). Defects found and fixed are listed in | ||||
| 62 | +the paper (Section 9) and in `DECISIONS.md`. No screenshots were captured; machine-readable logs (`runs/logs`) and rendered page images | ||||
| 63 | +(`evidence/pages`) are the execution evidence. | ||||
modified
STATUS.md
+6 −9
@@ -1,11 +1,8 @@ | |||||
| 1 | # STATUS.md — WP30 | 1 | # STATUS.md — WP30 | ||
| 2 | 2 | ||||
| 3 | −**Phase:** 8 (core single-handoff campaign running) — protocol frozen 2026-10-30 04:32 UTC, hash 404c52b34d964693… | 3 | +**Phase:** 11 (analysis) / 12 (manuscript) — core campaigns complete; two tails running | ||
| 4 | −**Completed gates:** 0 environment · 1 literature (34 sources) · 2 datasets (800 items, keys isolated) · 3 live inference · 4 cache correctness (12/12) · | 4 | +**Completed:** E0 correctness · E1_core 13 280 trials (both pairs) · E4_core 7 200 (chains, 2 machines) · E5_core 1 600 (fan-in) · E6_core 324 two-node runs · | ||
| 5 | −5 text/evidence methods (A0–A8) · 6 advanced methods (B5/B6 faithful re-implementations; linear mapper v1/v2 trained on M3U96b; SwaT/C2C/LatentMAS/H2O/Compaction audited, not run) · | 5 | +ED_hosted_core 672 (0.53 USD) · E8 router evaluated on test · E9 minimal reproduction 64/64 identical · protocol frozen 404c52b3…, amendments A-001…A-004 | ||
| 6 | −7 pilot (E1_pilot 1 037 trials dev; E3_pilot/v2; E4_pilot; ED_hosted_pilot) + freeze | 6 | +**Running:** E3_core (Qwen1.5B→3B mapper, M3U96a) · laptop queue2 (A8 Llama retry, then exploratory E7_qtypes) | ||
| 7 | −**Running:** E1_core Qwen shard (laptop, started 04:32 UTC); E4_pilot (M3U96a, finishing); ED_hosted_pilot (M3U96b) | 7 | +**Next:** collect E3 + E3_sender → results_transfer.tex · E7 → appendix · abstract/conclusion · claim ledger · page-by-page PDF inspection · audit-artifacts · FINAL_REPORT.md · spbgit push | ||
| 8 | −**Queued:** E1_core Llama shard (M3U96a) · E6_core (M3U96a→M3U96b) · E4_core, E5_core, E3_core(+sender) (M3U96b) · ED_hosted_core · E8 router eval · analysis · paper | 8 | +**Resume:** `./scripts/collect_remote_results.sh && make reproduce-analysis && make paper` | ||
| 9 | −**Blockers:** none | ||||
| 10 | −**Resume commands:** laptop `python -m wp30 run --config configs/core_qwen.yaml --resume`; M3U96a `python -m wp30 run --config configs/core_llama.yaml --resume`; | ||||
| 11 | −M3U96b `python -m wp30.cli_extra chains configs/chains_core.yaml --resume`, `fanin configs/fanin_core.yaml --resume`, `python -m wp30 run --config configs/core_transfer.yaml --resume` | ||||
added
evidence/pages/p-01.png
+0 −0
Binary file not shown.
added
evidence/pages/p-02.png
+0 −0
Binary file not shown.
added
evidence/pages/p-03.png
+0 −0
Binary file not shown.
added
evidence/pages/p-04.png
+0 −0
Binary file not shown.
added
evidence/pages/p-05.png
+0 −0
Binary file not shown.
added
evidence/pages/p-06.png
+0 −0
Binary file not shown.
added
evidence/pages/p-07.png
+0 −0
Binary file not shown.
added
evidence/pages/p-08.png
+0 −0
Binary file not shown.
added
evidence/pages/p-09.png
+0 −0
Binary file not shown.
added
evidence/pages/p-10.png
+0 −0
Binary file not shown.
added
evidence/pages/p-11.png
+0 −0
Binary file not shown.
added
evidence/pages/p-12.png
+0 −0
Binary file not shown.
added
evidence/pages/p-13.png
+0 −0
Binary file not shown.
added
evidence/pages/p-14.png
+0 −0
Binary file not shown.
added
evidence/pages/p-15.png
+0 −0
Binary file not shown.
added
evidence/pages/p-16.png
+0 −0
Binary file not shown.
added
evidence/pages/p-17.png
+0 −0
Binary file not shown.
added
evidence/pages/p-18.png
+0 −0
Binary file not shown.
added
evidence/pages/p-19.png
+0 −0
Binary file not shown.
added
evidence/pages/p-20.png
+0 −0
Binary file not shown.
added
evidence/pages/p-21.png
+0 −0
Binary file not shown.
added
evidence/pages/p-22.png
+0 −0
Binary file not shown.
added
evidence/pages/p-23.png
+0 −0
Binary file not shown.
added
evidence/pages/p-24.png
+0 −0
Binary file not shown.
added
evidence/pages/p-25.png
+0 −0
Binary file not shown.
added
evidence/pages/p-26.png
+0 −0
Binary file not shown.
added
evidence/pages/p-27.png
+0 −0
Binary file not shown.
added
evidence/pages/p-28.png
+0 −0
Binary file not shown.
added
evidence/pages/p-29.png
+0 −0
Binary file not shown.
added
evidence/pages/p-30.png
+0 −0
Binary file not shown.
added
evidence/pages/p-31.png
+0 −0
Binary file not shown.
added
evidence/pages/p-32.png
+0 −0
Binary file not shown.
added
evidence/pages/p-33.png
+0 −0
Binary file not shown.
added
evidence/pages/p-34.png
+0 −0
Binary file not shown.
added
evidence/pages/p-35.png
+0 −0
Binary file not shown.
added
evidence/pages/p-36.png
+0 −0
Binary file not shown.
added
evidence/pages/p-37.png
+0 −0
Binary file not shown.
added
evidence/pages/p-38.png
+0 −0
Binary file not shown.
added
evidence/pages/p-39.png
+0 −0
Binary file not shown.
added
evidence/pages/p-40.png
+0 −0
Binary file not shown.
added
evidence/pages/p-41.png
+0 −0
Binary file not shown.
added
evidence/pages/p-42.png
+0 −0
Binary file not shown.
added
evidence/pages/p-43.png
+0 −0
Binary file not shown.
added
evidence/pages/p-44.png
+0 −0
Binary file not shown.
added
evidence/pages/sheet_01.png
+0 −0
Binary file not shown.
added
evidence/pages/sheet_02.png
+0 −0
Binary file not shown.
added
evidence/pages/sheet_03.png
+0 −0
Binary file not shown.
added
evidence/pages/sheet_04.png
+0 −0
Binary file not shown.
added
evidence/pages/sheet_05.png
+0 −0
Binary file not shown.
added
evidence/pages/sheet_06.png
+0 −0
Binary file not shown.
modified
paper/appendix/appendix.tex
+1 −1
@@ -8,7 +8,7 @@ | |||||
| 8 | \label{app:audit} | 8 | \label{app:audit} | ||
| 9 | Thirty-four sources were verified on 2026-10-29 from their arXiv pages, repositories and documentation (\texttt{literature/sources.csv}; | 9 | Thirty-four sources were verified on 2026-10-29 from their arXiv pages, repositories and documentation (\texttt{literature/sources.csv}; | ||
| 10 | notes in \texttt{literature/audit\_group\{1,2,3\}.md}). Table~\ref{tab:audit} summarizes the core methods. | 10 | notes in \texttt{literature/audit\_group\{1,2,3\}.md}). Table~\ref{tab:audit} summarizes the core methods. | ||
| 11 | −\begin{table}[h]\centering\scriptsize | 11 | +\begin{table}[H]\centering\scriptsize | ||
| 12 | \caption{Audited core methods: availability of code and checkpoints, backend, question access, and WP30 status.}\label{tab:audit} | 12 | \caption{Audited core methods: availability of code and checkpoints, backend, question access, and WP30 status.}\label{tab:audit} | ||
| 13 | \begin{tabular}{@{}llllll@{}}\toprule | 13 | \begin{tabular}{@{}llllll@{}}\toprule | ||
| 14 | Method & Code & Checkpoint & Backend & Question access & WP30 \\\midrule | 14 | Method & Code & Checkpoint & Backend & Question access & WP30 \\\midrule | ||
modified
paper/appendix/extra_tables.tex
+26 −1
@@ -1 +1,26 @@ | |||||
| 1 | −% filled by analysis | 1 | +\subsection{Core results by question type} | ||
| 2 | +\begin{table}[H]\centering\scriptsize | ||||
| 3 | +\caption{Synthetic family, core run, accuracy (\%) by question type (both pairs pooled; 95\,\% cluster-bootstrap CI).} | ||||
| 4 | +\adjustbox{max width=\textwidth}{\input{tables/table_qtype_core}} | ||||
| 5 | +\end{table} | ||||
| 6 | + | ||||
| 7 | +\subsection{Attempt outcomes by method} | ||||
| 8 | +\begin{table}[H]\centering\scriptsize | ||||
| 9 | +\caption{All attempts of the core run by status (retries included).} | ||||
| 10 | +\input{tables/table_failures} | ||||
| 11 | +\end{table} | ||||
| 12 | + | ||||
| 13 | +\subsection{Exploratory: question types not covered by the core (A-004)} | ||||
| 14 | +\begin{figure}[H]\centering\includegraphics[width=\textwidth]{figA_qtypes_exploratory.pdf} | ||||
| 15 | +\caption{EXPLORATORY. Accuracy on negation, revision/precedence, temporal order, aggregation, unit conversion and unanswerable questions | ||||
| 16 | +(questions 6--15 of the 40 synthetic test documents) for a subset of methods; no confirmatory test attached.}\end{figure} | ||||
| 17 | +\begin{table}[H]\centering\scriptsize | ||||
| 18 | +\caption{EXPLORATORY question-type extension (\%, 95\,\% CI).} | ||||
| 19 | +\adjustbox{max width=\textwidth}{\input{tables/table_qtypes_exploratory}} | ||||
| 20 | +\end{table} | ||||
| 21 | + | ||||
| 22 | +\subsection{Question-access panels} | ||||
| 23 | +\begin{figure}[H]\centering\includegraphics[width=\textwidth]{figA_quality_vs_bytes_blind.pdf} | ||||
| 24 | +\caption{Question-blind conditions only (reusable messages).}\end{figure} | ||||
| 25 | +\begin{figure}[H]\centering\includegraphics[width=\textwidth]{figA_quality_vs_bytes_aware.pdf} | ||||
| 26 | +\caption{Question-aware conditions only (query-specific messages).}\end{figure} | ||||
modified
paper/appendix/hypotheses_verbatim.tex
+106 −32
@@ -1,58 +1,90 @@ | |||||
| 1 | \begin{footnotesize}\begin{verbatim} | 1 | \begin{footnotesize}\begin{verbatim} | ||
| 2 | −# WP30 -- Research questions and falsifiable hypotheses (registered before any held-out outcome was examined) | 2 | +# WP30 -- Research questions and falsifiable hypotheses (registered before any held-out | ||
| 3 | + outcome was examined) | ||||
| 3 | 4 | ||||
| 4 | Registered: 2026-10-29 (Phase 1). Amendments only as dated entries at the bottom. | 5 | Registered: 2026-10-29 (Phase 1). Amendments only as dated entries at the bottom. | ||
| 5 | −Test-split outcomes had **not** been examined at registration (no test split existed yet; only the E0 smoke run on a | 6 | +Test-split outcomes had **not** been examined at registration (no test split existed yet; | ||
| 7 | + only the E0 smoke run on a | ||||
| 6 | hand-written 3-sentence memo had been executed, see `runs/logs/`). | 8 | hand-written 3-sentence memo had been executed, see `runs/logs/`). | ||
| 7 | 9 | ||||
| 8 | ## Research questions | 10 | ## Research questions | ||
| 9 | 11 | ||||
| 10 | −- **RQ1 (compression frontier)** How do text shortening (A2-A4, A8), packed KV quantization (B2), token eviction (B3-B6) and | 12 | +- **RQ1 (compression frontier)** How do text shortening (A2-A4, A8), packed KV quantization | ||
| 11 | − learned compaction (B7, if run) trade task quality against *measured* serialized bytes and resident cache bytes? | 13 | + (B2), token eviction (B3-B6) and | ||
| 12 | −- **RQ2 (transfer compatibility)** How much performance is preserved by same-checkpoint reuse (B1, cross-process, cross-node) | 14 | + learned compaction (B7, if run) trade task quality against *measured* serialized bytes and | ||
| 13 | − versus learned mappings between distinct checkpoints (Track C), relative to the receiver's own full-context answer? | 15 | + resident cache bytes? | ||
| 14 | −- **RQ3 (resource accounting)** Do rankings of methods under a token budget change when the budget is bytes, end-to-end latency, | 16 | +- **RQ2 (transfer compatibility)** How much performance is preserved by same-checkpoint | ||
| 17 | + reuse (B1, cross-process, cross-node) | ||||
| 18 | + versus learned mappings between distinct checkpoints (Track C), relative to the receiver's | ||||
| 19 | + own full-context answer? | ||||
| 20 | +- **RQ3 (resource accounting)** Do rankings of methods under a token budget change when the | ||||
| 21 | + budget is bytes, end-to-end latency, | ||||
| 15 | peak memory or amortized cost over N reuses? | 22 | peak memory or amortized cost over N reuses? | ||
| 16 | −- **RQ4 (repeated handoffs)** How do correct-fact retention, unsupported additions and task accuracy evolve after 1, 2, 4, 8 handoffs, | 23 | +- **RQ4 (repeated handoffs)** How do correct-fact retention, unsupported additions and task | ||
| 24 | + accuracy evolve after 1, 2, 4, 8 handoffs, | ||||
| 17 | for prose summaries vs structured evidence, in closed vs repairable chains? | 25 | for prose summaries vs structured evidence, in closed vs repairable chains? | ||
| 18 | −- **RQ5 (evidence)** Under an equal byte budget, does structured evidence with source spans (A5) retain exact facts (identifiers, | 26 | +- **RQ5 (evidence)** Under an equal byte budget, does structured evidence with source spans | ||
| 19 | − numbers, dates, negations) better than an abstractive summary (A4)? Does metered retrieval (A6) repair losses, and at what cost? | 27 | + (A5) retain exact facts (identifiers, | ||
| 20 | −- **RQ6 (locality)** When is running the next query where the cache resides cheaper than moving the cache or recomputing from text, | 28 | + numbers, dates, negations) better than an abstractive summary (A4)? Does metered retrieval | ||
| 29 | + (A6) repair losses, and at what cost? | ||||
| 30 | +- **RQ6 (locality)** When is running the next query where the cache resides cheaper than | ||||
| 31 | + moving the cache or recomputing from text, | ||||
| 21 | as a function of context length, payload bytes, measured bandwidth and queue delay? | 32 | as a function of context length, payload bytes, measured bandwidth and queue delay? | ||
| 22 | −- **RQ7 (adaptive policy)** Can a router fitted on development data improve the held-out quality/cost frontier over the best | 33 | +- **RQ7 (adaptive policy)** Can a router fitted on development data improve the held-out | ||
| 34 | + quality/cost frontier over the best | ||||
| 23 | development-selected static method, once routing overhead and fallbacks are counted? | 35 | development-selected static method, once routing overhead and fallbacks are counted? | ||
| 24 | 36 | ||||
| 25 | ## Hypotheses (each may be rejected) | 37 | ## Hypotheses (each may be rejected) | ||
| 26 | 38 | ||||
| 27 | −- **H1** Lossy compression degrades exact identifiers, decimal numbers, negation and temporal order more than paraphrasable content: | 39 | +- **H1** Lossy compression degrades exact identifiers, decimal numbers, negation and | ||
| 28 | − on the synthetic private-fact family, the accuracy drop from A1 to A4 at a 512-token budget is larger (>= 10 percentage points) | 40 | + temporal order more than paraphrasable content: | ||
| 29 | − for `exact_copy`, `negation`, and `revision` question types than for `single_fact` questions. | 41 | + on the synthetic private-fact family, the accuracy drop from A1 to A4 at a 512-token | ||
| 30 | −- **H2** Packed KV quantization is model-dependent: at 4 bits/group 64, Llama-3.2-3B retains >= 95 % of its B0 accuracy while | 42 | + budget is larger (>= 10 percentage points) | ||
| 31 | − Qwen2.5-3B loses >= 20 percentage points (motivated by E0 smoke: Qwen2.5-1.5B produced garbage at 4-bit in both the native | 43 | + for `exact_copy`, `negation`, and `revision` question types than for `single_fact` | ||
| 44 | + questions. | ||||
| 45 | +- **H2** Packed KV quantization is model-dependent: at 4 bits/group 64, Llama-3.2-3B retains | ||||
| 46 | + >= 95 % of its B0 accuracy while | ||||
| 47 | + Qwen2.5-3B loses >= 20 percentage points (motivated by E0 smoke: Qwen2.5-1.5B produced | ||||
| 48 | + garbage at 4-bit in both the native | ||||
| 32 | mlx_lm path and ours; Llama-3.2-3B did not). 8-bit retains >= 97 % for both. | 49 | mlx_lm path and ours; Llama-3.2-3B did not). 8-bit retains >= 97 % for both. | ||
| 33 | −- **H3** Sink+recent eviction (B3) at <= 1/4 retention is worse than a *question-aware* attention-informed selection (B5-aware) | 50 | +- **H3** Sink+recent eviction (B3) at <= 1/4 retention is worse than a *question-aware* | ||
| 34 | − at equal retained positions, but **not** reliably better than random selection (B4) on questions whose answer lies in the | 51 | + attention-informed selection (B5-aware) | ||
| 52 | + at equal retained positions, but **not** reliably better than random selection (B4) on | ||||
| 53 | + questions whose answer lies in the | ||||
| 35 | middle of the document. | 54 | middle of the document. | ||
| 36 | −- **H4** Serialized cache bytes exceed raw UTF-8 document bytes by >= 2 orders of magnitude for 3B models; hence B1 transfer only | 55 | +- **H4** Serialized cache bytes exceed raw UTF-8 document bytes by >= 2 orders of magnitude | ||
| 37 | − wins on total latency when (a) the receiver's prefill cost exceeds transport time, which on the measured LAN requires contexts | 56 | + for 3B models; hence B1 transfer only | ||
| 38 | − above a break-even length we will estimate (prediction: several thousand tokens), or (b) the cache is reused >= N* times. | 57 | + wins on total latency when (a) the receiver's prefill cost exceeds transport time, which | ||
| 39 | −- **H5** Repeated prose handoffs lose facts monotonically; after 4 handoffs the retained-correct-fact rate of A4 chains falls below | 58 | + on the measured LAN requires contexts | ||
| 40 | − 70 % while A5 (structured, explicit unknowns) stays above 85 %; unsupported additions appear mainly in prose chains. | 59 | + above a break-even length we will estimate (prediction: several thousand tokens), or (b) | ||
| 41 | −- **H6** Metered retrieval (A6, repairable chains) restores most of the lost exact facts but adds fetched bytes comparable to | 60 | + the cache is reused >= N* times. | ||
| 61 | +- **H5** Repeated prose handoffs lose facts monotonically; after 4 handoffs the | ||||
| 62 | + retained-correct-fact rate of A4 chains falls below | ||||
| 63 | + 70 % while A5 (structured, explicit unknowns) stays above 85 %; unsupported additions | ||||
| 64 | + appear mainly in prose chains. | ||||
| 65 | +- **H6** Metered retrieval (A6, repairable chains) restores most of the lost exact facts but | ||||
| 66 | + adds fetched bytes comparable to | ||||
| 42 | the message itself. | 67 | the message itself. | ||
| 43 | −- **H7** Question-aware compression dominates question-blind compression at equal budget for *all* lossy methods; the gap is | 68 | +- **H7** Question-aware compression dominates question-blind compression at equal budget for | ||
| 69 | + *all* lossy methods; the gap is | ||||
| 44 | largest for attention-based selection (which is query-dependent by construction). | 70 | largest for attention-based selection (which is query-dependent by construction). | ||
| 45 | −- **H8** A lossless transport codec (A7, zstd) on text yields >= 2x byte savings with < 5 ms overhead but **no** change in receiver | 71 | +- **H8** A lossless transport codec (A7, zstd) on text yields >= 2x byte savings with < 5 ms | ||
| 72 | + overhead but **no** change in receiver | ||||
| 46 | latency or quality; on bf16 KV tensors the codec yields < 1.3x (high-entropy payload). | 73 | latency or quality; on bf16 KV tensors the codec yields < 1.3x (high-entropy payload). | ||
| 47 | −- **H9** The adaptive router (E8) will not reliably beat the best development-selected static method on held-out data once | 74 | +- **H9** The adaptive router (E8) will not reliably beat the best development-selected | ||
| 75 | + static method on held-out data once | ||||
| 48 | overhead is included (we expect a null or small, uncertain gain). | 76 | overhead is included (we expect a null or small, uncertain gain). | ||
| 49 | −- **H10** Cross-family cache transfer without a trained mapper is not possible; with a mapper trained under our budget (if feasible), | 77 | +- **H10** Cross-family cache transfer without a trained mapper is not possible; with a | ||
| 50 | − quality is below the receiver's own A4 summary baseline (we expect learned transfer to lose to text at our scale). | 78 | + mapper trained under our budget (if feasible), | ||
| 79 | + quality is below the receiver's own A4 summary baseline (we expect learned transfer to | ||||
| 80 | + lose to text at our scale). | ||||
| 51 | 81 | ||||
| 52 | ## Primary endpoints (frozen at Phase 7 together with the matrix) | 82 | ## Primary endpoints (frozen at Phase 7 together with the matrix) | ||
| 53 | 83 | ||||
| 54 | −Per task family: exact-match / F1 (LongBench normalization) or numeric correctness with tolerance; operational success rate; | 84 | +Per task family: exact-match / F1 (LongBench normalization) or numeric correctness with | ||
| 55 | −serialized payload bytes; end-to-end wall time (defined boundaries, S6.1 of the brief); peak MLX memory. | 85 | + tolerance; operational success rate; | ||
| 86 | +serialized payload bytes; end-to-end wall time (defined boundaries, ?6.1 of the brief); peak | ||||
| 87 | + MLX memory. | ||||
| 56 | 88 | ||||
| 57 | ## Primary confirmatory comparison family (Holm-corrected; everything else exploratory) | 89 | ## Primary confirmatory comparison family (Holm-corrected; everything else exploratory) | ||
| 58 | 90 | ||||
@@ -67,4 +99,46 @@ serialized payload bytes; end-to-end wall time (defined boundaries, S6.1 of the | |||||
| 67 | 99 | ||||
| 68 | (none yet) | 100 | (none yet) | ||
| 69 | 101 | ||||
| 102 | +- **A-001 (2026-10-30, before freeze, after pilot on dev only).** Core matrix bounded for | ||||
| 103 | + run time: 40 test documents per family (synthetic and | ||||
| 104 | + exec = all; public = first 40 in manifest order), 5 questions per synthetic document, | ||||
| 105 | + question-aware A4/A5 limited to the first 3 questions | ||||
| 106 | + of synthetic documents only; one sender budget (512 tokens) and one retention ratio (1/4) | ||||
| 107 | + in the registered comparisons; B2 at 8 and 4 bits | ||||
| 108 | + (2-bit dropped from the core: pilot showed total failure on Qwen and no additional | ||||
| 109 | + information). Campaign sharded by model pair across two | ||||
| 110 | + machines (D-015). Track C uses the ridge mapper v2 (D-016). None of these changes used | ||||
| 111 | + test outcomes. | ||||
| 112 | +- **A-002 (2026-10-30).** Pilot observation recorded without changing hypotheses: on dev, A5 | ||||
| 113 | + (structured) was *below* A4 (summary) at the same | ||||
| 114 | + budget; H1/T1 are kept as registered and may be rejected on test. | ||||
| 115 | +- **A-003 (2026-10-30 06:40 UTC, after test outcomes of the Qwen shard were examined).** | ||||
| 116 | + Non-scientific code changes after the freeze, listed | ||||
| 117 | + for transparency: (i) `runner.py`/`chains.py`/`fanin.py`: `hardware_id` derived from the | ||||
| 118 | + hostname instead of a laptop constant (records | ||||
| 119 | + produced on cluster nodes before the fix are relabelled by | ||||
| 120 | + `scripts/collect_remote_results.sh`); (ii) `reproduce.py`: trial keys of the | ||||
| 121 | + reproduction use the frozen protocol hash; (iii) `router.py`/`router_eval.py`: the static | ||||
| 122 | + baseline for the question-aware regime is the | ||||
| 123 | + dev-best *aware-eligible* action (`A3|512|aware` on dev) instead of the blind dev-best | ||||
| 124 | + (`A1`), and an explicit `B5-aware` static baseline was | ||||
| 125 | + added -- the router's own decision rule, feature set, cost column, tau and dev-fitted | ||||
| 126 | + table are unchanged. None of these changes alters any | ||||
| 127 | + trial key, prompt, budget, scorer, dataset, or hypothesis; `protocol/frozen.json` keeps | ||||
| 128 | + the v1 hash used in all trial keys, and the | ||||
| 129 | + post-freeze file hashes are recorded in `protocol/frozen_v1.1.json` (the campaign configs | ||||
| 130 | + differ from v1 only by the injected `protocol_hash` field, written immediately after the | ||||
| 131 | + freeze). | ||||
| 132 | +- **A-004 (2026-10-30 08:40 UTC, EXPLORATORY, after core outcomes were examined).** The | ||||
| 133 | + 5-question core limit (A-001) kept only the first five | ||||
| 134 | + generator questions per synthetic document (2x single fact, 2x exact copy, 1x multi-hop), | ||||
| 135 | + so H1's negation/revision/aggregation/unanswerable | ||||
| 136 | + types were not covered by the confirmatory run. An exploratory extension `E7_qtypes` runs | ||||
| 137 | + questions 6-15 of the 40 synthetic test documents | ||||
| 138 | + for A1, A3-blind, A4-blind, A5-blind, B2-8bit, B3 and B5-aware on both pairs. It is | ||||
| 139 | + labelled exploratory everywhere; no confirmatory test | ||||
| 140 | + is attached to it. Also recorded: A8 (LLMLingua-2) failed with `implementation_error` on | ||||
| 141 | + M3U96a for the Llama pair (no torch in that | ||||
| 142 | + environment); those 240 trials are retried on the laptop as new attempts | ||||
| 143 | + (`core_llama_a8_retry.yaml`), both attempts kept. | ||||
| 70 | \end{verbatim}\end{footnotesize} | 144 | \end{verbatim}\end{footnotesize} | ||
modified
paper/appendix/prompts_verbatim.tex
+33 −18
@@ -1,34 +1,49 @@ | |||||
| 1 | % auto-generated from src/wp30/prompts.py | 1 | % auto-generated from src/wp30/prompts.py | ||
| 2 | \begin{footnotesize}\begin{verbatim} | 2 | \begin{footnotesize}\begin{verbatim} | ||
| 3 | −"""Prompt templates (frozen at Phase 7). Receiver prompts are identical across methods except for the message slot.""" | 3 | +"""Prompt templates (frozen at Phase 7). Receiver prompts are identical across methods | ||
| 4 | −SYSTEM_RECEIVER = ("You are a careful assistant. Answer the question using ONLY the provided material. " | 4 | + except for the message slot.""" | ||
| 5 | +SYSTEM_RECEIVER = ("You are a careful assistant. Answer the question using ONLY the provided | ||||
| 6 | + material. " | ||||
| 5 | "If the material does not contain the answer, reply exactly: unknown.") | 7 | "If the material does not contain the answer, reply exactly: unknown.") | ||
| 6 | −SYSTEM_RECEIVER_NOMSG = ("You are a careful assistant. Answer the question. If you do not know, reply exactly: unknown.") | 8 | +SYSTEM_RECEIVER_NOMSG = ("You are a careful assistant. Answer the question. If you do not | ||
| 9 | + know, reply exactly: unknown.") | ||||
| 7 | 10 | ||||
| 8 | −def receiver_user_text(material_label: str, material: str, question: str, family: str) -> str: | 11 | +def receiver_user_text(material_label: str, material: str, question: str, family: str) -> | ||
| 12 | + str: | ||||
| 9 | if family == "exec": | 13 | if family == "exec": | ||
| 10 | − return f"{material_label}:\\n{material}\\n\\nTask: {question}" | 14 | + return f"{material_label}:\n{material}\n\nTask: {question}" | ||
| 11 | fmt = "Give a short answer (a few words or a number), with no explanation." | 15 | fmt = "Give a short answer (a few words or a number), with no explanation." | ||
| 12 | − return f"{material_label}:\\n{material}\\n\\nQuestion: {question}\\n{fmt}" | 16 | + return f"{material_label}:\n{material}\n\nQuestion: {question}\n{fmt}" | ||
| 13 | 17 | ||||
| 14 | def receiver_question_only(question: str, family: str) -> str: | 18 | def receiver_question_only(question: str, family: str) -> str: | ||
| 15 | if family == "exec": | 19 | if family == "exec": | ||
| 16 | return f"Task: {question}" | 20 | return f"Task: {question}" | ||
| 17 | − return f"Question: {question}\\nGive a short answer (a few words or a number), with no explanation." | 21 | + return f"Question: {question}\nGive a short answer (a few words or a number), with no | ||
| 22 | + explanation." | ||||
| 18 | 23 | ||||
| 19 | # Sender prompts (question-blind: no question shown; question-aware: question appended) | 24 | # Sender prompts (question-blind: no question shown; question-aware: question appended) | ||
| 20 | −SUMMARY_SYSTEM = "You are a precise note-taker. You write faithful summaries that preserve exact names, identifiers, numbers, units, dates, statuses and negations." | 25 | +SUMMARY_SYSTEM = "You are a precise note-taker. You write faithful summaries that preserve | ||
| 26 | + exact names, identifiers, numbers, units, dates, statuses and negations." | ||||
| 21 | def summary_user(doc: str, budget_tokens: int, question: str | None) -> str: | 27 | def summary_user(doc: str, budget_tokens: int, question: str | None) -> str: | ||
| 22 | − q = f"\\nThe reader will need to answer this question: {question}\\n" if question else "\\nThe reader's future questions are unknown; preserve every concrete fact (who, what, where, when, how much, status).\\n" | 28 | + q = f"\nThe reader will need to answer this question: {question}\n" if question else | ||
| 23 | − return (f"Summarize the following document in at most {budget_tokens} tokens (about {int(budget_tokens*0.75)} words). Copy identifiers, " | 29 | + "\nThe reader's future questions are unknown; preserve every concrete fact (who, what, | ||
| 24 | − f"numbers, dates and names exactly as written. Mark explicitly what is NOT stated if relevant.{q}\\nDocument:\\n{doc}\\n\\nSummary:") | 30 | + where, when, how much, status).\n" | ||
| 31 | + return (f"Summarize the following document in at most {budget_tokens} tokens (about | ||||
| 32 | + {int(budget_tokens*0.75)} words). Copy identifiers, " | ||||
| 33 | + f"numbers, dates and names exactly as written. Mark explicitly what is NOT | ||||
| 34 | + stated if relevant.{q}\nDocument:\n{doc}\n\nSummary:") | ||||
| 25 | 35 | ||||
| 26 | −EVIDENCE_SYSTEM = ("You extract structured evidence. Output ONLY a JSON object with a key \\"facts\\": a list of objects " | 36 | +EVIDENCE_SYSTEM = ("You extract structured evidence. Output ONLY a JSON object with a key | ||
| 27 | − "{\\"entity\\": str, \\"attribute\\": str, \\"value\\": str, \\"quote\\": str} where quote is a short EXACT substring of the document " | 37 | + \"facts\": a list of objects " | ||
| 28 | − "supporting the fact, and optionally a key \\"notes\\": a short string for anything important that does not fit the schema, " | 38 | + "{\"entity\": str, \"attribute\": str, \"value\": str, \"quote\": str} | ||
| 29 | − "and a key \\"unknowns\\": list of things the document explicitly leaves unstated. Copy values verbatim.") | 39 | + where quote is a short EXACT substring of the document " | ||
| 40 | + "supporting the fact, and optionally a key \"notes\": a short string for | ||||
| 41 | + anything important that does not fit the schema, " | ||||
| 42 | + "and a key \"unknowns\": list of things the document explicitly leaves | ||||
| 43 | + unstated. Copy values verbatim.") | ||||
| 30 | def evidence_user(doc: str, budget_tokens: int, question: str | None) -> str: | 44 | def evidence_user(doc: str, budget_tokens: int, question: str | None) -> str: | ||
| 31 | − q = f"\\nThe reader will need to answer this question: {question}\\n" if question else "\\nThe reader's future questions are unknown; capture every concrete fact.\\n" | 45 | + q = f"\nThe reader will need to answer this question: {question}\n" if question else | ||
| 32 | − return f"Extract structured evidence from the document. Keep the JSON under {budget_tokens} tokens.{q}\\nDocument:\\n{doc}\\n\\nJSON:" | 46 | + "\nThe reader's future questions are unknown; capture every concrete fact.\n" | ||
| 33 | − | 47 | + return f"Extract structured evidence from the document. Keep the JSON under | ||
| 48 | + {budget_tokens} tokens.{q}\nDocument:\n{doc}\n\nJSON:" | ||||
| 34 | \end{verbatim}\end{footnotesize} | 49 | \end{verbatim}\end{footnotesize} | ||
modified
paper/figures/fig2_quality_vs_bytes.pdf
+0 −0
Binary file not shown.
modified
paper/figures/fig3_quality_vs_latency_memory.pdf
+0 −0
Binary file not shown.
modified
paper/figures/fig4_latency_decomposition.pdf
+0 −0
Binary file not shown.
modified
paper/figures/fig5_handoffs.pdf
+0 −0
Binary file not shown.
modified
paper/figures/fig6_breakeven.pdf
+0 −0
Binary file not shown.
modified
paper/figures/fig7_router.pdf
+0 −0
Binary file not shown.
added
paper/figures/figA_qtypes_exploratory.pdf
+0 −0
Binary file not shown.
modified
paper/figures/figA_quality_vs_bytes_aware.pdf
+0 −0
Binary file not shown.
modified
paper/figures/figA_quality_vs_bytes_blind.pdf
+0 −0
Binary file not shown.
modified
paper/main.pdf
+0 −0
Binary file not shown.
modified
paper/sections/abstract_text.tex
+21 −1
@@ -1 +1,21 @@ | |||||
| 1 | −\newcommand{\WPabstract}{Abstract to be written after the results.} | 1 | +\newcommand{\WPabstract}{% | ||
| 2 | +Agents built on language models hand information to one another as text, summaries, structured evidence, shared-memory references or---when | ||||
| 3 | +they share a checkpoint---attention state (KV cache). We ask under which task, model, cache, network and reuse conditions each representation | ||||
| 4 | +preserves task-relevant information at the lowest end-to-end cost, and answer with a reproducible study executed by an autonomous research | ||||
| 5 | +operator (Claude Code) on Apple-Silicon hardware with the MLX runtime, whose caches are inspectable tensors. Twenty-two conditions (text | ||||
| 6 | +truncation, extractive selection, summaries, structured evidence with spans, references with metered retrieval, a lossless codec, LLMLingua-2, | ||||
| 7 | +native and serialized caches, packed 8/4-bit quantization, sink-plus-recent, random, SnapKV-style and PyramidKV-style eviction) are measured on | ||||
| 8 | +Qwen2.5-3B and Llama-3.2-3B across private-fact ledgers, LongBench QA and executable tasks, in question-blind and question-aware regimes, with | ||||
| 9 | +measured bytes, synchronized latency spans and peak memory (13\,280 trials; frozen protocol, cluster bootstrap, Holm-corrected tests). Further | ||||
| 10 | +experiments measure two-node cache transfer over a 1~GbE LAN (324 runs), relays of 1--8 handoffs with an evaluator-only fact ledger (7\,200), | ||||
| 11 | +fan-in with conflicting evidence (1\,600), a same-family learned KV mapper, hosted receivers (672) and a development-fitted router. Lossless | ||||
| 12 | +representations are interchangeable in quality and differ only in cost, whose ranking inverts between cold and reused regimes; on the measured | ||||
| 13 | +link, moving an 8-bit cache beats re-reading the text at every length. Lossy choices are model- and regime-dependent: 4-bit quantization is free | ||||
| 14 | +for Llama and fatal for Qwen; attention-based eviction keeps 78--98\,\% of private-fact accuracy with the question and 12--19\,\% without it, and | ||||
| 15 | +no eviction survives a code specification. At a 512-token budget prose summaries beat structured evidence (38--44 vs 12--15\,\%), relays are | ||||
| 16 | +nearly lossless after the first hop and invent almost nothing, and metered repair buys a few points for kilobytes of re-reading. A ridge KV mapper | ||||
| 17 | +transfers no content while producing coherent abstention, and an invalid cache concatenation yields plausible answers---both argue for | ||||
| 18 | +compatibility manifests and negative controls. The router halves amortized latency at equal quality when questions are unknown and does not help | ||||
| 19 | +otherwise. Cross-family cache transfer was not executed; the study is partial in that respect. Code, records, protocol, checkpoint and a | ||||
| 20 | +minimal reproduction (64/64 identical outputs) are released.% | ||||
| 21 | +} | ||||
modified
paper/sections/conclusion.tex
+21 −1
@@ -1,3 +1,23 @@ | |||||
| 1 | \section{Conclusion} | 1 | \section{Conclusion} | ||
| 2 | \label{sec:conclusion} | 2 | \label{sec:conclusion} | ||
| 3 | −To be written from results. | 3 | +We asked under which conditions each way of passing information between model executions preserves what matters at the lowest measured cost, | ||
| 4 | +and we answered with a single harness on commodity hardware, real cache tensors, measured bytes and synchronized clocks, released records for | ||||
| 5 | +every attempt, and a protocol frozen before the test split was touched. The bounded findings are these. (1) Lossless representations are | ||||
| 6 | +interchangeable: text, its zstd encoding, the native cache, the reloaded cache and the 8-bit packed cache give identical answers; the choice | ||||
| 7 | +among them is a pure cost question, and the cost ranking flips between the cold case (text wins: no build) and the reused case (cache wins: | ||||
| 8 | +no prefill), with a 1~GbE link and a 3B model already favouring moving an 8-bit cache over re-reading at two thousand tokens. | ||||
| 9 | +(2) Every lossy choice we measured is model- or regime-dependent: 4-bit per-token quantization is free for Llama-3.2-3B and fatal for | ||||
| 10 | +Qwen2.5-3B; attention-based eviction is excellent with the question and useless without it, and no eviction survives a code specification; | ||||
| 11 | +LLMLingua-2 drops exactly the identifiers private-fact questions ask for. (3) At a 512-token sender budget, prose summaries carried more than | ||||
| 12 | +structured evidence with provenance, in single handoffs, in eight-hop relays and in fan-in, because provenance is paid in the sender's tokens; | ||||
| 13 | +relays themselves were nearly lossless after the first hop and invented almost nothing, and metered repair bought a few points for kilobytes of | ||||
| 14 | +re-reading. (4) A same-family linear KV mapper that reconstructs most of the receiver's cache variance transfers no content, and produces the | ||||
| 15 | +most dangerous kind of failure---coherent abstention---while an invalid cache concatenation produced plausible answers; compatibility manifests | ||||
| 16 | +and negative controls are therefore part of any cache-transfer protocol, not an afterthought. (5) A router fitted on development data matched | ||||
| 17 | +the best static policy at half the amortized latency when questions were unknown and offered nothing when they were known. | ||||
| 18 | + | ||||
| 19 | +Open questions follow directly. The structured-evidence result should be re-run with budgets that separate provenance from values and with | ||||
| 20 | +senders large enough to fill them; the break-even map needs a faster receiver and a slower link to locate its crossing; the transfer ladder's | ||||
| 21 | +cross-family rung needs a trained mapper with generation and distillation terms, and its evaluation must keep the sender-alone and | ||||
| 22 | +receiver-alone references and an identity control beside it; and the fixed-point behaviour of structured relays suggests that the first | ||||
| 23 | +message, not the chain, is where compression research for multi-agent systems should concentrate. | ||||
modified
paper/sections/results_transfer.tex
+28 −1
@@ -1 +1,28 @@ | |||||
| 1 | −% pending | 1 | +\subsection{Cross-checkpoint transfer: the same-family linear mapper (E3)} | ||
| 2 | +\label{sec:transfer} | ||||
| 3 | +Table~\ref{tab:transfer} reports the compatibility ladder's second rung on the synthetic (27 documents of 2k and 8k tokens, 8 questions each) and | ||||
| 4 | +executable (40) test items: the receiver Qwen2.5-3B reading the document itself (A1), the sender Qwen2.5-1.5B's own answers with full context | ||||
| 5 | +(sender alone), two text handoffs from the 1.5B sender (A4, A5), the identity-transfer negative control (C0: sender cache fed to the receiver | ||||
| 6 | +without mapping) and the ridge mapper (C2) alone and followed by question-aware selection (C3). The mapper was fitted on 60 training documents | ||||
| 7 | +(248\,569 token positions, 28.3~M parameters, 483~s on M3U96b, held-out reconstruction error $0.10$ for keys and $0.32$ for values, relative | ||||
| 8 | +Frobenius; \texttt{runs/checkpoints}); it needs the sender's cache and nothing else at the receiver (no source text, no prefill). | ||||
| 9 | + | ||||
| 10 | +\begin{table}[t]\centering\scriptsize | ||||
| 11 | +\caption{Same-family transfer Qwen2.5-1.5B $\to$ Qwen2.5-3B (test split; M3U96a). Accuracy (\%, 95\,\% cluster-bootstrap CI), share of answers | ||||
| 12 | +containing ``unknown'', accuracy by question type, median payload and warm per-query latency. Negation questions are yes/no.}\label{tab:transfer} | ||||
| 13 | +\adjustbox{max width=\textwidth}{\input{tables/table_transfer}} | ||||
| 14 | +\end{table} | ||||
| 15 | + | ||||
| 16 | +\paragraph{The mapped cache is well-formed but empty (H10 confirmed).} The receiver generates fluent, on-task text from the mapped cache---it | ||||
| 17 | +answers ``unknown'' 69\,\% of the time and never produces the garbled tokens of the identity control---but it recovers essentially none of the | ||||
| 18 | +content: 0\,\% on multi-hop, 2--4\,\% on single facts and exact copies, 0\,\% on code. Its aggregate score of 24.5\,\% comes from the yes/no negation | ||||
| 19 | +questions (93\,\%), which a receiver that answers ``no'' by default gets right at the base rate (70\,\% of projects are not cancelled); the sender's | ||||
| 20 | +own full-context answers show that the facts were available on the sender side (96\,\%). The 1.5B sender's prose summary transfers more | ||||
| 21 | +(28\,\%, 72\,\% on negation, 9--20\,\% on content) and its structured extraction less (12\,\%); the paired difference between the mapper and the | ||||
| 22 | +summary is $-3.7$ points (95\,\% CI $[-11.6, +4.2]$, $p=0.37$), and between the mapper and the receiver's own reading $-75$ points. Selection on | ||||
| 23 | +the mapped cache (C3) changes nothing. A linear map that explains 68\,\% of the receiver's value variance on held-out documents is therefore | ||||
| 24 | +not enough to carry a single identifier across checkpoints: cross-checkpoint transfer needs the generation and distillation terms that | ||||
| 25 | +published mappers train with, at a cost we did not have; the measured by-product is that a \emph{wrong} cache can be indistinguishable from an | ||||
| 26 | +empty one in the receiver's behaviour (coherent abstention), which is why Section~\ref{sec:fanin}'s manifests matter. Rungs 1 (same checkpoint, | ||||
| 27 | +two nodes) and 3 (cross-family) are covered by Section~\ref{sec:network} and the coverage table respectively; the cross-family rung was not | ||||
| 28 | +executed. | ||||
added
paper/tables/table_failures.tex
+23 −0
@@ -0,0 +1,23 @@ | |||||
| 1 | +\begin{tabular}{@{}lrrr@{}} | ||||
| 2 | +\toprule | ||||
| 3 | +method & implementation\_error & invalid\_output & success \\ | ||||
| 4 | +\midrule | ||||
| 5 | +A0 & 0 & 0 & 640 \\ | ||||
| 6 | +A1 & 0 & 0 & 640 \\ | ||||
| 7 | +A2 & 0 & 0 & 640 \\ | ||||
| 8 | +A3 & 0 & 0 & 1280 \\ | ||||
| 9 | +A4 & 0 & 0 & 880 \\ | ||||
| 10 | +A5 & 0 & 0 & 880 \\ | ||||
| 11 | +A6 & 0 & 0 & 640 \\ | ||||
| 12 | +A7 & 0 & 0 & 640 \\ | ||||
| 13 | +A8 & 240 & 0 & 640 \\ | ||||
| 14 | +B0 & 0 & 0 & 640 \\ | ||||
| 15 | +B1 & 0 & 0 & 640 \\ | ||||
| 16 | +B2 & 0 & 29 & 1251 \\ | ||||
| 17 | +B3 & 0 & 0 & 640 \\ | ||||
| 18 | +B4 & 0 & 45 & 595 \\ | ||||
| 19 | +B5 & 0 & 0 & 1280 \\ | ||||
| 20 | +B6 & 0 & 0 & 640 \\ | ||||
| 21 | +B9 & 0 & 0 & 640 \\ | ||||
| 22 | +\bottomrule | ||||
| 23 | +\end{tabular} | ||||
modified
paper/tables/table_primary.tex
+1 −1
@@ -13,7 +13,7 @@ A5 512 aware & 100 [100,100] & 95 [91,98] & -- & -- & -- & -- & -- & -- \\ | |||||
| 13 | A5 512 blind & 15 [12,18] & 12 [9,16] & 12 [2,22] & 0 [0,0] & 9 [2,18] & 5 [1,11] & 12 [4,23] & 6 [0,13] \\ | 13 | A5 512 blind & 15 [12,18] & 12 [9,16] & 12 [2,22] & 0 [0,0] & 9 [2,18] & 5 [1,11] & 12 [4,23] & 6 [0,13] \\ | ||
| 14 | A6 512 blind & 18 [14,22] & 18 [14,22] & 22 [10,35] & 15 [5,28] & 9 [2,17] & 7 [2,13] & 11 [2,22] & 10 [2,19] \\ | 14 | A6 512 blind & 18 [14,22] & 18 [14,22] & 22 [10,35] & 15 [5,28] & 9 [2,17] & 7 [2,13] & 11 [2,22] & 10 [2,19] \\ | ||
| 15 | A7 zstd & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 39 [25,54] & 33 [20,47] \\ | 15 | A7 zstd & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 39 [25,54] & 33 [20,47] \\ | ||
| 16 | −A8 512 blind & 14 [9,18] & 0 [0,0] & 0 [0,0] & 0 [0,0] & 17 [10,25] & 23 [13,33] & 6 [0,14] & 8 [0,18] \\ | 16 | +A8 512 blind & 14 [9,18] & 16 [10,22] & 0 [0,0] & 0 [0,0] & 17 [10,25] & 23 [13,33] & 6 [0,14] & 8 [0,18] \\ | ||
| 17 | B0 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | 17 | B0 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | ||
| 18 | B1 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | 18 | B1 & 99 [98,100] & 99 [98,100] & 100 [100,100] & 95 [88,100] & 35 [24,47] & 25 [15,36] & 36 [22,50] & 33 [20,47] \\ | ||
| 19 | B2 bits=4 & 0 [0,0] & 98 [94,100] & 0 [0,0] & 100 [100,100] & 1 [0,2] & 25 [15,36] & 0 [0,1] & 22 [10,34] \\ | 19 | B2 bits=4 & 0 [0,0] & 98 [94,100] & 0 [0,0] & 100 [100,100] & 1 [0,2] & 25 [15,36] & 0 [0,1] & 22 [10,34] \\ | ||
added
paper/tables/table_qtype_core.tex
+28 −0
@@ -0,0 +1,28 @@ | |||||
| 1 | +\begin{tabular}{@{}lrrr@{}} | ||||
| 2 | +\toprule | ||||
| 3 | +condition & exact\_copy & multi\_hop & single\_fact \\ | ||||
| 4 | +\midrule | ||||
| 5 | +A0 & 0 [0,0] & 0 [0,0] & 0 [0,0] \\ | ||||
| 6 | +A1 & 99 [98,100] & 98 [94,100] & 99 [98,100] \\ | ||||
| 7 | +A2 512 & 14 [8,20] & 20 [8,32] & 26 [18,35] \\ | ||||
| 8 | +A3 512 aware & 99 [98,100] & 92 [86,98] & 100 [100,100] \\ | ||||
| 9 | +A3 512 blind & 51 [50,52] & 94 [88,99] & 0 [0,0] \\ | ||||
| 10 | +A4 512 aware & 79 [69,88] & -- & 94 [90,98] \\ | ||||
| 11 | +A4 512 blind & 45 [38,53] & 46 [35,57] & 34 [24,45] \\ | ||||
| 12 | +A5 512 aware & 98 [94,100] & -- & 98 [96,99] \\ | ||||
| 13 | +A5 512 blind & 13 [8,18] & 11 [4,21] & 16 [10,22] \\ | ||||
| 14 | +A6 512 blind & 15 [9,21] & 16 [6,26] & 21 [14,29] \\ | ||||
| 15 | +A7 zstd & 99 [98,100] & 98 [94,100] & 99 [98,100] \\ | ||||
| 16 | +A8 512 blind & 10 [5,16] & 5 [1,10] & 24 [16,34] \\ | ||||
| 17 | +B0 & 99 [98,100] & 98 [94,100] & 99 [98,100] \\ | ||||
| 18 | +B1 & 99 [98,100] & 98 [94,100] & 99 [98,100] \\ | ||||
| 19 | +B2 bits=4 & 49 [47,50] & 49 [46,50] & 49 [47,50] \\ | ||||
| 20 | +B2 bits=8 & 99 [98,100] & 98 [94,100] & 99 [98,100] \\ | ||||
| 21 | +B3 1/4 & 31 [23,38] & 12 [2,22] & 11 [5,18] \\ | ||||
| 22 | +B4 1/4 & 0 [0,0] & 0 [0,0] & 0 [0,0] \\ | ||||
| 23 | +B5 1/4 aware & 97 [94,99] & 82 [76,90] & 82 [79,86] \\ | ||||
| 24 | +B5 1/4 blind & 20 [13,27] & 15 [8,22] & 11 [6,17] \\ | ||||
| 25 | +B6 1/4 aware & 92 [88,96] & 78 [69,85] & 74 [71,76] \\ | ||||
| 26 | +B9 bits=8 1/4 att aware & 97 [94,99] & 84 [78,90] & 82 [79,86] \\ | ||||
| 27 | +\bottomrule | ||||
| 28 | +\end{tabular} | ||||
added
paper/tables/table_qtypes_exploratory.tex
+20 −0
@@ -0,0 +1,20 @@ | |||||
| 1 | +\begin{tabular}{@{}lrrrrrrr@{}} | ||||
| 2 | +\toprule | ||||
| 3 | +condition / pair & aggregation & multi\_hop & negation & revision & temporal & unanswerable & unit\_conversion \\ | ||||
| 4 | +\midrule | ||||
| 5 | +A1 Llama-3.2-3B & 0 [0,0] & 100 [100,100] & 90 [80,100] & 73 [58,88] & 47 [20,73] & 100 [100,100] & 0 [0,0] \\ | ||||
| 6 | +A1 Qwen2.5-3B & 0 [0,0] & 100 [100,100] & 100 [100,100] & 94 [84,100] & 44 [22,69] & 97 [91,100] & 50 [25,75] \\ | ||||
| 7 | +A3 512 blind Llama-3.2-3B & 0 [0,0] & 0 [0,0] & 83 [70,93] & 73 [57,87] & 53 [33,73] & 100 [100,100] & 0 [0,0] \\ | ||||
| 8 | +A3 512 blind Qwen2.5-3B & 0 [0,0] & 0 [0,0] & 93 [83,100] & 73 [53,90] & 33 [13,53] & 100 [100,100] & 0 [0,0] \\ | ||||
| 9 | +A4 512 blind Llama-3.2-3B & 0 [0,0] & 33 [7,60] & 100 [100,100] & 17 [3,33] & 20 [0,40] & 100 [100,100] & 0 [0,0] \\ | ||||
| 10 | +A4 512 blind Qwen2.5-3B & 0 [0,0] & 44 [19,69] & 72 [53,88] & 26 [13,43] & 33 [13,53] & 100 [100,100] & 40 [13,67] \\ | ||||
| 11 | +A5 512 blind Llama-3.2-3B & 0 [0,0] & 13 [0,33] & 50 [37,63] & 13 [0,30] & 13 [0,33] & 100 [100,100] & 0 [0,0] \\ | ||||
| 12 | +A5 512 blind Qwen2.5-3B & 0 [0,0] & 20 [7,40] & 53 [37,70] & 10 [0,27] & 0 [0,0] & 100 [100,100] & 20 [0,40] \\ | ||||
| 13 | +B2 bits=8 Llama-3.2-3B & 0 [0,0] & 100 [100,100] & 90 [80,100] & 73 [58,88] & 47 [20,73] & 100 [100,100] & 0 [0,0] \\ | ||||
| 14 | +B2 bits=8 Qwen2.5-3B & 0 [0,0] & 100 [100,100] & 100 [100,100] & 93 [83,100] & 40 [13,67] & 97 [90,100] & 60 [33,87] \\ | ||||
| 15 | +B3 1/4 Llama-3.2-3B & 0 [0,0] & 20 [0,40] & 73 [60,83] & 7 [0,17] & 53 [27,73] & 93 [80,100] & 0 [0,0] \\ | ||||
| 16 | +B3 1/4 Qwen2.5-3B & 0 [0,0] & 20 [0,40] & 87 [73,97] & 0 [0,0] & 53 [27,73] & 97 [90,100] & 7 [0,20] \\ | ||||
| 17 | +B5 1/4 aware Llama-3.2-3B & 0 [0,0] & 100 [100,100] & 87 [77,97] & 73 [62,87] & 60 [40,80] & 100 [100,100] & 0 [0,0] \\ | ||||
| 18 | +B5 1/4 aware Qwen2.5-3B & 0 [0,0] & 53 [27,80] & 100 [100,100] & 30 [17,43] & 53 [27,80] & 97 [90,100] & 47 [20,73] \\ | ||||
| 19 | +\bottomrule | ||||
| 20 | +\end{tabular} | ||||
added
paper/tables/table_transfer.tex
+22 −0
@@ -0,0 +1,22 @@ | |||||
| 1 | +\begin{tabular}{@{}llrrrrrrrrrr@{}} | ||||
| 2 | +\toprule | ||||
| 3 | +family & condition & n & accuracy (\\%) & `unknown' share & single\_fact & exact\_copy & multi\_hop & negation & exec & payload B & warm ms \\ | ||||
| 4 | +\midrule | ||||
| 5 | +exec & A1 & 40 & 100 [100,100] & 0.00 & -- & -- & -- & -- & 1.00 & 7,817.00 & 1,912.17 \\ | ||||
| 6 | +exec & A4|512|blind & 40 & 0 [0,0] & 0.28 & -- & -- & -- & -- & 0.00 & 938.00 & 1,025.84 \\ | ||||
| 7 | +exec & A5|512|blind & 40 & 0 [0,0] & 0.85 & -- & -- & -- & -- & 0.00 & 936.00 & 215.30 \\ | ||||
| 8 | +exec & C0 & 40 & 0 [0,0] & 0.00 & -- & -- & -- & -- & 0.00 & 69,762,785 & 3,979.97 \\ | ||||
| 9 | +exec & C2 & 40 & 0 [0,0] & 0.00 & -- & -- & -- & -- & 0.00 & 69,762,886 & 1,098.63 \\ | ||||
| 10 | +exec & C3|1/4|aware & 40 & 0 [0,0] & 0.00 & -- & -- & -- & -- & 0.00 & 17,452,748 & 939.02 \\ | ||||
| 11 | +exec & sender alone A1 & 40 & 0 [0,0] & 0.00 & -- & -- & -- & -- & 0.00 & 7,817.00 & 909.11 \\ | ||||
| 12 | +exec & sender alone B0 & 40 & 0 [0,0] & 0.00 & -- & -- & -- & -- & 0.00 & 54,260,105 & 621.42 \\ | ||||
| 13 | +synthetic & A1 & 216 & 100 [99,100] & 0.00 & 1.00 & 1.00 & 0.98 & 1.00 & -- & 7,555.00 & 890.79 \\ | ||||
| 14 | +synthetic & A4|512|blind & 216 & 28 [22,35] & 0.64 & 0.09 & 0.20 & 0.11 & 0.72 & -- & 1,263.00 & 250.39 \\ | ||||
| 15 | +synthetic & A5|512|blind & 216 & 12 [7,16] & 0.73 & 0.07 & 0.09 & 0.07 & 0.22 & -- & 596.00 & 166.89 \\ | ||||
| 16 | +synthetic & C0 & 216 & 0 [0,0] & 0.00 & 0.00 & 0.00 & 0.00 & 0.00 & -- & 77,688,549 & 632.53 \\ | ||||
| 17 | +synthetic & C2 & 216 & 25 [22,27] & 0.69 & 0.02 & 0.04 & 0.00 & 0.93 & -- & 77,688,650 & 85.57 \\ | ||||
| 18 | +synthetic & C3|1/4|aware & 216 & 25 [23,27] & 0.69 & 0.04 & 0.02 & 0.00 & 0.94 & -- & 19,443,415 & 56.23 \\ | ||||
| 19 | +synthetic & sender alone A1 & 216 & 96 [94,98] & 0.00 & 0.98 & 0.98 & 0.94 & 0.93 & -- & 7,555.00 & 448.40 \\ | ||||
| 20 | +synthetic & sender alone B0 & 216 & 95 [93,98] & 0.00 & 0.98 & 0.98 & 0.94 & 0.91 & -- & 60,424,589 & 104.16 \\ | ||||
| 21 | +\bottomrule | ||||
| 22 | +\end{tabular} | ||||
added
results/claim_ledger.csv
+21 −0
@@ -0,0 +1,21 @@ | |||||
| 1 | +claim_id,claim,experiment_ids,evidence_table_or_figure,rows_or_filter,script,status,limitation | ||||
| 2 | +C01,"Lossless representations (A1, A7, B0, B1, B2-8bit) give the same quality within noise on every family and pair",E1_core,"results/tables/E1_core_primary_tests.csv (T2, T6); table_primary","rows T2,T6",analyze.py,confirmed,"two 3B pairs, 160 test documents" | ||||
| 3 | +C02,4-bit packed KV quantization destroys Qwen2.5-3B (0%) but not Llama-3.2-3B (>=97%),E1_core,E1_core_primary.csv B2|bits=4; primary_tests T3,condition B2|bits=4,analyze.py,confirmed (H2),"mlx per-token affine quantization, group 64" | ||||
| 4 | +C03,Attention-informed eviction with the question (B5-aware) beats sink+recent at 1/4 by +44 points; blind window variant collapses,E1_core,primary_tests T4; E1_core_primary.csv,B5 vs B3,analyze.py,"confirmed (H3 first half, H7)",question-aware method | ||||
| 5 | +C04,All eviction methods score 0 on executable tasks at 1/4 retention,E1_core,E1_core_primary.csv family=exec,"B3,B4,B5,B6,B9",analyze.py,measured,"3B receivers, 6-rule spec" | ||||
| 6 | +C05,"Structured evidence (A5) is below prose summary (A4) at the same 512-token budget (-27 points, synthetic)",E1_core,primary_tests T1,T1,analyze.py,H1 rejected,sender spends budget on quotes; ~8 facts of 62 | ||||
| 7 | +C06,zstd shrinks text ~3.5x with no quality/latency effect; ~20% on bf16 caches,"E1_core, E6_core",E1_core_primary.csv A7; E6_network.csv codec=zstd,A7; B1 zstd,analyze.py,confirmed (H8),zstd level 3 | ||||
| 8 | +C07,Serialized 3B cache is 3-4 orders of magnitude larger than the text,"E1_core, E6_core",E1_core_primary.csv payload_bytes_median; E6_network.csv bytes,B0 vs A1,analyze.py,measured,"bf16, Qwen 215 MB vs 29 kB at ~8k tokens" | ||||
| 9 | +C08,"On 1 GbE with an M3 Ultra receiver, moving the cache (bf16 or 8-bit) answers faster than remote text prefill at 2k-16k tokens",E6_core,E6_network.csv; fig6,lan rows,analyze.py,measured,"one link, one receiver; break-even depends on prefill/link ratio" | ||||
| 10 | +C09,Repeated prose/structured relays lose facts at hop 1 and are nearly lossless afterwards (no monotone decay),E4_core,E4_core_handoffs.csv; fig5,hops 1-8,analyze.py,H5 rejected,ledger metric = normalized value containment | ||||
| 11 | +C10,"Unsupported additions are near zero in 7,200 relayed messages",E4_core,E4_core_handoffs.csv unsupported_mean,all chains,analyze.py,measured,regex-based detection | ||||
| 12 | +C11,Metered repair raises prose-chain retention 32->38% and accuracy 40->44% for ~5.9 kB cumulative fetch,E4_core,E4_core_handoffs.csv repairable,A4 repairable,analyze.py,H6 partial,repair limited to entities still named | ||||
| 13 | +C12,Concatenated summaries compose as well as full context on multi-hop joins; merged structured records do not,E5_core,E5_core_fanin.csv; table_fanin,concat_A4 vs merge_A5,analyze.py,measured,"k=2,4; 3B aggregator" | ||||
| 14 | +C13,Cache concatenation of independently prefilled sources yields plausible answers (70% multi-hop at k=2) despite invalid positions,E5_core,E5_core_fanin.csv cache_concat_negative_control,"k=2,4",analyze.py,negative control,diagnostic only | ||||
| 15 | +C14,"Hosted receivers recover 100% from full text, ~30% from the local 512-token summary, 12.5% from structured JSON",ED_hosted_core,ED_hosted.csv; table_hosted,synthetic rows,analyze.py,measured,provider default sampling; 8 documents/family | ||||
| 16 | +C15,"Anthropic prompt caching did not engage below the documented 4,096-token minimum (2k docs) and halved estimated cost on 8k docs",ED_hosted_core,runs/raw/ED_hosted_core.jsonl provider_cached_usage,A1 provider_cache rows,hosted_run.py,measured,billing fields only | ||||
| 17 | +C16,Dev-fitted router matches best static quality at half the amortized latency in the blind regime; no gain and higher cost in the aware regime,E8_router (E1_core records),E8_router_summary.csv; E8_router_tests.csv; fig7,router vs best_static_dev,router_eval.py,H9 mixed,off-policy on full factorial; dev table from pilot | ||||
| 18 | +C17,Linear ridge KV mapper (Qwen 1.5B->3B) yields coherent but uninformative receiver outputs; below sender-summary transfer,E3_core,E3_core tables,C2 vs A4,analyze.py,confirmed (H10): C2 24.5% overall but 0-4% on content questions; negation yes/no at base rate,reconstruction-only mapper; no SwaT reproduction | ||||
| 19 | +C18,Identity round trip and 100% retention reproduce native logits exactly; cached-prefix equivalence holds within registered tolerance,E0 tests,tests/test_cache_correctness.py,12 tests,pytest,confirmed,MLX nondeterminism across chunking documented | ||||
| 20 | +C19,Minimal reproduction reran 64 trials from a clean process with identical outputs and scores,E9,reproduction/report.json,all,reproduce.py,confirmed,"same machine, same chunking" | ||||
| 21 | +C20,Cross-family cache transfer was not executed (no SwaT checkpoint/licence; mapper budget),coverage,literature/audit_group1.md; table1_taxonomy,SwaT row,n/a,coverage gap,partial transfer study | ||||
modified
results/figures/fig2_quality_vs_bytes.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig2_quality_vs_bytes.png
+0 −0
Binary file not shown.
modified
results/figures/fig3_quality_vs_latency_memory.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig4_latency_decomposition.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig5_handoffs.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig6_breakeven.pdf
+0 −0
Binary file not shown.
modified
results/figures/fig7_router.pdf
+0 −0
Binary file not shown.
added
results/figures/figA_qtypes_exploratory.pdf
+0 −0
Binary file not shown.
added
results/figures/figA_qtypes_exploratory.png
+0 −0
Binary file not shown.
modified
results/figures/figA_quality_vs_bytes_aware.pdf
+0 −0
Binary file not shown.
modified
results/figures/figA_quality_vs_bytes_blind.pdf
+0 −0
Binary file not shown.
modified
results/figures/figA_quality_vs_bytes_blind.png
+0 −0
Binary file not shown.
modified
results/provenance.json
+67 −25
@@ -4,7 +4,7 @@ | |||||
| 4 | "runs/raw/E1_core.jsonl" | 4 | "runs/raw/E1_core.jsonl" | ||
| 5 | ], | 5 | ], | ||
| 6 | "script": "src/wp30/analysis/analyze.py", | 6 | "script": "src/wp30/analysis/analyze.py", | ||
| 7 | − "generated_utc": "2026-10-30T08:41:10.888608Z", | 7 | + "generated_utc": "2026-10-30T09:02:37.609345Z", | ||
| 8 | "note": "per-condition quality (cluster bootstrap CI) and resource medians" | 8 | "note": "per-condition quality (cluster bootstrap CI) and resource medians" | ||
| 9 | }, | 9 | }, | ||
| 10 | "results/tables/E1_core_failures.csv": { | 10 | "results/tables/E1_core_failures.csv": { | ||
@@ -12,7 +12,7 @@ | |||||
| 12 | "runs/raw/E1_core.jsonl" | 12 | "runs/raw/E1_core.jsonl" | ||
| 13 | ], | 13 | ], | ||
| 14 | "script": "src/wp30/analysis/analyze.py", | 14 | "script": "src/wp30/analysis/analyze.py", | ||
| 15 | − "generated_utc": "2026-10-30T08:41:10.897925Z", | 15 | + "generated_utc": "2026-10-30T09:02:37.611126Z", | ||
| 16 | "note": "attempt status counts by method" | 16 | "note": "attempt status counts by method" | ||
| 17 | }, | 17 | }, | ||
| 18 | "results/tables/E1_core_by_question_type.csv": { | 18 | "results/tables/E1_core_by_question_type.csv": { | ||
@@ -20,7 +20,7 @@ | |||||
| 20 | "runs/raw/E1_core.jsonl" | 20 | "runs/raw/E1_core.jsonl" | ||
| 21 | ], | 21 | ], | ||
| 22 | "script": "src/wp30/analysis/analyze.py", | 22 | "script": "src/wp30/analysis/analyze.py", | ||
| 23 | − "generated_utc": "2026-10-30T08:41:11.023256Z", | 23 | + "generated_utc": "2026-10-30T09:02:37.730657Z", | ||
| 24 | "note": "synthetic accuracy by question type" | 24 | "note": "synthetic accuracy by question type" | ||
| 25 | }, | 25 | }, | ||
| 26 | "results/tables/E1_core_primary_tests.csv": { | 26 | "results/tables/E1_core_primary_tests.csv": { | ||
@@ -28,7 +28,7 @@ | |||||
| 28 | "runs/raw/E1_core.jsonl" | 28 | "runs/raw/E1_core.jsonl" | ||
| 29 | ], | 29 | ], | ||
| 30 | "script": "src/wp30/analysis/analyze.py", | 30 | "script": "src/wp30/analysis/analyze.py", | ||
| 31 | − "generated_utc": "2026-10-30T08:41:11.097268Z", | 31 | + "generated_utc": "2026-10-30T09:02:37.786568Z", | ||
| 32 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | 32 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | ||
| 33 | }, | 33 | }, | ||
| 34 | "results/figures/fig2_quality_vs_bytes.pdf": { | 34 | "results/figures/fig2_quality_vs_bytes.pdf": { | ||
@@ -36,7 +36,7 @@ | |||||
| 36 | "runs/raw/E1_core.jsonl" | 36 | "runs/raw/E1_core.jsonl" | ||
| 37 | ], | 37 | ], | ||
| 38 | "script": "src/wp30/analysis/analyze.py", | 38 | "script": "src/wp30/analysis/analyze.py", | ||
| 39 | − "generated_utc": "2026-10-30T08:41:11.754908Z", | 39 | + "generated_utc": "2026-10-30T09:02:38.459020Z", | ||
| 40 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 40 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 41 | }, | 41 | }, | ||
| 42 | "results/figures/fig2_quality_vs_bytes.png": { | 42 | "results/figures/fig2_quality_vs_bytes.png": { | ||
@@ -44,7 +44,7 @@ | |||||
| 44 | "runs/raw/E1_core.jsonl" | 44 | "runs/raw/E1_core.jsonl" | ||
| 45 | ], | 45 | ], | ||
| 46 | "script": "src/wp30/analysis/analyze.py", | 46 | "script": "src/wp30/analysis/analyze.py", | ||
| 47 | − "generated_utc": "2026-10-30T08:41:11.951700Z", | 47 | + "generated_utc": "2026-10-30T09:02:38.666585Z", | ||
| 48 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 48 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 49 | }, | 49 | }, | ||
| 50 | "results/figures/figA_quality_vs_bytes_blind.pdf": { | 50 | "results/figures/figA_quality_vs_bytes_blind.pdf": { | ||
@@ -52,7 +52,7 @@ | |||||
| 52 | "runs/raw/E1_core.jsonl" | 52 | "runs/raw/E1_core.jsonl" | ||
| 53 | ], | 53 | ], | ||
| 54 | "script": "src/wp30/analysis/analyze.py", | 54 | "script": "src/wp30/analysis/analyze.py", | ||
| 55 | − "generated_utc": "2026-10-30T08:41:12.396339Z", | 55 | + "generated_utc": "2026-10-30T09:02:39.176959Z", | ||
| 56 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 56 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 57 | }, | 57 | }, | ||
| 58 | "results/figures/figA_quality_vs_bytes_blind.png": { | 58 | "results/figures/figA_quality_vs_bytes_blind.png": { | ||
@@ -60,7 +60,7 @@ | |||||
| 60 | "runs/raw/E1_core.jsonl" | 60 | "runs/raw/E1_core.jsonl" | ||
| 61 | ], | 61 | ], | ||
| 62 | "script": "src/wp30/analysis/analyze.py", | 62 | "script": "src/wp30/analysis/analyze.py", | ||
| 63 | − "generated_utc": "2026-10-30T08:41:12.558258Z", | 63 | + "generated_utc": "2026-10-30T09:02:39.359044Z", | ||
| 64 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 64 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 65 | }, | 65 | }, | ||
| 66 | "results/figures/figA_quality_vs_bytes_aware.pdf": { | 66 | "results/figures/figA_quality_vs_bytes_aware.pdf": { | ||
@@ -68,7 +68,7 @@ | |||||
| 68 | "runs/raw/E1_core.jsonl" | 68 | "runs/raw/E1_core.jsonl" | ||
| 69 | ], | 69 | ], | ||
| 70 | "script": "src/wp30/analysis/analyze.py", | 70 | "script": "src/wp30/analysis/analyze.py", | ||
| 71 | − "generated_utc": "2026-10-30T08:41:12.888916Z", | 71 | + "generated_utc": "2026-10-30T09:02:39.746284Z", | ||
| 72 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 72 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 73 | }, | 73 | }, | ||
| 74 | "results/figures/figA_quality_vs_bytes_aware.png": { | 74 | "results/figures/figA_quality_vs_bytes_aware.png": { | ||
@@ -76,7 +76,7 @@ | |||||
| 76 | "runs/raw/E1_core.jsonl" | 76 | "runs/raw/E1_core.jsonl" | ||
| 77 | ], | 77 | ], | ||
| 78 | "script": "src/wp30/analysis/analyze.py", | 78 | "script": "src/wp30/analysis/analyze.py", | ||
| 79 | − "generated_utc": "2026-10-30T08:41:13.061312Z", | 79 | + "generated_utc": "2026-10-30T09:02:39.940182Z", | ||
| 80 | "note": "points = conditions; x = median payload bytes; y = mean quality" | 80 | "note": "points = conditions; x = median payload bytes; y = mean quality" | ||
| 81 | }, | 81 | }, | ||
| 82 | "results/figures/fig3_quality_vs_latency_memory.pdf": { | 82 | "results/figures/fig3_quality_vs_latency_memory.pdf": { | ||
@@ -84,7 +84,7 @@ | |||||
| 84 | "runs/raw/E1_core.jsonl" | 84 | "runs/raw/E1_core.jsonl" | ||
| 85 | ], | 85 | ], | ||
| 86 | "script": "src/wp30/analysis/analyze.py", | 86 | "script": "src/wp30/analysis/analyze.py", | ||
| 87 | − "generated_utc": "2026-10-30T08:41:13.355100Z", | 87 | + "generated_utc": "2026-10-30T09:02:40.285980Z", | ||
| 88 | "note": "" | 88 | "note": "" | ||
| 89 | }, | 89 | }, | ||
| 90 | "results/figures/fig3_quality_vs_latency_memory.png": { | 90 | "results/figures/fig3_quality_vs_latency_memory.png": { | ||
@@ -92,7 +92,7 @@ | |||||
| 92 | "runs/raw/E1_core.jsonl" | 92 | "runs/raw/E1_core.jsonl" | ||
| 93 | ], | 93 | ], | ||
| 94 | "script": "src/wp30/analysis/analyze.py", | 94 | "script": "src/wp30/analysis/analyze.py", | ||
| 95 | − "generated_utc": "2026-10-30T08:41:13.527311Z", | 95 | + "generated_utc": "2026-10-30T09:02:40.475124Z", | ||
| 96 | "note": "" | 96 | "note": "" | ||
| 97 | }, | 97 | }, | ||
| 98 | "results/figures/fig4_latency_decomposition.pdf": { | 98 | "results/figures/fig4_latency_decomposition.pdf": { | ||
@@ -100,7 +100,7 @@ | |||||
| 100 | "runs/raw/E1_core.jsonl" | 100 | "runs/raw/E1_core.jsonl" | ||
| 101 | ], | 101 | ], | ||
| 102 | "script": "src/wp30/analysis/analyze.py", | 102 | "script": "src/wp30/analysis/analyze.py", | ||
| 103 | − "generated_utc": "2026-10-30T08:41:13.606317Z", | 103 | + "generated_utc": "2026-10-30T09:02:40.560198Z", | ||
| 104 | "note": "" | 104 | "note": "" | ||
| 105 | }, | 105 | }, | ||
| 106 | "results/figures/fig4_latency_decomposition.png": { | 106 | "results/figures/fig4_latency_decomposition.png": { | ||
@@ -108,7 +108,7 @@ | |||||
| 108 | "runs/raw/E1_core.jsonl" | 108 | "runs/raw/E1_core.jsonl" | ||
| 109 | ], | 109 | ], | ||
| 110 | "script": "src/wp30/analysis/analyze.py", | 110 | "script": "src/wp30/analysis/analyze.py", | ||
| 111 | − "generated_utc": "2026-10-30T08:41:13.663220Z", | 111 | + "generated_utc": "2026-10-30T09:02:40.620070Z", | ||
| 112 | "note": "" | 112 | "note": "" | ||
| 113 | }, | 113 | }, | ||
| 114 | "results/figures/fig5_handoffs.pdf": { | 114 | "results/figures/fig5_handoffs.pdf": { | ||
@@ -116,7 +116,7 @@ | |||||
| 116 | "runs/raw/E4_core.jsonl" | 116 | "runs/raw/E4_core.jsonl" | ||
| 117 | ], | 117 | ], | ||
| 118 | "script": "src/wp30/analysis/analyze.py", | 118 | "script": "src/wp30/analysis/analyze.py", | ||
| 119 | − "generated_utc": "2026-10-30T08:41:18.022870Z", | 119 | + "generated_utc": "2026-10-30T09:02:45.615826Z", | ||
| 120 | "note": "means over documents; chains defined in configs/chains*.yaml" | 120 | "note": "means over documents; chains defined in configs/chains*.yaml" | ||
| 121 | }, | 121 | }, | ||
| 122 | "results/figures/fig5_handoffs.png": { | 122 | "results/figures/fig5_handoffs.png": { | ||
@@ -124,7 +124,7 @@ | |||||
| 124 | "runs/raw/E4_core.jsonl" | 124 | "runs/raw/E4_core.jsonl" | ||
| 125 | ], | 125 | ], | ||
| 126 | "script": "src/wp30/analysis/analyze.py", | 126 | "script": "src/wp30/analysis/analyze.py", | ||
| 127 | − "generated_utc": "2026-10-30T08:41:18.082563Z", | 127 | + "generated_utc": "2026-10-30T09:02:45.675774Z", | ||
| 128 | "note": "means over documents; chains defined in configs/chains*.yaml" | 128 | "note": "means over documents; chains defined in configs/chains*.yaml" | ||
| 129 | }, | 129 | }, | ||
| 130 | "results/tables/E4_core_handoffs.csv": { | 130 | "results/tables/E4_core_handoffs.csv": { | ||
@@ -132,7 +132,7 @@ | |||||
| 132 | "runs/raw/E4_core.jsonl" | 132 | "runs/raw/E4_core.jsonl" | ||
| 133 | ], | 133 | ], | ||
| 134 | "script": "src/wp30/analysis/analyze.py", | 134 | "script": "src/wp30/analysis/analyze.py", | ||
| 135 | − "generated_utc": "2026-10-30T08:41:18.179059Z", | 135 | + "generated_utc": "2026-10-30T09:02:45.778336Z", | ||
| 136 | "note": "repeated handoffs" | 136 | "note": "repeated handoffs" | ||
| 137 | }, | 137 | }, | ||
| 138 | "results/tables/E4_core_h4_primary_tests.csv": { | 138 | "results/tables/E4_core_h4_primary_tests.csv": { | ||
@@ -140,7 +140,7 @@ | |||||
| 140 | "runs/raw/E4_core.jsonl" | 140 | "runs/raw/E4_core.jsonl" | ||
| 141 | ], | 141 | ], | ||
| 142 | "script": "src/wp30/analysis/analyze.py", | 142 | "script": "src/wp30/analysis/analyze.py", | ||
| 143 | − "generated_utc": "2026-10-30T08:41:18.190264Z", | 143 | + "generated_utc": "2026-10-30T09:02:45.791552Z", | ||
| 144 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | 144 | "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | ||
| 145 | }, | 145 | }, | ||
| 146 | "results/tables/E5_core_fanin.csv": { | 146 | "results/tables/E5_core_fanin.csv": { | ||
@@ -148,7 +148,7 @@ | |||||
| 148 | "runs/raw/E5_core.jsonl" | 148 | "runs/raw/E5_core.jsonl" | ||
| 149 | ], | 149 | ], | ||
| 150 | "script": "src/wp30/analysis/analyze.py", | 150 | "script": "src/wp30/analysis/analyze.py", | ||
| 151 | − "generated_utc": "2026-10-30T08:41:18.294190Z", | 151 | + "generated_utc": "2026-10-30T09:02:45.898241Z", | ||
| 152 | "note": "fan-in by method and question type" | 152 | "note": "fan-in by method and question type" | ||
| 153 | }, | 153 | }, | ||
| 154 | "results/figures/fig6_breakeven.pdf": { | 154 | "results/figures/fig6_breakeven.pdf": { | ||
@@ -156,7 +156,7 @@ | |||||
| 156 | "runs/raw/E6_core.jsonl" | 156 | "runs/raw/E6_core.jsonl" | ||
| 157 | ], | 157 | ], | ||
| 158 | "script": "src/wp30/analysis/analyze.py", | 158 | "script": "src/wp30/analysis/analyze.py", | ||
| 159 | − "generated_utc": "2026-10-30T08:41:18.383673Z", | 159 | + "generated_utc": "2026-10-30T09:02:45.992041Z", | ||
| 160 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | 160 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | ||
| 161 | }, | 161 | }, | ||
| 162 | "results/figures/fig6_breakeven.png": { | 162 | "results/figures/fig6_breakeven.png": { | ||
@@ -164,7 +164,7 @@ | |||||
| 164 | "runs/raw/E6_core.jsonl" | 164 | "runs/raw/E6_core.jsonl" | ||
| 165 | ], | 165 | ], | ||
| 166 | "script": "src/wp30/analysis/analyze.py", | 166 | "script": "src/wp30/analysis/analyze.py", | ||
| 167 | − "generated_utc": "2026-10-30T08:41:18.456745Z", | 167 | + "generated_utc": "2026-10-30T09:02:46.065845Z", | ||
| 168 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | 168 | "note": "left = measured (medians, p25-p75); right = analytic model from measured bandwidth and prefill slope; dashed 10 Gb/s is hypothetical" | ||
| 169 | }, | 169 | }, | ||
| 170 | "results/tables/E6_network.csv": { | 170 | "results/tables/E6_network.csv": { | ||
@@ -172,7 +172,7 @@ | |||||
| 172 | "runs/raw/E6_core.jsonl" | 172 | "runs/raw/E6_core.jsonl" | ||
| 173 | ], | 173 | ], | ||
| 174 | "script": "src/wp30/analysis/analyze.py", | 174 | "script": "src/wp30/analysis/analyze.py", | ||
| 175 | − "generated_utc": "2026-10-30T08:41:18.462390Z", | 175 | + "generated_utc": "2026-10-30T09:02:46.070991Z", | ||
| 176 | "note": "two-node transfer measurements" | 176 | "note": "two-node transfer measurements" | ||
| 177 | }, | 177 | }, | ||
| 178 | "results/tables/ED_hosted.csv": { | 178 | "results/tables/ED_hosted.csv": { | ||
@@ -180,9 +180,51 @@ | |||||
| 180 | "runs/raw/ED_hosted_core.jsonl" | 180 | "runs/raw/ED_hosted_core.jsonl" | ||
| 181 | ], | 181 | ], | ||
| 182 | "script": "src/wp30/analysis/analyze.py", | 182 | "script": "src/wp30/analysis/analyze.py", | ||
| 183 | − "generated_utc": "2026-10-30T08:41:18.529003Z", | 183 | + "generated_utc": "2026-10-30T09:02:46.140839Z", | ||
| 184 | "note": "hosted receivers; cost estimated from provider price tables" | 184 | "note": "hosted receivers; cost estimated from provider price tables" | ||
| 185 | }, | 185 | }, | ||
| 186 | + "results/tables/E3_core_transfer.csv": { | ||||
| 187 | + "sources": [ | ||||
| 188 | + "runs/raw/E3_core.jsonl", | ||||
| 189 | + "runs/raw/E3_core_sender.jsonl" | ||||
| 190 | + ], | ||||
| 191 | + "script": "src/wp30/analysis/analyze.py", | ||||
| 192 | + "generated_utc": "2026-10-30T09:02:46.269308Z", | ||||
| 193 | + "note": "same-family mapper transfer vs text handoffs and references" | ||||
| 194 | + }, | ||||
| 195 | + "results/tables/E3_core_primary_tests.csv": { | ||||
| 196 | + "sources": [ | ||||
| 197 | + "runs/raw/E3_core.jsonl", | ||||
| 198 | + "runs/raw/E3_core_sender.jsonl" | ||||
| 199 | + ], | ||||
| 200 | + "script": "src/wp30/analysis/analyze.py", | ||||
| 201 | + "generated_utc": "2026-10-30T09:02:46.347449Z", | ||||
| 202 | + "note": "registered primary comparisons, paired, cluster bootstrap, Holm" | ||||
| 203 | + }, | ||||
| 204 | + "results/tables/E7_qtypes.csv": { | ||||
| 205 | + "sources": [ | ||||
| 206 | + "runs/raw/E7_qtypes.jsonl" | ||||
| 207 | + ], | ||||
| 208 | + "script": "src/wp30/analysis/analyze.py", | ||||
| 209 | + "generated_utc": "2026-10-30T09:02:46.532910Z", | ||||
| 210 | + "note": "EXPLORATORY: question types 6-15 on synthetic test documents" | ||||
| 211 | + }, | ||||
| 212 | + "results/figures/figA_qtypes_exploratory.pdf": { | ||||
| 213 | + "sources": [ | ||||
| 214 | + "runs/raw/E7_qtypes.jsonl" | ||||
| 215 | + ], | ||||
| 216 | + "script": "src/wp30/analysis/analyze.py", | ||||
| 217 | + "generated_utc": "2026-10-30T09:02:46.612438Z", | ||||
| 218 | + "note": "exploratory extension A-004" | ||||
| 219 | + }, | ||||
| 220 | + "results/figures/figA_qtypes_exploratory.png": { | ||||
| 221 | + "sources": [ | ||||
| 222 | + "runs/raw/E7_qtypes.jsonl" | ||||
| 223 | + ], | ||||
| 224 | + "script": "src/wp30/analysis/analyze.py", | ||||
| 225 | + "generated_utc": "2026-10-30T09:02:46.668848Z", | ||||
| 226 | + "note": "exploratory extension A-004" | ||||
| 227 | + }, | ||||
| 186 | "results/figures/fig7_router.pdf": { | 228 | "results/figures/fig7_router.pdf": { | ||
| 187 | "sources": [ | 229 | "sources": [ | ||
| 188 | "results/tables/E8_router_summary.csv", | 230 | "results/tables/E8_router_summary.csv", | ||
@@ -190,7 +232,7 @@ | |||||
| 190 | "runs/checkpoints/router_policy.json" | 232 | "runs/checkpoints/router_policy.json" | ||
| 191 | ], | 233 | ], | ||
| 192 | "script": "src/wp30/analysis/analyze.py", | 234 | "script": "src/wp30/analysis/analyze.py", | ||
| 193 | − "generated_utc": "2026-10-30T08:41:18.669288Z", | 235 | + "generated_utc": "2026-10-30T09:02:46.768937Z", | ||
| 194 | "note": "oracle = infeasible upper reference" | 236 | "note": "oracle = infeasible upper reference" | ||
| 195 | }, | 237 | }, | ||
| 196 | "results/figures/fig7_router.png": { | 238 | "results/figures/fig7_router.png": { | ||
@@ -200,7 +242,7 @@ | |||||
| 200 | "runs/checkpoints/router_policy.json" | 242 | "runs/checkpoints/router_policy.json" | ||
| 201 | ], | 243 | ], | ||
| 202 | "script": "src/wp30/analysis/analyze.py", | 244 | "script": "src/wp30/analysis/analyze.py", | ||
| 203 | − "generated_utc": "2026-10-30T08:41:18.747352Z", | 245 | + "generated_utc": "2026-10-30T09:02:46.853258Z", | ||
| 204 | "note": "oracle = infeasible upper reference" | 246 | "note": "oracle = infeasible upper reference" | ||
| 205 | } | 247 | } | ||
| 206 | } | 248 | } | ||
| \ No newline at end of file | |||||
modified
results/tables/E1_core_by_question_type.csv
+3 −3
@@ -30,9 +30,9 @@ A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,single_fact,0.2125 | |||||
| 30 | A7|codec=zstd,exact_copy,0.99375,0.97796875,1.0,160 | 30 | A7|codec=zstd,exact_copy,0.99375,0.97796875,1.0,160 | ||
| 31 | A7|codec=zstd,multi_hop,0.975,0.9375,1.0,80 | 31 | A7|codec=zstd,multi_hop,0.975,0.9375,1.0,80 | ||
| 32 | A7|codec=zstd,single_fact,0.99375,0.98125,1.0,160 | 32 | A7|codec=zstd,single_fact,0.99375,0.98125,1.0,160 | ||
| 33 | −A8|budget_tokens=512|blind,exact_copy,0.05,0.025,0.0875,160 | 33 | +A8|budget_tokens=512|blind,exact_copy,0.1,0.05,0.1625,160 | ||
| 34 | −A8|budget_tokens=512|blind,multi_hop,0.0125,0.0,0.0375,80 | 34 | +A8|budget_tokens=512|blind,multi_hop,0.05,0.0125,0.1,80 | ||
| 35 | −A8|budget_tokens=512|blind,single_fact,0.1125,0.06875,0.15953124999999985,160 | 35 | +A8|budget_tokens=512|blind,single_fact,0.24375,0.1625,0.3375,160 | ||
| 36 | B0,exact_copy,0.99375,0.97796875,1.0,160 | 36 | B0,exact_copy,0.99375,0.97796875,1.0,160 | ||
| 37 | B0,multi_hop,0.975,0.9375,1.0,80 | 37 | B0,multi_hop,0.975,0.9375,1.0,80 | ||
| 38 | B0,single_fact,0.99375,0.98125,1.0,160 | 38 | B0,single_fact,0.99375,0.98125,1.0,160 | ||
modified
results/tables/E1_core_failures.csv
+1 −1
@@ -7,7 +7,7 @@ A4,0,0,880 | |||||
| 7 | A5,0,0,880 | 7 | A5,0,0,880 | ||
| 8 | A6,0,0,640 | 8 | A6,0,0,640 | ||
| 9 | A7,0,0,640 | 9 | A7,0,0,640 | ||
| 10 | −A8,240,0,400 | 10 | +A8,240,0,640 | ||
| 11 | B0,0,0,640 | 11 | B0,0,0,640 | ||
| 12 | B1,0,0,640 | 12 | B1,0,0,640 | ||
| 13 | B2,0,29,1251 | 13 | B2,0,29,1251 | ||
modified
results/tables/E1_core_primary.csv
+2 −2
@@ -8,7 +8,7 @@ exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A4|budget_tokens=512 | |||||
| 8 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.0,0.0,0.0,1.0,1245.5,,8283.329896512441,1541.5113129420206,8283.329896512441,11.789770913310349,6766525528.0,6766525528.0,0.0 | 8 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,40,40,0.0,0.0,0.0,1.0,1245.5,,8283.329896512441,1541.5113129420206,8283.329896512441,11.789770913310349,6766525528.0,6766525528.0,0.0 | ||
| 9 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.15,0.05,0.275,1.0,280.0,,1566.0093335900456,1565.9761460265145,1566.0093335900456,11.801395448856056,6751091800.0,6751091800.0,938.575 | 9 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,40,40,0.15,0.05,0.275,1.0,280.0,,1566.0093335900456,1565.9761460265145,1566.0093335900456,11.801395448856056,6751091800.0,6751091800.0,938.575 | ||
| 10 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.95,0.875,1.0,1.0,1304.5,,1995.8721044822596,1995.802208490204,1995.8721044822596,12.078374973498285,7123374444.0,7123374444.0,0.0 | 10 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,40,40,0.95,0.875,1.0,1.0,1304.5,,1995.8721044822596,1995.802208490204,1995.8721044822596,12.078374973498285,7123374444.0,7123374444.0,0.0 | ||
| 11 | −exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,,0.0 | 11 | +exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,40,40,0.0,0.0,0.0,1.0,2397.5,,1807.6947699883021,1636.3695199252106,1807.6947699883021,13.637624972034246,6901300956.0,6901300956.0,0.0 | ||
| 12 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.95,0.875,1.0,1.0,209433294.0,209420288.0,2161.7709995480254,1476.9027290167287,2161.7709995480254,51.358687051106244,7181169892.0,7181169892.0,0.0 | 12 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,40,40,0.95,0.875,1.0,1.0,209433294.0,209420288.0,2161.7709995480254,1476.9027290167287,2161.7709995480254,51.358687051106244,7181169892.0,7181169892.0,0.0 | ||
| 13 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.95,0.875,1.0,1.0,209433322.0,209420288.0,2183.0639789113775,1496.8550420016982,2183.0639789113775,49.82733295764774,7180973284.0,7180973284.0,0.0 | 13 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,40,40,0.95,0.875,1.0,1.0,209433322.0,209420288.0,2183.0639789113775,1496.8550420016982,2183.0639789113775,49.82733295764774,7180973284.0,7180973284.0,0.0 | ||
| 14 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,1.0,1.0,1.0,1.0,58926513.0,58899456.0,2119.401790900156,1451.94422948407,2119.401790900156,42.334249475970864,6889044124.0,7112184172.0,0.0 | 14 | exec,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,40,40,1.0,1.0,1.0,1.0,58926513.0,58899456.0,2119.401790900156,1451.94422948407,2119.401790900156,42.334249475970864,6889044124.0,7112184172.0,0.0 | ||
@@ -130,7 +130,7 @@ synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_token | |||||
| 130 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.125,0.09,0.155,1.0,842.0,,18998.95481200656,344.1750835045241,4091.6990083642304,23.827395518310368,6734748760.0,6734748760.0,0.0 | 130 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A5|budget_tokens=512|blind,A5,blind,200,40,0.125,0.09,0.155,1.0,842.0,,18998.95481200656,344.1750835045241,4091.6990083642304,23.827395518310368,6734748760.0,6734748760.0,0.0 | ||
| 131 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.175,0.135,0.215,1.0,707.0,,492.9024174925871,492.8722715121694,492.87830070825294,25.794854445848614,6933195852.0,6933195852.0,1367.27 | 131 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A6|budget_tokens=512|max_fetch_bytes=2000|max_lookups=6|blind,A6,blind,200,40,0.175,0.135,0.215,1.0,707.0,,492.9024174925871,492.8722715121694,492.87830070825294,25.794854445848614,6933195852.0,6933195852.0,1367.27 | ||
| 132 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,2857.3816449497826,2857.2952494141646,2857.312528521288,27.074062498286366,7576794164.0,7576794164.0,0.0 | 132 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A7|codec=zstd,A7,none,200,40,0.99,0.975,1.0,1.0,2726.0,,2857.3816449497826,2857.2952494141646,2857.312528521288,27.074062498286366,7576794164.0,7576794164.0,0.0 | ||
| 133 | −synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.0,0.0,0.0,0.0,,,0.0,0.0,0.0,,,,0.0 | 133 | +synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,A8|budget_tokens=512|blind,A8,blind,200,40,0.16,0.105,0.225,1.0,2583.0,,522.9626869549975,108.42154250713065,216.73387542832643,13.577207922935486,6915931970.0,6915931970.0,0.0 | ||
| 134 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,651268854.0,651255808.0,3253.5364581272006,393.2519589434378,973.5832870006561,136.40537502942607,8593077474.0,8593077474.0,0.0 | 134 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B0,B0,blind,200,40,0.99,0.975,1.0,1.0,651268854.0,651255808.0,3253.5364581272006,393.2519589434378,973.5832870006561,136.40537502942607,8593077474.0,8593077474.0,0.0 | ||
| 135 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,651268882.0,651255808.0,3351.503874640912,505.0313540850766,1057.6043623499572,144.29387502605096,8593069282.0,8593069282.0,0.0 | 135 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B1,B1,blind,200,40,0.99,0.975,1.0,1.0,651268882.0,651255808.0,3351.503874640912,505.0313540850766,1057.6043623499572,144.29387502605096,8593069282.0,8593069282.0,0.0 | ||
| 136 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.975,0.945,0.995,1.0,183192937.0,183165696.0,3111.2300624372438,335.1737505290657,882.7701129950583,106.28564545186237,7628087269.0,7628087269.0,0.0 | 136 | synthetic,Llama-3.2-3B-Instruct-bf16->Llama-3.2-3B-Instruct-bf16,B2|bits=4,B2,blind,200,40,0.975,0.945,0.995,1.0,183192937.0,183165696.0,3111.2300624372438,335.1737505290657,882.7701129950583,106.28564545186237,7628087269.0,7628087269.0,0.0 | ||
added
results/tables/E3_core_primary_tests.csv
+3 −0
@@ -0,0 +1,3 @@ | |||||
| 1 | +a,b,diff,lo,hi,p,n,n_clusters,mean_a,mean_b,rel_change,name,hypothesis,p_holm | ||||
| 2 | +C2,A4|512|blind,-0.037037037037037035,-0.11574074074074074,0.041666666666666664,0.368,216,27,0.24537037037037038,0.2824074074074074,-0.13114754098360656,C2 mapper vs A4 summary (synthetic),H10,0.368 | ||||
| 3 | +C2,A1,-0.75,-0.7777777777777778,-0.7222222222222222,0.0,216,27,0.24537037037037038,0.9953703703703703,-0.7534883720930232,C2 mapper vs A1 receiver full context (synthetic),H10,0.0 | ||||
added
results/tables/E3_core_transfer.csv
+17 −0
@@ -0,0 +1,17 @@ | |||||
| 1 | +family,condition,quality,lo,hi,n,n_docs,payload_bytes_median,cold_ms_p50,warm_ms_p50,unknown_share,q_exec,q_exact_copy,q_multi_hop,q_negation,q_single_fact | ||||
| 2 | +exec,A1,1.0,1.0,1.0,40,40,7817.0,1912.1752704959363,1912.1676459326409,0.0,1.0,,,, | ||||
| 3 | +exec,A4|512|blind,0.0,0.0,0.0,40,40,938.0,2819.653937360272,1025.8437710581347,0.275,0.0,,,, | ||||
| 4 | +exec,A5|512|blind,0.0,0.0,0.0,40,40,936.0,4190.043583512306,215.29910451499745,0.85,0.0,,,, | ||||
| 5 | +exec,C0,0.0,0.0,0.0,40,40,69762785.0,4331.171416444704,3979.971270891838,0.0,0.0,,,, | ||||
| 6 | +exec,C2,0.0,0.0,0.0,40,40,69762886.0,2318.2933544158004,1098.6273545422591,0.0,0.0,,,, | ||||
| 7 | +exec,C3|1/4|aware,0.0,0.0,0.0,40,40,17452748.5,2254.7777493600734,939.0185408992693,0.0,0.0,,,, | ||||
| 8 | +exec,sender alone A1,0.0,0.0,0.0,40,40,7817.0,909.1166876023635,909.1070625581779,0.0,0.0,,,, | ||||
| 9 | +exec,sender alone B0,0.0,0.0,0.0,40,40,54260105.0,957.9157516709529,621.4223124552518,0.0,0.0,,,, | ||||
| 10 | +synthetic,A1,0.9953703703703703,0.9861111111111112,1.0,216,27,7555.0,890.8028129953891,890.7906879903749,0.0,,1.0,0.9814814814814815,1.0,1.0 | ||||
| 11 | +synthetic,A4|512|blind,0.2824074074074074,0.2175925925925926,0.35185185185185186,216,27,1263.0,4260.842582501937,250.3902085009031,0.6435185185185185,,0.2037037037037037,0.1111111111111111,0.7222222222222222,0.09259259259259259 | ||||
| 12 | +synthetic,A5|512|blind,0.11574074074074074,0.06944444444444445,0.16203703703703703,216,27,596.0,4229.795791499782,166.88918694853783,0.7314814814814815,,0.09259259259259259,0.07407407407407407,0.2222222222222222,0.07407407407407407 | ||||
| 13 | +synthetic,C0,0.0,0.0,0.0,216,27,77688549.0,1025.9398333728313,632.5281668687239,0.0,,0.0,0.0,0.0,0.0 | ||||
| 14 | +synthetic,C2,0.24537037037037038,0.2175925925925926,0.27314814814814814,216,27,77688650.0,1424.9500405276194,85.57341661071405,0.6898148148148148,,0.037037037037037035,0.0,0.9259259259259259,0.018518518518518517 | ||||
| 15 | +synthetic,C3|1/4|aware,0.25,0.22685185185185186,0.27314814814814814,216,27,19443415.0,1492.1443954808637,56.23004218796268,0.6851851851851852,,0.018518518518518517,0.0,0.9444444444444444,0.037037037037037035 | ||||
| 16 | +synthetic,sender alone A1,0.9583333333333334,0.9350694444444447,0.9814814814814815,216,27,7555.0,448.41252046171576,448.40406253933907,0.0,,0.9814814814814815,0.9444444444444444,0.9259259259259259,0.9814814814814815 | ||||
| 17 | +synthetic,sender alone B0,0.9537037037037037,0.9259259259259259,0.9814814814814815,216,27,60424589.0,478.51893870392814,104.15885498514399,0.0,,0.9814814814814815,0.9444444444444444,0.9074074074074074,0.9814814814814815 | ||||
added
results/tables/E7_qtypes.csv
+99 −0
@@ -0,0 +1,99 @@ | |||||
| 1 | +condition,qtype,pair,quality,lo,hi,n,abstained | ||||
| 2 | +A1,aggregation,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 3 | +A1,aggregation,Qwen2.5-3B,0.0,0.0,0.0,16,0.0 | ||||
| 4 | +A1,multi_hop,Llama-3.2-3B,1.0,1.0,1.0,15,0.0 | ||||
| 5 | +A1,multi_hop,Qwen2.5-3B,1.0,1.0,1.0,16,0.0 | ||||
| 6 | +A1,negation,Llama-3.2-3B,0.9,0.8,1.0,30,0.0 | ||||
| 7 | +A1,negation,Qwen2.5-3B,1.0,1.0,1.0,32,0.0 | ||||
| 8 | +A1,revision,Llama-3.2-3B,0.7333333333333333,0.5825000000000004,0.8841666666666659,30,0.0 | ||||
| 9 | +A1,revision,Qwen2.5-3B,0.9375,0.84375,1.0,32,0.0 | ||||
| 10 | +A1,temporal,Llama-3.2-3B,0.4666666666666667,0.2,0.7333333333333333,15,0.0 | ||||
| 11 | +A1,temporal,Qwen2.5-3B,0.4375,0.21718750000000064,0.6875,16,0.0 | ||||
| 12 | +A1,unanswerable,Llama-3.2-3B,1.0,1.0,1.0,30,1.0 | ||||
| 13 | +A1,unanswerable,Qwen2.5-3B,0.96875,0.90625,1.0,32,0.96875 | ||||
| 14 | +A1,unit_conversion,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 15 | +A1,unit_conversion,Qwen2.5-3B,0.5,0.25,0.75,16,0.0 | ||||
| 16 | +A3|budget_tokens=512|blind,aggregation,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 17 | +A3|budget_tokens=512|blind,aggregation,Qwen2.5-3B,0.0,0.0,0.0,15,0.0 | ||||
| 18 | +A3|budget_tokens=512|blind,multi_hop,Llama-3.2-3B,0.0,0.0,0.0,15,1.0 | ||||
| 19 | +A3|budget_tokens=512|blind,multi_hop,Qwen2.5-3B,0.0,0.0,0.0,15,1.0 | ||||
| 20 | +A3|budget_tokens=512|blind,negation,Llama-3.2-3B,0.8333333333333334,0.7,0.9333333333333333,30,0.0 | ||||
| 21 | +A3|budget_tokens=512|blind,negation,Qwen2.5-3B,0.9333333333333333,0.8333333333333334,1.0,30,0.0 | ||||
| 22 | +A3|budget_tokens=512|blind,revision,Llama-3.2-3B,0.7333333333333333,0.5666666666666667,0.8666666666666667,30,0.0 | ||||
| 23 | +A3|budget_tokens=512|blind,revision,Qwen2.5-3B,0.7333333333333333,0.5333333333333333,0.9,30,0.0 | ||||
| 24 | +A3|budget_tokens=512|blind,temporal,Llama-3.2-3B,0.5333333333333333,0.3333333333333333,0.7333333333333333,15,0.0 | ||||
| 25 | +A3|budget_tokens=512|blind,temporal,Qwen2.5-3B,0.3333333333333333,0.13333333333333333,0.5333333333333333,15,0.0 | ||||
| 26 | +A3|budget_tokens=512|blind,unanswerable,Llama-3.2-3B,1.0,1.0,1.0,30,1.0 | ||||
| 27 | +A3|budget_tokens=512|blind,unanswerable,Qwen2.5-3B,1.0,1.0,1.0,30,1.0 | ||||
| 28 | +A3|budget_tokens=512|blind,unit_conversion,Llama-3.2-3B,0.0,0.0,0.0,15,0.9333333333333333 | ||||
| 29 | +A3|budget_tokens=512|blind,unit_conversion,Qwen2.5-3B,0.0,0.0,0.0,15,0.6666666666666666 | ||||
| 30 | +A4|budget_tokens=512|blind,aggregation,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 31 | +A4|budget_tokens=512|blind,aggregation,Qwen2.5-3B,0.0,0.0,0.0,15,0.4 | ||||
| 32 | +A4|budget_tokens=512|blind,multi_hop,Llama-3.2-3B,0.3333333333333333,0.06666666666666667,0.6,15,0.5333333333333333 | ||||
| 33 | +A4|budget_tokens=512|blind,multi_hop,Qwen2.5-3B,0.4375,0.1875,0.6875,16,0.5 | ||||
| 34 | +A4|budget_tokens=512|blind,negation,Llama-3.2-3B,1.0,1.0,1.0,30,0.0 | ||||
| 35 | +A4|budget_tokens=512|blind,negation,Qwen2.5-3B,0.71875,0.53125,0.875,32,0.1875 | ||||
| 36 | +A4|budget_tokens=512|blind,revision,Llama-3.2-3B,0.16666666666666666,0.03333333333333333,0.3333333333333333,30,0.3333333333333333 | ||||
| 37 | +A4|budget_tokens=512|blind,revision,Qwen2.5-3B,0.25806451612903225,0.12903225806451613,0.4266935483870965,31,0.5161290322580645 | ||||
| 38 | +A4|budget_tokens=512|blind,temporal,Llama-3.2-3B,0.2,0.0,0.4,15,0.3333333333333333 | ||||
| 39 | +A4|budget_tokens=512|blind,temporal,Qwen2.5-3B,0.3333333333333333,0.13333333333333333,0.5333333333333333,15,0.26666666666666666 | ||||
| 40 | +A4|budget_tokens=512|blind,unanswerable,Llama-3.2-3B,1.0,1.0,1.0,30,1.0 | ||||
| 41 | +A4|budget_tokens=512|blind,unanswerable,Qwen2.5-3B,1.0,1.0,1.0,30,1.0 | ||||
| 42 | +A4|budget_tokens=512|blind,unit_conversion,Llama-3.2-3B,0.0,0.0,0.0,15,0.6666666666666666 | ||||
| 43 | +A4|budget_tokens=512|blind,unit_conversion,Qwen2.5-3B,0.4,0.13333333333333333,0.6666666666666666,15,0.6 | ||||
| 44 | +A5|budget_tokens=512|blind,aggregation,Llama-3.2-3B,0.0,0.0,0.0,15,0.3333333333333333 | ||||
| 45 | +A5|budget_tokens=512|blind,aggregation,Qwen2.5-3B,0.0,0.0,0.0,15,0.4666666666666667 | ||||
| 46 | +A5|budget_tokens=512|blind,multi_hop,Llama-3.2-3B,0.13333333333333333,0.0,0.3333333333333333,15,0.8666666666666667 | ||||
| 47 | +A5|budget_tokens=512|blind,multi_hop,Qwen2.5-3B,0.2,0.06666666666666667,0.4,15,0.7333333333333333 | ||||
| 48 | +A5|budget_tokens=512|blind,negation,Llama-3.2-3B,0.5,0.36666666666666664,0.6333333333333333,30,0.3 | ||||
| 49 | +A5|budget_tokens=512|blind,negation,Qwen2.5-3B,0.5333333333333333,0.36666666666666664,0.7,30,0.43333333333333335 | ||||
| 50 | +A5|budget_tokens=512|blind,revision,Llama-3.2-3B,0.13333333333333333,0.0,0.3,30,0.7666666666666667 | ||||
| 51 | +A5|budget_tokens=512|blind,revision,Qwen2.5-3B,0.1,0.0,0.26666666666666666,30,0.8333333333333334 | ||||
| 52 | +A5|budget_tokens=512|blind,temporal,Llama-3.2-3B,0.13333333333333333,0.0,0.3333333333333333,15,0.8666666666666667 | ||||
| 53 | +A5|budget_tokens=512|blind,temporal,Qwen2.5-3B,0.0,0.0,0.0,15,0.8666666666666667 | ||||
| 54 | +A5|budget_tokens=512|blind,unanswerable,Llama-3.2-3B,1.0,1.0,1.0,30,1.0 | ||||
| 55 | +A5|budget_tokens=512|blind,unanswerable,Qwen2.5-3B,1.0,1.0,1.0,30,1.0 | ||||
| 56 | +A5|budget_tokens=512|blind,unit_conversion,Llama-3.2-3B,0.0,0.0,0.0,15,0.7333333333333333 | ||||
| 57 | +A5|budget_tokens=512|blind,unit_conversion,Qwen2.5-3B,0.2,0.0,0.4,15,0.3333333333333333 | ||||
| 58 | +B2|bits=8,aggregation,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 59 | +B2|bits=8,aggregation,Qwen2.5-3B,0.0,0.0,0.0,15,0.0 | ||||
| 60 | +B2|bits=8,multi_hop,Llama-3.2-3B,1.0,1.0,1.0,15,0.0 | ||||
| 61 | +B2|bits=8,multi_hop,Qwen2.5-3B,1.0,1.0,1.0,15,0.0 | ||||
| 62 | +B2|bits=8,negation,Llama-3.2-3B,0.9,0.8,1.0,30,0.0 | ||||
| 63 | +B2|bits=8,negation,Qwen2.5-3B,1.0,1.0,1.0,30,0.0 | ||||
| 64 | +B2|bits=8,revision,Llama-3.2-3B,0.7333333333333333,0.5825000000000004,0.8841666666666659,30,0.0 | ||||
| 65 | +B2|bits=8,revision,Qwen2.5-3B,0.9333333333333333,0.8333333333333334,1.0,30,0.0 | ||||
| 66 | +B2|bits=8,temporal,Llama-3.2-3B,0.4666666666666667,0.2,0.7333333333333333,15,0.0 | ||||
| 67 | +B2|bits=8,temporal,Qwen2.5-3B,0.4,0.13333333333333333,0.6666666666666666,15,0.0 | ||||
| 68 | +B2|bits=8,unanswerable,Llama-3.2-3B,1.0,1.0,1.0,30,1.0 | ||||
| 69 | +B2|bits=8,unanswerable,Qwen2.5-3B,0.9666666666666667,0.9,1.0,30,0.9666666666666667 | ||||
| 70 | +B2|bits=8,unit_conversion,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 71 | +B2|bits=8,unit_conversion,Qwen2.5-3B,0.6,0.3333333333333333,0.8666666666666667,15,0.0 | ||||
| 72 | +B3|keep_frac=0.25,aggregation,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 73 | +B3|keep_frac=0.25,aggregation,Qwen2.5-3B,0.0,0.0,0.0,15,0.0 | ||||
| 74 | +B3|keep_frac=0.25,multi_hop,Llama-3.2-3B,0.2,0.0,0.4,15,0.3333333333333333 | ||||
| 75 | +B3|keep_frac=0.25,multi_hop,Qwen2.5-3B,0.2,0.0,0.4,15,0.13333333333333333 | ||||
| 76 | +B3|keep_frac=0.25,negation,Llama-3.2-3B,0.7333333333333333,0.6,0.8333333333333334,30,0.0 | ||||
| 77 | +B3|keep_frac=0.25,negation,Qwen2.5-3B,0.8666666666666667,0.7333333333333333,0.9666666666666667,30,0.0 | ||||
| 78 | +B3|keep_frac=0.25,revision,Llama-3.2-3B,0.06666666666666667,0.0,0.16666666666666666,30,0.6666666666666666 | ||||
| 79 | +B3|keep_frac=0.25,revision,Qwen2.5-3B,0.0,0.0,0.0,30,0.0 | ||||
| 80 | +B3|keep_frac=0.25,temporal,Llama-3.2-3B,0.5333333333333333,0.26666666666666666,0.7333333333333333,15,0.0 | ||||
| 81 | +B3|keep_frac=0.25,temporal,Qwen2.5-3B,0.5333333333333333,0.26666666666666666,0.7333333333333333,15,0.0 | ||||
| 82 | +B3|keep_frac=0.25,unanswerable,Llama-3.2-3B,0.9333333333333333,0.8,1.0,30,0.9333333333333333 | ||||
| 83 | +B3|keep_frac=0.25,unanswerable,Qwen2.5-3B,0.9666666666666667,0.9,1.0,30,0.9666666666666667 | ||||
| 84 | +B3|keep_frac=0.25,unit_conversion,Llama-3.2-3B,0.0,0.0,0.0,15,0.7333333333333333 | ||||
| 85 | +B3|keep_frac=0.25,unit_conversion,Qwen2.5-3B,0.06666666666666667,0.0,0.2,15,0.0 | ||||
| 86 | +B5|keep_frac=0.25|aware,aggregation,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 87 | +B5|keep_frac=0.25|aware,aggregation,Qwen2.5-3B,0.0,0.0,0.0,15,0.0 | ||||
| 88 | +B5|keep_frac=0.25|aware,multi_hop,Llama-3.2-3B,1.0,1.0,1.0,15,0.0 | ||||
| 89 | +B5|keep_frac=0.25|aware,multi_hop,Qwen2.5-3B,0.5333333333333333,0.26666666666666666,0.8,15,0.0 | ||||
| 90 | +B5|keep_frac=0.25|aware,negation,Llama-3.2-3B,0.8666666666666667,0.7666666666666667,0.9666666666666667,30,0.0 | ||||
| 91 | +B5|keep_frac=0.25|aware,negation,Qwen2.5-3B,1.0,1.0,1.0,30,0.0 | ||||
| 92 | +B5|keep_frac=0.25|aware,revision,Llama-3.2-3B,0.7333333333333333,0.6158333333333337,0.8666666666666667,30,0.0 | ||||
| 93 | +B5|keep_frac=0.25|aware,revision,Qwen2.5-3B,0.3,0.16666666666666666,0.43333333333333335,30,0.0 | ||||
| 94 | +B5|keep_frac=0.25|aware,temporal,Llama-3.2-3B,0.6,0.4,0.8,15,0.0 | ||||
| 95 | +B5|keep_frac=0.25|aware,temporal,Qwen2.5-3B,0.5333333333333333,0.26666666666666666,0.8,15,0.0 | ||||
| 96 | +B5|keep_frac=0.25|aware,unanswerable,Llama-3.2-3B,1.0,1.0,1.0,30,1.0 | ||||
| 97 | +B5|keep_frac=0.25|aware,unanswerable,Qwen2.5-3B,0.9666666666666667,0.9,1.0,30,0.9666666666666667 | ||||
| 98 | +B5|keep_frac=0.25|aware,unit_conversion,Llama-3.2-3B,0.0,0.0,0.0,15,0.0 | ||||
| 99 | +B5|keep_frac=0.25|aware,unit_conversion,Qwen2.5-3B,0.4666666666666667,0.2,0.7333333333333333,15,0.0 | ||||
modified
runs/raw/E1_core.jsonl
+34 −0
@@ -13484,3 +13484,37 @@ | |||||
| 13484 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "249692f5ce8f1d73a6740de8", "attempt_id": "fb51489c21df", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:10.966933Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2882882882882883, "origin_tokens": 1776, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1776, "source_tokens_receiver": 1776, "query_tokens": 677, "message_tokens": 571, "message_utf8_bytes": 2437, "cache_tensor_bytes": null, "serialized_payload_bytes": 2437, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.06537502352148, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.74979193042964, "ttft_ms": 13.673665933310986, "decode_ms": 1547.018332988955}, "total_wall_ms": 1642.768583027646, "ttft_ms": 13.673665933310986, "input_usage": {"receiver_prompt_tokens": 677}, "output_usage": {"output_tokens": 115}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902742760, "mlx_cache_bytes": 617350120, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6902742760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n total_price = row[1] * row[2]\n discount = total_price * row[3] / 100\n total_price -= discount\n tax = total_price * row[4] / 100\n total_price -= tax\n if row[5]:\n total_price -= total_price * row[6] / 100\n net_revenue.append([row[0], total_price])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b7473c9b2ca34ae2ad15a2f4942179c42282d616b583ea59fc5a9c9279c50de4", "output_hash": "3a25256cab462a5e1cb32c2c1077112ba4d284b7186c251430927e593e89675f"} | 13484 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "249692f5ce8f1d73a6740de8", "attempt_id": "fb51489c21df", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:10.966933Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2882882882882883, "origin_tokens": 1776, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1776, "source_tokens_receiver": 1776, "query_tokens": 677, "message_tokens": 571, "message_utf8_bytes": 2437, "cache_tensor_bytes": null, "serialized_payload_bytes": 2437, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.06537502352148, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.74979193042964, "ttft_ms": 13.673665933310986, "decode_ms": 1547.018332988955}, "total_wall_ms": 1642.768583027646, "ttft_ms": 13.673665933310986, "input_usage": {"receiver_prompt_tokens": 677}, "output_usage": {"output_tokens": 115}, "provider_cached_usage": null, "process_memory": 9840558080, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902742760, "mlx_cache_bytes": 617350120, "process_rss_bytes": 9840558080}, "peak_prefill_memory": null, "peak_decode_memory": 6902742760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n total_price = row[1] * row[2]\n discount = total_price * row[3] / 100\n total_price -= discount\n tax = total_price * row[4] / 100\n total_price -= tax\n if row[5]:\n total_price -= total_price * row[6] / 100\n net_revenue.append([row[0], total_price])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b7473c9b2ca34ae2ad15a2f4942179c42282d616b583ea59fc5a9c9279c50de4", "output_hash": "3a25256cab462a5e1cb32c2c1077112ba4d284b7186c251430927e593e89675f"} | ||
| 13485 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fcffc2920a4be15dd5396dac", "attempt_id": "09276543f2ae", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:12.835175Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2879640044994376, "origin_tokens": 1778, "compressed_tokens": 578, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 684, "message_tokens": 578, "message_utf8_bytes": 2327, "cache_tensor_bytes": null, "serialized_payload_bytes": 2327, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.99858301319182, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34491695091128, "ttft_ms": 13.695165980607271, "decode_ms": 2792.174707981758}, "total_wall_ms": 2888.588665984571, "ttft_ms": 13.695165980607271, "input_usage": {"receiver_prompt_tokens": 684}, "output_usage": {"output_tokens": 203}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907199236, "mlx_cache_bytes": 621921284, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6907199236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3]:\n if row[2] < 2:\n net_revenue.append({\n 'revenue': row[0],\n 'unit_price': row[1],\n 'days': row[2],\n 'return': row[3],\n 'result': row[4]\n })\n else:\n discount = row[1] * row[4] / 100\n unit_price = row[1] - discount\n tax = unit_price * row[2] * row[4] / 100\n net_revenue.append({\n 'revenue': row[0] * row[4],\n 'unit_price': unit_price,\n 'days': row[2],\n 'return': row[3],\n 'result': row[4],\n 'tax': tax\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "423a49a4accbb29d70f7498f3ebf493e0c0481ec1422a6875554275ac1745e8a", "output_hash": "a307b446a77dfaebc3d534f4333abf69203f14ae8a6eabb7ccb4cb5570ca3b0e"} | 13485 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fcffc2920a4be15dd5396dac", "attempt_id": "09276543f2ae", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:12.835175Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2879640044994376, "origin_tokens": 1778, "compressed_tokens": 578, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 684, "message_tokens": 578, "message_utf8_bytes": 2327, "cache_tensor_bytes": null, "serialized_payload_bytes": 2327, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.99858301319182, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.34491695091128, "ttft_ms": 13.695165980607271, "decode_ms": 2792.174707981758}, "total_wall_ms": 2888.588665984571, "ttft_ms": 13.695165980607271, "input_usage": {"receiver_prompt_tokens": 684}, "output_usage": {"output_tokens": 203}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907199236, "mlx_cache_bytes": 621921284, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6907199236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3]:\n if row[2] < 2:\n net_revenue.append({\n 'revenue': row[0],\n 'unit_price': row[1],\n 'days': row[2],\n 'return': row[3],\n 'result': row[4]\n })\n else:\n discount = row[1] * row[4] / 100\n unit_price = row[1] - discount\n tax = unit_price * row[2] * row[4] / 100\n net_revenue.append({\n 'revenue': row[0] * row[4],\n 'unit_price': unit_price,\n 'days': row[2],\n 'return': row[3],\n 'result': row[4],\n 'tax': tax\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "423a49a4accbb29d70f7498f3ebf493e0c0481ec1422a6875554275ac1745e8a", "output_hash": "a307b446a77dfaebc3d534f4333abf69203f14ae8a6eabb7ccb4cb5570ca3b0e"} | ||
| 13486 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8ba5551920d488af0ada35b4", "attempt_id": "a9fa9ad4ba9f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:15.948869Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2925714285714286, "origin_tokens": 1750, "compressed_tokens": 584, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1750, "source_tokens_receiver": 1750, "query_tokens": 690, "message_tokens": 584, "message_utf8_bytes": 2394, "cache_tensor_bytes": null, "serialized_payload_bytes": 2394, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.46862507797778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.24412503093481, "ttft_ms": 13.564125052653253, "decode_ms": 1656.4636249095201}, "total_wall_ms": 1752.6230829535052, "ttft_ms": 13.564125052653253, "input_usage": {"receiver_prompt_tokens": 690}, "output_usage": {"output_tokens": 123}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910574364, "mlx_cache_bytes": 625394716, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6910574364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[3] < 4:\n continue\n if row[3] < 4 and row[4] < 0:\n continue\n if row[4] < 0:\n net_revenue += row[2] * (1 - row[4])\n else:\n net_revenue += row[2] * (1 - row[4]) * (1 + row[4] / 100)\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "91535a844a7c8262e6f7eb2869f5f0ce078ee999e468a110e4336dff99f138d3", "output_hash": "1cd5a1a531494e01135bfff7b53b5e0ed8bcf8a7082638991c6dc75c3514efd9"} | 13486 | {"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8ba5551920d488af0ada35b4", "attempt_id": "a9fa9ad4ba9f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:15.948869Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2925714285714286, "origin_tokens": 1750, "compressed_tokens": 584, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1750, "source_tokens_receiver": 1750, "query_tokens": 690, "message_tokens": 584, "message_utf8_bytes": 2394, "cache_tensor_bytes": null, "serialized_payload_bytes": 2394, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.46862507797778, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.24412503093481, "ttft_ms": 13.564125052653253, "decode_ms": 1656.4636249095201}, "total_wall_ms": 1752.6230829535052, "ttft_ms": 13.564125052653253, "input_usage": {"receiver_prompt_tokens": 690}, "output_usage": {"output_tokens": 123}, "provider_cached_usage": null, "process_memory": 9840607232, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910574364, "mlx_cache_bytes": 625394716, "process_rss_bytes": 9840607232}, "peak_prefill_memory": null, "peak_decode_memory": 6910574364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[3] < 4:\n continue\n if row[3] < 4 and row[4] < 0:\n continue\n if row[4] < 0:\n net_revenue += row[2] * (1 - row[4])\n else:\n net_revenue += row[2] * (1 - row[4]) * (1 + row[4] / 100)\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "91535a844a7c8262e6f7eb2869f5f0ce078ee999e468a110e4336dff99f138d3", "output_hash": "1cd5a1a531494e01135bfff7b53b5e0ed8bcf8a7082638991c6dc75c3514efd9"} | ||
| 13487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "497ed6b8d988e4442ffb66df", "attempt_id": "533b7a059565", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3c3d27f14e6841b389fd503bcab914bda201aa79", "timestamp_utc": "2026-10-30T08:42:17.925526Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 561, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 667, "message_tokens": 561, "message_utf8_bytes": 2495, "cache_tensor_bytes": null, "serialized_payload_bytes": 2495, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.45999998319894, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.29549999628216, "ttft_ms": 13.490624958649278, "decode_ms": 2664.541167090647}, "total_wall_ms": 2759.726958000101, "ttft_ms": 13.490624958649278, "input_usage": {"receiver_prompt_tokens": 667}, "output_usage": {"output_tokens": 195}, "provider_cached_usage": null, "process_memory": 9840623616, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6896844480, "mlx_cache_bytes": 611288000, "process_rss_bytes": 9840623616}, "peak_prefill_memory": null, "peak_decode_memory": 6896844480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[5]:\n total_price = row[1] * row[2]\n discount = total_price * row[3] / 100\n total_price -= discount\n tax = total_price * row[4] / 100\n total_price += tax\n net_revenue.append({\n 'total_price': total_price,\n 'return': round(row[5] * row[1] * row[2], 2),\n 'result': round(total_price - row[5] * row[1] * row[2], 2)\n })\n else:\n net_revenue.append({\n 'total_price': row[1] * row[2],\n 'return': 0,\n 'result': row[1] * row[2]\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "84f1ebed1a2b476e559b7b3f4cefd24b66211ebb600bf98a61fe13802fda636d", "output_hash": "2012fa6a70529683271c63eaa3a666e852f485fee479f79842debd9754e4217b"} | ||||
| 13488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "99cc94326e4146b1b7165a7f", "attempt_id": "0128ef8e8046", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:20.921162Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2882882882882883, "origin_tokens": 1776, "compressed_tokens": 565, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1776, "source_tokens_receiver": 1776, "query_tokens": 672, "message_tokens": 565, "message_utf8_bytes": 2310, "cache_tensor_bytes": null, "serialized_payload_bytes": 2310, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 178.83129208348691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.4949589073658, "ttft_ms": 14.29595798254013, "decode_ms": 2122.73499998264}, "total_wall_ms": 2219.3354580085725, "ttft_ms": 14.29595798254013, "input_usage": {"receiver_prompt_tokens": 672}, "output_usage": {"output_tokens": 155}, "provider_cached_usage": null, "process_memory": 9841491968, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899744468, "mlx_cache_bytes": 614269908, "process_rss_bytes": 9841491968}, "peak_prefill_memory": null, "peak_decode_memory": 6899744468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[4] and row[5] < 2:\n net_revenue.append({\n 'revenue': row[0],\n 'price_pct': row[6],\n 'days': row[7],\n 'unit_price': row[8],\n 'discount': row[9],\n 'tax': row[10]\n })\n net_revenue = [item for item in net_revenue if item['tax']]\n net_revenue = [round(item['revenue'] * (1 - item['price_pct'] / 100), 2) for item in net_revenue]\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2d7a71bcd3ed95b9325ffe04e15279b6712cc9af7b11b359e09dce855a593b75", "output_hash": "b729cb4436c688b07cc5ec42ef27ac402004366a29dced7d5e60a665f5d75288"} | ||||
| 13489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "47ac740aefc4ffb314dc60b5", "attempt_id": "122b4245320a", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:23.371658Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1773, "compressed_tokens": 567, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 673, "message_tokens": 567, "message_utf8_bytes": 2354, "cache_tensor_bytes": null, "serialized_payload_bytes": 2354, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.0899579813704, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.64887500181794, "ttft_ms": 13.771625002846122, "decode_ms": 1872.2131249960512}, "total_wall_ms": 1965.9930830821395, "ttft_ms": 13.771625002846122, "input_usage": {"receiver_prompt_tokens": 673}, "output_usage": {"output_tokens": 138}, "provider_cached_usage": null, "process_memory": 9841573888, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899924696, "mlx_cache_bytes": 614466520, "process_rss_bytes": 9841573888}, "peak_prefill_memory": null, "peak_decode_memory": 6899924696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[6]:\n total_price = row[1] * (1 - row[2] / 100)\n return_value = round(total_price - row[3], 1)\n net_revenue.append([row[0], row[1], row[2], row[3], return_value])\n else:\n total_price = row[1] * (1 - row[2] / 100)\n net_revenue.append([row[0], row[1], row[2], total_price])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8f90480bac1467f3586aff0573ad1b393158f21bf18e94a44644a0c0fc8ced87", "output_hash": "a77d36f6c9a6ab5ec42f96d81c94c4dd992271ae35660b7d5be83758b7f06359"} | ||||
| 13490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "d82d6a231e7151db60b574f1", "attempt_id": "c68ca0fcdf4b", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:25.562074Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28780213603147836, "origin_tokens": 1779, "compressed_tokens": 568, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1779, "source_tokens_receiver": 1779, "query_tokens": 674, "message_tokens": 568, "message_utf8_bytes": 2387, "cache_tensor_bytes": null, "serialized_payload_bytes": 2387, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.6894160490483, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.06112503446639, "ttft_ms": 13.499583001248538, "decode_ms": 1498.353625065647}, "total_wall_ms": 1594.2203749436885, "ttft_ms": 13.499583001248538, "input_usage": {"receiver_prompt_tokens": 674}, "output_usage": {"output_tokens": 111}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6901300956, "mlx_cache_bytes": 615859164, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6901300956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n revenue, _price, _pct, days, return_value, _ = row\n if return_value < 3:\n continue\n discount = _price * _pct\n total_price = revenue - discount\n tax = total_price * 0.1\n total_price -= tax\n net_revenue.append((total_price, round(total_price, 2), days))\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "ValueError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "821e4a6998224f423dcccc86ab4ab3d5e99127736fd3c81de48b3bc8d4fadcfb", "output_hash": "fec0ade85339e7234c83e2d60ed984e03cea8b1b1e7b9315d99fc2cee40c0438"} | ||||
| 13491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dcb3968f5db34c4e2aa3c111", "attempt_id": "07a5d536c955", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:27.381046Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2910744741330301, "origin_tokens": 1759, "compressed_tokens": 568, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1759, "source_tokens_receiver": 1759, "query_tokens": 674, "message_tokens": 568, "message_utf8_bytes": 2477, "cache_tensor_bytes": null, "serialized_payload_bytes": 2477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.00216697528958, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.26708306372166, "ttft_ms": 13.799750013276935, "decode_ms": 1116.2925839889795}, "total_wall_ms": 1212.6838329713792, "ttft_ms": 13.799750013276935, "input_usage": {"receiver_prompt_tokens": 674}, "output_usage": {"output_tokens": 83}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6901300956, "mlx_cache_bytes": 491078620, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6901300956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[3] == 'true':\n total_price = row[1] * (1 - row[2])\n return_value = total_price - (total_price * row[2] / 100)\n net_revenue += return_value\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9280a89505b62652effd544d5c0c14ee514c76f6bacf88c57ce1f1d0dafffb71", "output_hash": "ba5fd7c67f0a4047766abb3cfc1671e5cafb478059f113c0da65846fe5adadc7"} | ||||
| 13492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "8ba6edb7f2072035e1c2c36e", "attempt_id": "b005aa22a6df", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:28.817740Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2871564778463264, "origin_tokens": 1783, "compressed_tokens": 556, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1783, "source_tokens_receiver": 1783, "query_tokens": 662, "message_tokens": 556, "message_utf8_bytes": 2343, "cache_tensor_bytes": null, "serialized_payload_bytes": 2343, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.5197080047801, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.55270796082914, "ttft_ms": 13.581416918896139, "decode_ms": 1009.1769170248881}, "total_wall_ms": 1103.6108750849962, "ttft_ms": 13.581416918896139, "input_usage": {"receiver_prompt_tokens": 662}, "output_usage": {"output_tokens": 75}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6893846188, "mlx_cache_bytes": 483427244, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6893846188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row[3] < 3:\n continue\n if row[2] < 0:\n continue\n total += (row[1] - row[2] * row[3]) * row[4]\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "146b533021f85a62b0b442f1c7858256c7643942d82bfc14a289b82840eb5aeb", "output_hash": "ac4ca858b5d72cf4f6aa0b7074365d712cf9f23a155262f7635c1c70db54f274"} | ||||
| 13493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "a286376f5d8f3683b8910219", "attempt_id": "82987a3e4a9f", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:30.128352Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2964678633468442, "origin_tokens": 1727, "compressed_tokens": 569, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1727, "source_tokens_receiver": 1727, "query_tokens": 675, "message_tokens": 569, "message_utf8_bytes": 2403, "cache_tensor_bytes": null, "serialized_payload_bytes": 2403, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 157.29450003709644, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.9257080545649, "ttft_ms": 13.848165981471539, "decode_ms": 1144.9057089630514}, "total_wall_ms": 1240.9864579094574, "ttft_ms": 13.848165981471539, "input_usage": {"receiver_prompt_tokens": 675}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6901481184, "mlx_cache_bytes": 491275232, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6901481184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row[6]:\n discount = row[2] * row[1]\n unit_price = row[1] - discount\n total += (row[0] * unit_price) / 100\n else:\n total += row[0]\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "f361625f3a060bb6cdacf62f72406152cc5b5504fc7bc0f3a2644719509fb2b7", "output_hash": "23840152737e815af651da4c9d5ec3607ebd257a12507429e459aea11c69253d"} | ||||
| 13494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "85977675d46a496ecac43d97", "attempt_id": "0e3eaaa37da5", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:31.593322Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28619340413638905, "origin_tokens": 1789, "compressed_tokens": 568, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1789, "source_tokens_receiver": 1789, "query_tokens": 674, "message_tokens": 568, "message_utf8_bytes": 2306, "cache_tensor_bytes": null, "serialized_payload_bytes": 2306, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.5933750383556, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.9099159669131, "ttft_ms": 13.659916934557259, "decode_ms": 1532.3253750102594}, "total_wall_ms": 1628.2140410039574, "ttft_ms": 13.659916934557259, "input_usage": {"receiver_prompt_tokens": 674}, "output_usage": {"output_tokens": 114}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6901300956, "mlx_cache_bytes": 615859164, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6901300956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[4] and row[5] < 3:\n continue\n price = row[2] * row[6]\n discount = row[2] * row[5] * row[7]\n tax = row[2] * row[5] * row[8]\n net_revenue += (price - discount) * row[5] * row[9]\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9c6c34da6100909bea9860b9179341485319e5085f2831b74824af13dd019a52", "output_hash": "300e8ce2def91ca8951552171089751d878ffdd0e00dc6239a68ea55075d2bc9"} | ||||
| 13495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "2d911474369be5b41b33aef5", "attempt_id": "6a2ce52eb411", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:33.446214Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.287478944413251, "origin_tokens": 1781, "compressed_tokens": 561, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1781, "source_tokens_receiver": 1781, "query_tokens": 668, "message_tokens": 561, "message_utf8_bytes": 2403, "cache_tensor_bytes": null, "serialized_payload_bytes": 2403, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.91362497396767, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.15595900360495, "ttft_ms": 13.627458014525473, "decode_ms": 2354.5712920604274}, "total_wall_ms": 2449.697708012536, "ttft_ms": 13.627458014525473, "input_usage": {"receiver_prompt_tokens": 668}, "output_usage": {"output_tokens": 175}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6897925828, "mlx_cache_bytes": 612385732, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6897925828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row['return'] and row['units'] < 2:\n net_revenue.append({\n 'total_price': row['unit_price'] * row['units'] * (1 - row['pct']),\n 'return': row['return'],\n 'result': 0\n })\n else:\n net_revenue.append({\n 'total_price': row['unit_price'] * row['units'] * (1 - row['pct']),\n 'return': row['return'],\n 'result': row['total_price'] - (row['total_price'] * row['pct'] / 100) - (row['total_price'] * row['return'] / 100)\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "550eb2ac15e1eb50b2b2b9937efd6fa3d2b485341b94e9e77bf64822c2ed7d46", "output_hash": "51badb0e56b2cb19c11b35f0067ab4371dd143d59c7ae31fdb406452b80ac71a"} | ||||
| 13496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "aa88aea946fad20df71b7aac", "attempt_id": "b3d16af58634", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:36.121956Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2828729281767956, "origin_tokens": 1810, "compressed_tokens": 579, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1810, "source_tokens_receiver": 1810, "query_tokens": 685, "message_tokens": 579, "message_utf8_bytes": 2312, "cache_tensor_bytes": null, "serialized_payload_bytes": 2312, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.94533301517367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.97695803735405, "ttft_ms": 13.529750052839518, "decode_ms": 1600.7696250453591}, "total_wall_ms": 1696.6219580499455, "ttft_ms": 13.529750052839518, "input_usage": {"receiver_prompt_tokens": 685}, "output_usage": {"output_tokens": 118}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907379464, "mlx_cache_bytes": 622117896, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6907379464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[6] < 6:\n continue\n revenue = row[1] * (1 - row[2] / 100)\n discount = row[1] * (row[2] / 100)\n tax = discount * (row[3] / 100)\n total_price = revenue - discount + tax\n net_revenue.append([row[0], round(total_price, 2)])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "c0975c8f7571f34d1cd9d9a5e9b39e146019671e5a0ceea765fadf22de7b7e52", "output_hash": "6b592111c07261f4244bb1861f24f16a3ddd48d58940fd5eae1ef046189c9814"} | ||||
| 13497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "025ee727b8d8620ea5b2d4b9", "attempt_id": "3df770973171", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:38.044691Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2924043403769275, "origin_tokens": 1751, "compressed_tokens": 584, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1751, "source_tokens_receiver": 1751, "query_tokens": 690, "message_tokens": 584, "message_utf8_bytes": 2401, "cache_tensor_bytes": null, "serialized_payload_bytes": 2401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.5227499846369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.4392080064863, "ttft_ms": 13.853417010977864, "decode_ms": 1307.8046248992905}, "total_wall_ms": 1404.468125081621, "ttft_ms": 13.853417010977864, "input_usage": {"receiver_prompt_tokens": 690}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6910574364, "mlx_cache_bytes": 625394716, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6910574364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[3] < 3:\n continue\n unit_price = row[1] * row[2]\n discount = row[1] * row[2] * row[3] / 100\n unit_price -= discount\n net_revenue += unit_price * row[0]\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "e5a6392a10268f82d9d3a60785b26607d413381787370acac61e71a77477cc95", "output_hash": "83275e808bae2f86c4674652db83a7d9f389b61b74f1b782aee075b4d93ab137"} | ||||
| 13498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "641cc033dab82953821bbb76", "attempt_id": "8f5ed33ad031", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:39.675998Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29207073588134624, "origin_tokens": 1753, "compressed_tokens": 583, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1753, "source_tokens_receiver": 1753, "query_tokens": 689, "message_tokens": 583, "message_utf8_bytes": 2420, "cache_tensor_bytes": null, "serialized_payload_bytes": 2420, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.8406249312684, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.28320798277855, "ttft_ms": 13.886500033549964, "decode_ms": 1415.9948750166222}, "total_wall_ms": 1512.5300409272313, "ttft_ms": 13.886500033549964, "input_usage": {"receiver_prompt_tokens": 689}, "output_usage": {"output_tokens": 104}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6909198104, "mlx_cache_bytes": 624002072, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6909198104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3] < 5:\n continue\n unit_price = row[1]\n discount = row[2] / 100\n unit_price -= unit_price * discount\n tax = row[3] * unit_price * 0.1\n unit_price += tax\n net_revenue.append([row[0], unit_price])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "40fd90e0803fcd3dc7e6e9f16768505edd868ec77860e7401b7b40a5c636dfeb", "output_hash": "dc5f865bffdcf95525727957a79355a89943889bcff8c6105beca968ccc6f898"} | ||||
| 13499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "61b672f1008820066df718a5", "attempt_id": "41a11868919e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:41.414048Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28845070422535213, "origin_tokens": 1775, "compressed_tokens": 560, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1775, "source_tokens_receiver": 1775, "query_tokens": 666, "message_tokens": 560, "message_utf8_bytes": 2454, "cache_tensor_bytes": null, "serialized_payload_bytes": 2454, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.64866696111858, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.80712503194809, "ttft_ms": 13.666957966051996, "decode_ms": 1776.1701670242473}, "total_wall_ms": 1870.9364999085665, "ttft_ms": 13.666957966051996, "input_usage": {"receiver_prompt_tokens": 666}, "output_usage": {"output_tokens": 132}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6896664252, "mlx_cache_bytes": 611091388, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6896664252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n price = row[1]\n pct = row[2]\n days = row[6]\n return_value = row[0]\n if row[7]:\n return_value -= (row[0] * (price * pct / 100))\n if days > 3:\n return_value += (row[0] * (price * pct / 100))\n return_value = round(return_value, 2)\n net_revenue.append([return_value, price, pct, days])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "448502755d7d30f09cc1db22fa65c54b8d68b3d1ca696958f2784d140711b43a", "output_hash": "3704ba8ff1c241b6f339b6da39a9133512684c0ed7a6392969bff0c3567288ae"} | ||||
| 13500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "4f68a6cf073fe103dd9f84f5", "attempt_id": "6e6a1b30f8fe", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:43.508640Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28942905596382135, "origin_tokens": 1769, "compressed_tokens": 567, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1769, "source_tokens_receiver": 1769, "query_tokens": 673, "message_tokens": 567, "message_utf8_bytes": 2254, "cache_tensor_bytes": null, "serialized_payload_bytes": 2254, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.0438330192119, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.24433292262256, "ttft_ms": 13.686000020243227, "decode_ms": 1927.0280000055209}, "total_wall_ms": 2020.3162910183892, "ttft_ms": 13.686000020243227, "input_usage": {"receiver_prompt_tokens": 673}, "output_usage": {"output_tokens": 143}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899924696, "mlx_cache_bytes": 614466520, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6899924696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[4] < 5:\n continue\n if row[2] == False:\n net_revenue.append({\n 'revenue': row[0],\n 'unit_price': row[1],\n 'discount': row[3],\n 'tax': row[4] * row[1] * row[3] / 100,\n 'result': row[0] - row[1] * row[3] + row[4] * row[1] * row[3] / 100\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "dd2978260f5277083d44090d80dfcde060d1d384818216b10a649b61e16517b2", "output_hash": "48282ee7e4c979b8bbe577ac34c6b8952a468155aa6239e60b2613fb39a67b91"} | ||||
| 13501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fb6c04376c11e55db2650bc2", "attempt_id": "a80bccf747b2", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:45.752660Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2882882882882883, "origin_tokens": 1776, "compressed_tokens": 578, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1776, "source_tokens_receiver": 1776, "query_tokens": 684, "message_tokens": 578, "message_utf8_bytes": 2193, "cache_tensor_bytes": null, "serialized_payload_bytes": 2193, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.16729100234807, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.82966599613428, "ttft_ms": 13.605042011477053, "decode_ms": 1829.5709999511018}, "total_wall_ms": 1925.2815840300173, "ttft_ms": 13.605042011477053, "input_usage": {"receiver_prompt_tokens": 684}, "output_usage": {"output_tokens": 136}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6907199236, "mlx_cache_bytes": 621921284, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6907199236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[6]:\n unit_price = row[1]\n discount = row[2] * unit_price\n revenue = row[0] - discount\n tax = (revenue * row[3]) / 100\n net_revenue.append([row[0], row[1], row[2], row[3], revenue, tax])\n else:\n net_revenue.append([row[0], row[1], row[2], row[3], row[0], 0])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "a2fc1c748d6e2e0d5a56ebddd9feb88ac4ac2392df78a72169af1a5b27895e5f", "output_hash": "5bb18c586d96a78edb7fa0f5e34844ecab050a8c059ed1451dfe72b71df7b924"} | ||||
| 13502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "978c018455a5a6a1ac63d92e", "attempt_id": "dd655a675016", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:47.902508Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2925714285714286, "origin_tokens": 1750, "compressed_tokens": 576, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1750, "source_tokens_receiver": 1750, "query_tokens": 682, "message_tokens": 576, "message_utf8_bytes": 2463, "cache_tensor_bytes": null, "serialized_payload_bytes": 2463, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.50287504773587, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.104209064506, "ttft_ms": 13.847957947291434, "decode_ms": 1279.2211669730023}, "total_wall_ms": 1375.4802499897778, "ttft_ms": 13.847957947291434, "input_usage": {"receiver_prompt_tokens": 682}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6905937660, "mlx_cache_bytes": 620626940, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6905937660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[4]:\n unit_price = row[2] * row[3]\n discount = row[2] * row[3] * row[5]\n net_price = unit_price - discount\n tax = net_price * row[6]\n net_revenue += net_price - tax\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "8630e417e7ecd69b053de649fe0d893eaf61fe5755895d35bc941e95fbb938a4", "output_hash": "c5f1d843bd0119adbb498f3fd117bcf9128b0fd48df692923193bb16fe0b71d1"} | ||||
| 13503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "23c5ec0cdcbfc99eda4dc7e3", "attempt_id": "a747ca243bae", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:49.501771Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2924043403769275, "origin_tokens": 1751, "compressed_tokens": 573, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1751, "source_tokens_receiver": 1751, "query_tokens": 679, "message_tokens": 573, "message_utf8_bytes": 2449, "cache_tensor_bytes": null, "serialized_payload_bytes": 2449, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 170.88595894165337, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.08937507495284, "ttft_ms": 13.747042044997215, "decode_ms": 1596.2386670289561}, "total_wall_ms": 1692.375999991782, "ttft_ms": 13.747042044997215, "input_usage": {"receiver_prompt_tokens": 679}, "output_usage": {"output_tokens": 118}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6904004336, "mlx_cache_bytes": 618644464, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6904004336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[6] < 6:\n continue\n if row[1] == False:\n unit_price = row[2]\n discount = row[3]\n tax = row[4]\n total_price = unit_price - (unit_price * discount / 100)\n if tax:\n total_price += (total_price * tax / 100)\n net_revenue.append([row[0], total_price])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "d9108e0320ff70f5c37a52c76dea886912e6b01db5cec54004934b350df6a14d", "output_hash": "d90b3d25ac4f1b03d55d5654d503a1d1dfedd7292281136fe593373206ffa9ae"} | ||||
| 13504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "89b2a97529b835b026ce7bbf", "attempt_id": "72f91793eef7", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:51.419124Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29307384087006294, "origin_tokens": 1747, "compressed_tokens": 577, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1747, "source_tokens_receiver": 1747, "query_tokens": 683, "message_tokens": 577, "message_utf8_bytes": 2374, "cache_tensor_bytes": null, "serialized_payload_bytes": 2374, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.2289999704808, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.49324997793883, "ttft_ms": 13.581749983131886, "decode_ms": 1471.4275830192491}, "total_wall_ms": 1567.844209028408, "ttft_ms": 13.581749983131886, "input_usage": {"receiver_prompt_tokens": 683}, "output_usage": {"output_tokens": 109}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6906117888, "mlx_cache_bytes": 620823552, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6906117888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[4]:\n discount = row[2] * row[3]\n unit_price = row[1] - discount\n tax = unit_price * 0.975\n net = unit_price - tax\n net_revenue.append([row[0], round(net, 2)])\n else:\n net_revenue.append([row[0], row[1]])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "db05d12476288df3b0020d8a6596118cf7292828db88dc6a1882fd6b8645ffe7", "output_hash": "131920fb22087c603c8c03b2a7751d283f14e60fcd9a79713282bd09d1a31774"} | ||||
| 13505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "dc39ee11a8978e148425de6c", "attempt_id": "d1916819032e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:53.212700Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289920724801812, "origin_tokens": 1766, "compressed_tokens": 537, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 643, "message_tokens": 537, "message_utf8_bytes": 2448, "cache_tensor_bytes": null, "serialized_payload_bytes": 2448, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.50633309595287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.88912495784461, "ttft_ms": 13.595500029623508, "decode_ms": 1212.232832913287}, "total_wall_ms": 1307.0872919633985, "ttft_ms": 13.595500029623508, "input_usage": {"receiver_prompt_tokens": 643}, "output_usage": {"output_tokens": 90}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6882934368, "mlx_cache_bytes": 472204128, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6882934368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[4]:\n unit_price = row[2] * row[3]\n discount = row[2] * row[5]\n net_price = unit_price - discount\n tax = net_price * row[6]\n net_revenue += net_price - tax\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "9b093efb24dab82665d1b9d9382a2742c0b65505d5f65df1ad6d248f9feae2c5", "output_hash": "6923babd25cb138c1058e523556898398dd65be219eff452a62e2d031f57ac35"} | ||||
| 13506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "139fca0831cb1fc7c2d67d90", "attempt_id": "a7ef4b9ab385", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:54.744710Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29157175398633256, "origin_tokens": 1756, "compressed_tokens": 571, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1756, "source_tokens_receiver": 1756, "query_tokens": 677, "message_tokens": 571, "message_utf8_bytes": 2519, "cache_tensor_bytes": null, "serialized_payload_bytes": 2519, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.5362500399351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.89508407283574, "ttft_ms": 13.631999958306551, "decode_ms": 955.9395830146968}, "total_wall_ms": 1051.8002919852734, "ttft_ms": 13.631999958306551, "input_usage": {"receiver_prompt_tokens": 677}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6902742760, "mlx_cache_bytes": 492569576, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6902742760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_price = 0\n for row in rows:\n if row[3] < 3:\n continue\n unit_price = row[1] - (row[1] * row[2] / 100)\n total_price += unit_price\n return total_price\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "33e9e194cec43017dddec4d3c723228289ddf300af66722f35a8ec7d5601325f", "output_hash": "b2bf737e68b5ac320de4942978295fdbbc1379a4999808840bbfa66f9f634bd4"} | ||||
| 13507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "7db6b526486c17d5a19e82d3", "attempt_id": "9b98f90bd0fb", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:56.004152Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.287478944413251, "origin_tokens": 1781, "compressed_tokens": 565, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1781, "source_tokens_receiver": 1781, "query_tokens": 671, "message_tokens": 565, "message_utf8_bytes": 2310, "cache_tensor_bytes": null, "serialized_payload_bytes": 2310, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 156.63258300628513, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.28445905074477, "ttft_ms": 13.715166016481817, "decode_ms": 847.5787499919534}, "total_wall_ms": 942.8761670133099, "ttft_ms": 13.715166016481817, "input_usage": {"receiver_prompt_tokens": 671}, "output_usage": {"output_tokens": 63}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6899367632, "mlx_cache_bytes": 489096144, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6899367632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for r in rows:\n if r[3] < 5:\n continue\n total += round((r[1] * (1 - r[2] / 100)), 1)\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "bd4e07f1a616236f364ee7cefdf01757ae715ef75b4a935e47120e40a77f3e44", "output_hash": "2d220646ae2a26932c763cfcbe679fbd40555124568628628ac4940a1291719a"} | ||||
| 13508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "417b799672db8ff9fdcbf02d", "attempt_id": "58df1c483870", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:57.153796Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.289920724801812, "origin_tokens": 1766, "compressed_tokens": 562, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1766, "source_tokens_receiver": 1766, "query_tokens": 668, "message_tokens": 562, "message_utf8_bytes": 2336, "cache_tensor_bytes": null, "serialized_payload_bytes": 2336, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 156.7782920319587, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.49608301371336, "ttft_ms": 13.607500004582107, "decode_ms": 1779.5917079783976}, "total_wall_ms": 1874.9484160216525, "ttft_ms": 13.607500004582107, "input_usage": {"receiver_prompt_tokens": 668}, "output_usage": {"output_tokens": 132}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6897925828, "mlx_cache_bytes": 612385732, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6897925828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[5]: # if item is returned\n units_returned = row[6]\n unit_price = row[2]\n discount = row[3]\n tax = row[4]\n net_revenue += (units_returned * unit_price) - (units_returned * unit_price * discount) + (units_returned * unit_price * discount * tax)\n else:\n net_revenue += row[2] - row[3]\n return round(net_revenue, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "18a815a8f3f527b23d509bf0e540b732df6b778d849e7c4e010741e191f73b6e", "output_hash": "0bbd37fea4e618dc818ff883dacee83793a671bd4ed31bf4a589b44f1cf15886"} | ||||
| 13509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9e32511fb4ecaf4d7e549ca5", "attempt_id": "ba4dff172423", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:42:59.252806Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2895927601809955, "origin_tokens": 1768, "compressed_tokens": 563, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1768, "source_tokens_receiver": 1768, "query_tokens": 669, "message_tokens": 563, "message_utf8_bytes": 2273, "cache_tensor_bytes": null, "serialized_payload_bytes": 2273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.56270798295736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.14262502547354, "ttft_ms": 13.650209060870111, "decode_ms": 1420.1994170434773}, "total_wall_ms": 1515.2930830372497, "ttft_ms": 13.650209060870111, "input_usage": {"receiver_prompt_tokens": 669}, "output_usage": {"output_tokens": 105}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6898106056, "mlx_cache_bytes": 612582344, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6898106056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row[3]:\n if row[2] < 6:\n total += row[1] * (1 - row[2] / 100)\n else:\n total += row[1] * (1 - row[2] / 100) * (1 - row[2] / 100)\n else:\n total += row[1]\n return total\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "cf570e5ce845b463ac0e0b7e0c1573c8e1c07c4fdc6cf595fdc96f2e58a1f6f7", "output_hash": "547c1d5080b69951b1883a0d35e019141280a12cb9eb042a5700e3e0b198dad3"} | ||||
| 13510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "f3438227c2d36b4280e97600", "attempt_id": "447df2132d8e", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:00.992893Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2912400455062571, "origin_tokens": 1758, "compressed_tokens": 575, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1758, "source_tokens_receiver": 1758, "query_tokens": 681, "message_tokens": 575, "message_utf8_bytes": 2478, "cache_tensor_bytes": null, "serialized_payload_bytes": 2478, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 170.58512510266155, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.99929103627801, "ttft_ms": 13.587624998763204, "decode_ms": 1536.7103329626843}, "total_wall_ms": 1632.6072909869254, "ttft_ms": 13.587624998763204, "input_usage": {"receiver_prompt_tokens": 681}, "output_usage": {"output_tokens": 114}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6904561400, "mlx_cache_bytes": 619234296, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6904561400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3] < 5:\n continue\n revenue = row[0] * row[2] * (1 - row[2] * row[4])\n tax = revenue * row[4]\n net = revenue - tax\n net_revenue.append([row[0], row[1], row[2], row[3], row[4], row[5], net])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "15bc4685c90e187e047fd226f3ae070a44f807d190800d87432b1247b39d777f", "output_hash": "67738af5a692c6bd432d014dec44dbcdb183eea0e169ea3999b80b02708e7a8f"} | ||||
| 13511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "417f3037ddb170c5eba5514a", "attempt_id": "278967976363", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:02.850007Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28942905596382135, "origin_tokens": 1769, "compressed_tokens": 560, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1769, "source_tokens_receiver": 1769, "query_tokens": 666, "message_tokens": 560, "message_utf8_bytes": 2367, "cache_tensor_bytes": null, "serialized_payload_bytes": 2367, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.30504094529897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.69599997159094, "ttft_ms": 13.524957932531834, "decode_ms": 1954.5689160004258}, "total_wall_ms": 2049.1593750193715, "ttft_ms": 13.524957932531834, "input_usage": {"receiver_prompt_tokens": 666}, "output_usage": {"output_tokens": 145}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6896664252, "mlx_cache_bytes": 611091388, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6896664252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3] < 5:\n continue\n if row[1] == 0:\n net_revenue.append([row[0], row[2], row[4], row[5], row[6]])\n else:\n discount = row[1] * row[2]\n unit_price = row[2] - discount\n tax = unit_price * row[5] / 100\n net_revenue.append([row[0], unit_price, row[4], row[5], row[6] - tax])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "0a7cf7d36d55b2746d25950ba1eea3b37ca170eb5aef512f124c5f349a495175", "output_hash": "fa72dc69f0801d0b7185b5a96cd62b4b7edf0991e9e07bf04d0edca0b6ab474c"} | ||||
| 13512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9c31ec74c6c7239a5b8d2425", "attempt_id": "765439cc5491", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:05.123121Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29024943310657597, "origin_tokens": 1764, "compressed_tokens": 583, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1764, "source_tokens_receiver": 1764, "query_tokens": 689, "message_tokens": 583, "message_utf8_bytes": 2392, "cache_tensor_bytes": null, "serialized_payload_bytes": 2392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 170.66475003957748, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.18833298794925, "ttft_ms": 13.64324998576194, "decode_ms": 1334.701249958016}, "total_wall_ms": 1430.8841250604019, "ttft_ms": 13.64324998576194, "input_usage": {"receiver_prompt_tokens": 689}, "output_usage": {"output_tokens": 99}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6909198104, "mlx_cache_bytes": 624002072, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6909198104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total = 0\n for row in rows:\n if row[4]:\n if row[2] < 5:\n total += (row[1] - row[2] * row[3]) * row[5]\n else:\n total += row[1] * row[5]\n else:\n total += row[1] * row[5]\n return round(total, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2779df1d50fd05a169f3780709dd8ff462bb7fac0793db2f3d291bdf6886efb0", "output_hash": "7a9e39d5f13655cb75a9bf3c806678bbd1303f68368d3510a3d0b989e7e2991b"} | ||||
| 13513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "15d1a22545249e7df14cf7b9", "attempt_id": "36b13cca650c", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:06.778263Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2905788876276958, "origin_tokens": 1762, "compressed_tokens": 569, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1762, "source_tokens_receiver": 1762, "query_tokens": 675, "message_tokens": 569, "message_utf8_bytes": 2434, "cache_tensor_bytes": null, "serialized_payload_bytes": 2434, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.22029105667025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.74895909521729, "ttft_ms": 13.602708000689745, "decode_ms": 1277.2740840446204}, "total_wall_ms": 1372.917874949053, "ttft_ms": 13.602708000689745, "input_usage": {"receiver_prompt_tokens": 675}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6901481184, "mlx_cache_bytes": 616055776, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6901481184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[3] < 3:\n continue\n unit_price = row[1] * row[2]\n discount = row[1] * row[2] * row[3] / 100\n unit_price -= discount\n net_revenue += unit_price * row[4]\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "7a7bd7ac5b59a6505d1891d602d084031b9cedc8e40c070443b850ce8d73e56f", "output_hash": "6b0b627e7aa4da77376f2bf48b04aea4178778e91af267a73a5d2c25c272e043"} | ||||
| 13514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "e8ecba377aaff21f86df692c", "attempt_id": "290c00c6d011", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:08.376996Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.29357798165137616, "origin_tokens": 1744, "compressed_tokens": 569, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1744, "source_tokens_receiver": 1744, "query_tokens": 675, "message_tokens": 569, "message_utf8_bytes": 2504, "cache_tensor_bytes": null, "serialized_payload_bytes": 2504, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.45045898016542, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.94512496609241, "ttft_ms": 13.613666989840567, "decode_ms": 3052.1428750362247}, "total_wall_ms": 3148.0328330071643, "ttft_ms": 13.613666989840567, "input_usage": {"receiver_prompt_tokens": 675}, "output_usage": {"output_tokens": 226}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6901481184, "mlx_cache_bytes": 616055776, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6901481184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n total_price = row['total_price']\n return_pct = row['return_pct']\n discount = row['discount']\n tax = row['tax']\n units = row['units']\n unit_price = row['unit_price']\n days = row['days']\n is_returned = row['is_returned']\n shipped_days = row['shipped_days']\n\n if is_returned:\n total_price -= units * unit_price * (discount / 100)\n total_price -= units * unit_price * (tax / 100)\n total_price = round(total_price, 1)\n\n net_revenue.append({\n 'total_price': total_price,\n 'return_pct': return_pct,\n 'discount': discount,\n 'tax': tax,\n 'units': units,\n 'unit_price': unit_price,\n 'days': days,\n 'is_returned': is_returned,\n 'shipped_days': shipped_days\n })\n\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "af22e608089fbe91e1860ef1c984588749c4f27891dfd740000af7070a5e6baf", "output_hash": "084cc93db66cac640271f6584db58241563a0fe1b936c6249015b23ed8a94f42"} | ||||
| 13515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "445f29a9d6b7ea696aad9995", "attempt_id": "ec3faa2102bd", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:11.750826Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28893905191873587, "origin_tokens": 1772, "compressed_tokens": 555, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1772, "source_tokens_receiver": 1772, "query_tokens": 661, "message_tokens": 555, "message_utf8_bytes": 2405, "cache_tensor_bytes": null, "serialized_payload_bytes": 2405, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.58554203342646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.1646660072729, "ttft_ms": 13.56295810546726, "decode_ms": 3667.922291904688}, "total_wall_ms": 3761.9722080416977, "ttft_ms": 13.56295810546726, "input_usage": {"receiver_prompt_tokens": 661}, "output_usage": {"output_tokens": 272}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6893469352, "mlx_cache_bytes": 607814568, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6893469352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[3]:\n if row[2] < 6:\n net_revenue.append({\n 'total_price': row[0] * row[1],\n 'discount': row[2] * row[1],\n 'tax': 0,\n 'return': row[2] * row[1],\n 'result': row[2] * row[1] - row[2] * row[1]\n })\n else:\n net_revenue.append({\n 'total_price': row[0] * row[1],\n 'discount': 0,\n 'tax': row[0] * row[1] * row[2],\n 'return': 0,\n 'result': row[0] * row[1] * row[2]\n })\n else:\n net_revenue.append({\n 'total_price': row[0] * row[1],\n 'discount': 0,\n 'tax': row[0] * row[1] * row[2],\n 'return': 0,\n 'result': row[0] * row[1] * row[2]\n })\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "075331a617210b26cdde49035dcae1522276146d58964e86c6918af5f89f2c76", "output_hash": "4730108a74f722814b200acc44323cfd87cc630ba021d49ce0346f9b6a22345d"} | ||||
| 13516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "0afab555476f2096be36b122", "attempt_id": "ac59ee619915", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:15.738341Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2879640044994376, "origin_tokens": 1778, "compressed_tokens": 558, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1778, "source_tokens_receiver": 1778, "query_tokens": 664, "message_tokens": 558, "message_utf8_bytes": 2335, "cache_tensor_bytes": null, "serialized_payload_bytes": 2335, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 172.06883302424103, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.74229205865413, "ttft_ms": 13.753874925896525, "decode_ms": 1454.0045419707894}, "total_wall_ms": 1548.7868339987472, "ttft_ms": 13.753874925896525, "input_usage": {"receiver_prompt_tokens": 664}, "output_usage": {"output_tokens": 108}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6895107764, "mlx_cache_bytes": 609502132, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6895107764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n if row[5]: # return\n if row[6] < 3:\n continue\n unit_price = row[7]\n discount = row[8]\n price_pct_days = row[9]\n total_price = unit_price - discount\n net_revenue += total_price * (1 - price_pct_days / 100)\n return round(net_revenue, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "db5a60832cf405c7d1bf66d6a49725a3e3704d0322eebaac23190ce58530c979", "output_hash": "2a878c0d44d41ce75fef86c29083194b25a4e8da2369dfce1a04a6f3fd423468"} | ||||
| 13517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9046a31f6157f55c3c551801", "attempt_id": "b5b923f3c5e9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:17.510068Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.28476084538375973, "origin_tokens": 1798, "compressed_tokens": 573, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1798, "source_tokens_receiver": 1798, "query_tokens": 679, "message_tokens": 573, "message_utf8_bytes": 2350, "cache_tensor_bytes": null, "serialized_payload_bytes": 2350, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 170.47075007576495, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.11183298751712, "ttft_ms": 13.52249993942678, "decode_ms": 1654.3575840769336}, "total_wall_ms": 1750.311000039801, "ttft_ms": 13.52249993942678, "input_usage": {"receiver_prompt_tokens": 679}, "output_usage": {"output_tokens": 123}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6904004336, "mlx_cache_bytes": 618644464, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6904004336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[5] and row[6] < 5:\n continue\n if row[2] < 0.975:\n continue\n total_price = row[1] * (1 - row[2])\n if row[3]:\n total_price *= 1 + row[4]\n net_revenue.append([row[0], total_price, row[5], row[6], row[7], row[8]])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "c366a2643874e918056d40df146f31f6ec7e70198fa23f9423595bc08528aaae", "output_hash": "a05062f8bd8bcaacee322fd2b1aa5dd3b72e7bf435f31e23fce3305886e2eb97"} | ||||
| 13518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "9d962bca79b9a33461333901", "attempt_id": "1b9fd34d02c9", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:19.485440Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2939150401836969, "origin_tokens": 1742, "compressed_tokens": 564, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1742, "source_tokens_receiver": 1742, "query_tokens": 670, "message_tokens": 564, "message_utf8_bytes": 2465, "cache_tensor_bytes": null, "serialized_payload_bytes": 2465, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.4025839464739, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.21716703660786, "ttft_ms": 13.643624959513545, "decode_ms": 1595.2362089883536}, "total_wall_ms": 1690.3827090281993, "ttft_ms": 13.643624959513545, "input_usage": {"receiver_prompt_tokens": 670}, "output_usage": {"output_tokens": 118}, "provider_cached_usage": null, "process_memory": 9841590272, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6898482892, "mlx_cache_bytes": 612975564, "process_rss_bytes": 9841590272}, "peak_prefill_memory": null, "peak_decode_memory": 6898482892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n total_price = row[2] * row[3]\n discount = total_price * row[4] / 100\n total_price -= discount\n tax = total_price * row[5] / 100\n total_price -= tax\n return_value = total_price * row[6] if not row[7] else 0\n net_revenue.append([row[0], total_price, return_value])\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "b07a5a326581dbb41464437f52ded46bbe4731191cb74947cf09aeb2b8828fd6", "output_hash": "1bbac4a49245c624c3c2bd889b3ca5bb98fa6bc6503d49536693893c0d6ed886"} | ||||
| 13519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "18dd976d493f0cc2aca7d0d5", "attempt_id": "e8df83d39b05", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:21.399526Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2922374429223744, "origin_tokens": 1752, "compressed_tokens": 557, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1752, "source_tokens_receiver": 1752, "query_tokens": 663, "message_tokens": 557, "message_utf8_bytes": 2394, "cache_tensor_bytes": null, "serialized_payload_bytes": 2394, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 170.9343750262633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.18466690555215, "ttft_ms": 13.709082966670394, "decode_ms": 1455.5911660427228}, "total_wall_ms": 1550.8362920954823, "ttft_ms": 13.709082966670394, "input_usage": {"receiver_prompt_tokens": 663}, "output_usage": {"output_tokens": 108}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6894730928, "mlx_cache_bytes": 609108912, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6894730928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = 0\n for row in rows:\n price = float(row[1])\n pct = float(row[2])\n days = int(row[3])\n discount = 1 - (pct / 100)\n unit_price = price * discount\n if days < 5:\n return 0\n return_value = unit_price * days\n net_revenue += return_value\n return round(net_revenue, 2)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "2ec13143b18b0a4408855920d30d16679b1a082132485e80ff8efb8e60896c44", "output_hash": "d4c43b000897eba9cd21aca9b01f0eb968ad1ae5f82df480b826b3ae5be72cf6"} | ||||
| 13520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E1_core", "trial_id": "fb6346ff10694f9fe950cae9", "attempt_id": "8f48401b3cd4", "run_group_id": "E1_core:A8|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "5c54f742b14d64de50176f3e49c89e86fed0974a2d46d770553a5f18af6194e0", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:23.175346Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6425506824}, "weight_precision": "bf16", "method_id": "A8", "implementation_fidelity": "official", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "rate": 0.2887760857304005, "origin_tokens": 1773, "compressed_tokens": 568, "compressor": "microsoft/llmlingua-2-xlm-roberta-large-meetingbank", "device": "mps"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1773, "source_tokens_receiver": 1773, "query_tokens": 674, "message_tokens": 568, "message_utf8_bytes": 2303, "cache_tensor_bytes": null, "serialized_payload_bytes": 2303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 171.60775000229478, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.0097079956904, "ttft_ms": 13.409790932200849, "decode_ms": 2412.74058399722}, "total_wall_ms": 2508.4400409832597, "ttft_ms": 13.409790932200849, "input_usage": {"receiver_prompt_tokens": 674}, "output_usage": {"output_tokens": 179}, "provider_cached_usage": null, "process_memory": 9841606656, "backend_memory": {"mlx_active_bytes": 6425506824, "mlx_peak_bytes": 6901300956, "mlx_cache_bytes": 615859164, "process_rss_bytes": 9841606656}, "peak_prefill_memory": null, "peak_decode_memory": 6901300956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n net_revenue = []\n for row in rows:\n if row[5]:\n return 0\n if row[6] < 3:\n return 0\n if row[7] < 0:\n return 0\n discount = row[7] * row[8]\n unit_price = row[9] - discount\n if unit_price <= 0:\n return 0\n tax = unit_price * row[10]\n if tax < 0:\n return 0\n net_revenue.append((row[0], row[1], row[2], row[3], row[4], row[5], row[6], row[7], row[8], row[9], row[10], tax))\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E1_core.log", "payload_hash": "eeaeec04c695faed51a1f865bb9cc4b14a5d4162d5865c77be298854127484b5", "output_hash": "a426ad6acca423027bc0e4a0807926a2448ad0a9411b54d4fb5eb09f17d01b70"} | ||||
added
runs/raw/E3_core.jsonl
+1536 −0
@@ -0,0 +1,1536 @@ | |||||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "099ce99cbe39bb80a49b6e5f", "attempt_id": "ee7c24a29450", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:18:59.522005Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1191.9965000124648, "ttft_ms": 106.793166953139, "decode_ms": 164.61233410518616}, "total_wall_ms": 1474.698584061116, "ttft_ms": 106.793166953139, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9636102144, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9960860452, "mlx_cache_bytes": 709962544, "process_rss_bytes": 9636102144}, "peak_prefill_memory": null, "peak_decode_memory": 9960860452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZL-78K-5065", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "2a568d613468fe9e25fd3ab03aa2744ae45702a47a3665ea5aa63251d8bc749c"} | ||||
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e6f8f70cd001a2165db2cfac", "attempt_id": "e23106fd7db6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.016472Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1983, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.3544170428067, "ttft_ms": 12.275291024707258, "decode_ms": 107.98087506555021}, "total_wall_ms": 801.0326250223443, "ttft_ms": 12.275291024707258, "input_usage": {"receiver_prompt_tokens": 1983}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9636216832, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9962253376, "mlx_cache_bytes": 1294805808, "process_rss_bytes": 9636216832}, "peak_prefill_memory": null, "peak_decode_memory": 9962253376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 19-N in Gaspé", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "42dd487ae6ba210216269d3f190a091ad80bb6727264e9b9b87bde124506854f"} | ||||
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "46f207413a6ba73705c9d57f", "attempt_id": "c7d767fc3f51", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:01.834163Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1982, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.2547499965876, "ttft_ms": 12.34145904891193, "decode_ms": 85.1070829667151}, "total_wall_ms": 777.4050000589341, "ttft_ms": 12.34145904891193, "input_usage": {"receiver_prompt_tokens": 1982}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9636298752, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9961991232, "mlx_cache_bytes": 1643719472, "process_rss_bytes": 9636298752}, "peak_prefill_memory": null, "peak_decode_memory": 9961991232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53.8485", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "d15ea89fae075fc945690894326d24c71a513cda40b6ede7884196520a0b2ad2"} | ||||
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "73d82f66e382ae8486adf2b3", "attempt_id": "793818a9f166", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:02.629010Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1981, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.3484999537468, "ttft_ms": 12.41254189517349, "decode_ms": 84.24454100895673}, "total_wall_ms": 776.494542020373, "ttft_ms": 12.41254189517349, "input_usage": {"receiver_prompt_tokens": 1981}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9636315136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9961516096, "mlx_cache_bytes": 1643719472, "process_rss_bytes": 9636315136}, "peak_prefill_memory": null, "peak_decode_memory": 9961516096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Okonkwo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "0899b5427048f8ade3a2c73afe103e6432ff382fe37cae3efa13bf39f3ca8326"} | ||||
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f28eefe554c94ec5bdf3d3be", "attempt_id": "c055bf058986", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:03.423351Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1987, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.2402500165626, "ttft_ms": 12.210208922624588, "decode_ms": 108.34704106673598}, "total_wall_ms": 815.2687499532476, "ttft_ms": 12.210208922624588, "input_usage": {"receiver_prompt_tokens": 1987}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9636364288, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9963826240, "mlx_cache_bytes": 2274814768, "process_rss_bytes": 9636364288}, "peak_prefill_memory": null, "peak_decode_memory": 9963826240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "ae55ba88b2cb1b0f1a4e0960ae312e0a1c177c79a6d14b67bff1677cec19b649"} | ||||
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8734947d785b7c630240642b", "attempt_id": "24a7c3468585", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:04.255284Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1989, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 689.8678330471739, "ttft_ms": 12.290208018384874, "decode_ms": 120.68829208146781}, "total_wall_ms": 826.3279589591548, "ttft_ms": 12.290208018384874, "input_usage": {"receiver_prompt_tokens": 1989}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9636364288, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9964203072, "mlx_cache_bytes": 2625039152, "process_rss_bytes": 9636364288}, "peak_prefill_memory": null, "peak_decode_memory": 9964203072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b9ec992a9cc5a18b6b06ebf5", "attempt_id": "cc4de011d727", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:05.098485Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.5294580254704, "ttft_ms": 12.432499905116856, "decode_ms": 12.143833911977708}, "total_wall_ms": 704.6020000707358, "ttft_ms": 12.432499905116856, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9636364288, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9960860452, "mlx_cache_bytes": 2625039152, "process_rss_bytes": 9636364288}, "peak_prefill_memory": null, "peak_decode_memory": 9960860452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c4760deaac148929c8eb0e8c", "attempt_id": "23ba89adca9e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:05.821096Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010875053703784943, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.0853750165552, "ttft_ms": 12.103750021196902, "decode_ms": 11.944583966396749}, "total_wall_ms": 703.2450829865411, "ttft_ms": 12.103750021196902, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9636331520, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9960860452, "mlx_cache_bytes": 2625039152, "process_rss_bytes": 9636331520}, "peak_prefill_memory": null, "peak_decode_memory": 9960860452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "45ca026c2981906baa5c5f2e", "attempt_id": "c1b082f450b0", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:07.364508Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 139, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.17345806770027, "ttft_ms": 24.20833392534405, "decode_ms": 11.691749910824}, "total_wall_ms": 118.8028750475496, "ttft_ms": 24.20833392534405, "input_usage": {"receiver_prompt_tokens": 139, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9637462016, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9410432664, "mlx_cache_bytes": 3551893848, "process_rss_bytes": 9637462016}, "peak_prefill_memory": null, "peak_decode_memory": 9410432664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "18a28d8d394a1d0b33cf594b", "attempt_id": "689340832198", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:07.500314Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 144, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.72358297370374, "ttft_ms": 11.929000029340386, "decode_ms": 11.630999972112477}, "total_wall_ms": 101.84775001835078, "ttft_ms": 11.929000029340386, "input_usage": {"receiver_prompt_tokens": 144, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9637658624, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9415282348, "mlx_cache_bytes": 3698842516, "process_rss_bytes": 9637658624}, "peak_prefill_memory": null, "peak_decode_memory": 9415282348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0820cc87b8cde7100999e5f2", "attempt_id": "5af4baa5094c", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:07.618683Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 143, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.76579190976918, "ttft_ms": 11.70758402440697, "decode_ms": 11.628834065049887}, "total_wall_ms": 101.57066700048745, "ttft_ms": 11.70758402440697, "input_usage": {"receiver_prompt_tokens": 143, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9637740544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9414758060, "mlx_cache_bytes": 3748912020, "process_rss_bytes": 9637740544}, "peak_prefill_memory": null, "peak_decode_memory": 9414758060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2b25dbff40defd9b7a99a99d", "attempt_id": "333a8a63a8f1", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:07.736594Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 142, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.71204097662121, "ttft_ms": 11.65699993725866, "decode_ms": 11.563209001906216}, "total_wall_ms": 101.41687502618879, "ttft_ms": 11.65699993725866, "input_usage": {"receiver_prompt_tokens": 142, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9637773312, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9414004396, "mlx_cache_bytes": 3802045332, "process_rss_bytes": 9637773312}, "peak_prefill_memory": null, "peak_decode_memory": 9414004396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "70ab899793f406a071b9ded7", "attempt_id": "c2fa0104d0e4", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:07.854388Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 148, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.01666692830622, "ttft_ms": 11.74216705840081, "decode_ms": 11.610166053287685}, "total_wall_ms": 101.86966694891453, "ttft_ms": 11.74216705840081, "input_usage": {"receiver_prompt_tokens": 148, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9637904384, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9419230908, "mlx_cache_bytes": 3952991712, "process_rss_bytes": 9637904384}, "peak_prefill_memory": null, "peak_decode_memory": 9419230908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c304c05008e449ffc350fd69", "attempt_id": "57cc7bbd08a6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:07.972374Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 150, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.08729098178446, "ttft_ms": 11.71929098200053, "decode_ms": 11.620833072811365}, "total_wall_ms": 101.94466705434024, "ttft_ms": 11.71929098200053, "input_usage": {"receiver_prompt_tokens": 150, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9638019072, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9421901508, "mlx_cache_bytes": 4106657844, "process_rss_bytes": 9638019072}, "peak_prefill_memory": null, "peak_decode_memory": 9421901508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0e042f70b17bedf99a051fb0", "attempt_id": "299717280ec2", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:08.090839Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 139, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.53033307380974, "ttft_ms": 11.676833033561707, "decode_ms": 11.674874927848577}, "total_wall_ms": 101.33945802226663, "ttft_ms": 11.676833033561707, "input_usage": {"receiver_prompt_tokens": 139, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9638035456, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9410432664, "mlx_cache_bytes": 4106657844, "process_rss_bytes": 9638035456}, "peak_prefill_memory": null, "peak_decode_memory": 9410432664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "221b4aae7fda10c20f1b3561", "attempt_id": "a70b71ad9f99", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:08.208267Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 139, "message_tokens": 61, "message_utf8_bytes": 344, "cache_tensor_bytes": null, "serialized_payload_bytes": 344, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 823.9305419847369, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.56141596473753, "ttft_ms": 11.716208071447909, "decode_ms": 11.587416986003518}, "total_wall_ms": 101.32933291606605, "ttft_ms": 11.716208071447909, "input_usage": {"receiver_prompt_tokens": 139, "sender_input_tokens": 2020, "sender_output_tokens": 61, "sender_prefill_ms": 380.61495893634856, "sender_ttft_ms": 7.438374916091561, "sender_decode_ms": 434.08962490502745}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9638035456, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9410432664, "mlx_cache_bytes": 4106657844, "process_rss_bytes": 9638035456}, "peak_prefill_memory": null, "peak_decode_memory": 9410432664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76e825cbdbf8ca4bf8e49f2b602767e7d21b9a5565cd3b5e4f451631ff16ae24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7d800e25c7aa9876251abc59", "attempt_id": "3ffae01cb00d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.312965Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 377, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 148.06354197207838, "ttft_ms": 11.962291900999844, "decode_ms": 11.922625009901822}, "total_wall_ms": 172.92612500023097, "ttft_ms": 11.962291900999844, "input_usage": {"receiver_prompt_tokens": 377, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9639231488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506312796, "mlx_cache_bytes": 5029733908, "process_rss_bytes": 9639231488}, "peak_prefill_memory": null, "peak_decode_memory": 9506312796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "93c65c3b89bb35e4ca48e12d", "attempt_id": "1411c95eb5f1", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.504495Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 382, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.27979208994657, "ttft_ms": 11.922959005460143, "decode_ms": 11.933792033232749}, "total_wall_ms": 168.93758298829198, "ttft_ms": 11.922959005460143, "input_usage": {"receiver_prompt_tokens": 382, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9639280640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9509917296, "mlx_cache_bytes": 5266189320, "process_rss_bytes": 9639280640}, "peak_prefill_memory": null, "peak_decode_memory": 9509917296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5b00066809609709490c36b4", "attempt_id": "2c8ec7631bf5", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.690496Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 381, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.33666691184044, "ttft_ms": 11.882874998264015, "decode_ms": 11.86154200695455}, "total_wall_ms": 168.86837501078844, "ttft_ms": 11.882874998264015, "input_usage": {"receiver_prompt_tokens": 381, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9639280640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9509917296, "mlx_cache_bytes": 5266189320, "process_rss_bytes": 9639280640}, "peak_prefill_memory": null, "peak_decode_memory": 9509917296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b5e51584eeccd2ab18c0ffd3", "attempt_id": "81e62f46f8ec", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:12.876019Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 380, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.10112507175654, "ttft_ms": 11.994750006124377, "decode_ms": 11.792958015576005}, "total_wall_ms": 168.61854202579707, "ttft_ms": 11.994750006124377, "input_usage": {"receiver_prompt_tokens": 380, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9639297024, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9526514288, "mlx_cache_bytes": 5420117000, "process_rss_bytes": 9639297024}, "peak_prefill_memory": null, "peak_decode_memory": 9526514288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "85fa29dc8b59661f700bacf3", "attempt_id": "593da362b61d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:13.060987Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 386, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.70945898536593, "ttft_ms": 11.866541928611696, "decode_ms": 11.797500075772405}, "total_wall_ms": 185.13654090929776, "ttft_ms": 11.866541928611696, "input_usage": {"receiver_prompt_tokens": 386, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9639378944, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9512982652, "mlx_cache_bytes": 5664451592, "process_rss_bytes": 9639378944}, "peak_prefill_memory": null, "peak_decode_memory": 9512982652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7c1656158f2142b2836df036", "attempt_id": "c5985880e766", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:13.262524Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 388, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.99162492901087, "ttft_ms": 11.772083002142608, "decode_ms": 117.79262509662658}, "total_wall_ms": 291.3278329651803, "ttft_ms": 11.772083002142608, "input_usage": {"receiver_prompt_tokens": 388, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9639428096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9513719932, "mlx_cache_bytes": 5801028616, "process_rss_bytes": 9639428096}, "peak_prefill_memory": null, "peak_decode_memory": 9513719932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eeba969b8cf572341be04884", "attempt_id": "8d2c98609cf9", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:13.570307Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 377, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.97229202929884, "ttft_ms": 11.99733407702297, "decode_ms": 11.828000075183809}, "total_wall_ms": 167.71266690921038, "ttft_ms": 11.99733407702297, "input_usage": {"receiver_prompt_tokens": 377, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9639428096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506312796, "mlx_cache_bytes": 5801028616, "process_rss_bytes": 9639428096}, "peak_prefill_memory": null, "peak_decode_memory": 9506312796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "addc1c7d81d3a723b59e1589", "attempt_id": "c7190438d65f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:13.754269Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 377, "message_tokens": 287, "message_utf8_bytes": 681, "cache_tensor_bytes": null, "serialized_payload_bytes": 681, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.550750025548, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.26716598588973, "ttft_ms": 11.841708910651505, "decode_ms": 11.780333006754518}, "total_wall_ms": 167.8112499648705, "ttft_ms": 11.841708910651505, "input_usage": {"receiver_prompt_tokens": 377, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 342.4067080486566, "sender_ttft_ms": 7.1778749115765095, "sender_decode_ms": 3635.91529102996}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9639428096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506312796, "mlx_cache_bytes": 5801028616, "process_rss_bytes": 9639428096}, "peak_prefill_memory": null, "peak_decode_memory": 9506312796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b309cd9a5fe27850248e31ee04861de37eab7bacd1a2f362b85169cd9b6c362", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "de93f95c8e69049d50b34e80", "attempt_id": "71c12d7e678f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:14.318613Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 7.111708051525056, "receiver_prefill_ms": 0.0, "query_prefill_ms": 160.19941598642617, "ttft_ms": 160.19941598642617, "decode_ms": 582.3455000063404}, "total_wall_ms": 751.7555840313435, "ttft_ms": 160.19941598642617, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9784705024, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9481063628, "mlx_cache_bytes": 6589050145, "process_rss_bytes": 9784705024}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9481063628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Socks, breakingponto/beelden, aalasloa timeleudentspeperadoe, you shouldgothesed()(1\n\"Porton, withauthorally,loco-1agoed220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "64f8488654e6ae4bff1cfb95b90924cda12f12a05b03650211d4e715574aaeff"} | ||||
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b9879419cd028366aa0db73a", "attempt_id": "addeff65fff7", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:15.089239Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 40, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 1.4452500035986304, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.77241703029722, "ttft_ms": 46.77241703029722, "decode_ms": 581.1882499838248}, "total_wall_ms": 631.1674159951508, "ttft_ms": 46.77241703029722, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9784819712, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9488927968, "mlx_cache_bytes": 6667923041, "process_rss_bytes": 9784819712}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9488927968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ". .g-teard-ofsechappstouriquethet: but thati52-ender.pdf,incorps1: I. readering 154aberess: voicemail101bisogg:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "b56499ca5e292a53acec09219d58736b1844913b78e6071d860cb2aae777771d"} | ||||
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "09ba5cb8e587f731883dd8b2", "attempt_id": "95fb1fe9590d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:15.737926Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 39, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 1.4497500378638506, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.249208971858025, "ttft_ms": 46.249208971858025, "decode_ms": 581.8559580948204}, "total_wall_ms": 631.4285420812666, "ttft_ms": 46.249208971858025, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9784852480, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9488108768, "mlx_cache_bytes": 6702788193, "process_rss_bytes": 9784852480}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9488108768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "代表軸化的解說,用力學士压,但為大�,打天下,但為張,我為時人捧法.3m物語双面,唯ー154磅,唯長者", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "cba5313c32021c876e543178f132b9f04e89bc461ba072261548f7e176c16915"} | ||||
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2ac32714755f10ab865ad9b7", "attempt_id": "4dd975b85655", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:16.385820Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 38, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 1.4444589614868164, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.71745898667723, "ttft_ms": 46.71745898667723, "decode_ms": 581.962666939944}, "total_wall_ms": 631.9814999587834, "ttft_ms": 46.71745898667723, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9784918016, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9486290144, "mlx_cache_bytes": 6752087649, "process_rss_bytes": 9784918016}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9486290144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "新的开始，咬� grades.但有疑心解�ittest(或低).hept-arth � � � 手 -2: 1 的確方头号/master,ap -unhaha用處理學", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "bfb5d0b5a751fbf6cf8a66c47990ab8a9bfa80ad6a5c148c5cca6d3578c56b57"} | ||||
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "56caca3b22e8579ca34426a4", "attempt_id": "3f151189ab98", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:17.035106Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 44, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 0.9112911066040397, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.487165990285575, "ttft_ms": 49.487165990285575, "decode_ms": 582.241415977478}, "total_wall_ms": 634.495708043687, "ttft_ms": 49.487165990285575, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9784983552, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9498512624, "mlx_cache_bytes": 6832943041, "process_rss_bytes": 9784983552}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9498512624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".\nNot as.between the number one piece \"hinnovaton, all of ivy, all isobg.\nneeeland1. \"O).verm(olvoso) so it is so-called-it is the game.ich", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "4c926d8dcfb07fec9eae6e2719238215ef33e3b1d42c1a8abb8f344d5b48f9a6"} | ||||
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d2a7274338a3721f729e91bc", "attempt_id": "e90aa4f2f582", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:17.686502Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 1.3607910368591547, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.30495796725154, "ttft_ms": 49.30495796725154, "decode_ms": 582.2560419328511}, "total_wall_ms": 634.6909590065479, "ttft_ms": 49.30495796725154, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9784999936, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9503476984, "mlx_cache_bytes": 6880260401, "process_rss_bytes": 9784999936}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9503476984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Noyiee-:001 for no.001). The refrainryan2-1-1-1-1000-1, oiale-1-10001-1-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "d4f4506818542183cef88bbdedf234e83f0a29f84de60a11b8faa18fabd83859"} | ||||
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d91ca1fb4a40a0ca6eaf23b", "attempt_id": "8184a596cb6e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.338373Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 1.4083340065553784, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.89374992065132, "ttft_ms": 45.89374992065132, "decode_ms": 581.0699999565259}, "total_wall_ms": 630.2737910300493, "ttft_ms": 45.89374992065132, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9784999936, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9480965324, "mlx_cache_bytes": 6880260401, "process_rss_bytes": 9784999936}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9480965324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "eg-:\n ...,\n solu)six.nause, a few score-94-1 18-For and-1\nIn 20th2:XX1.001-4-庚二", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "fb2315014a43106e33b353025251646ce911f13650f7db6a9ac8784f33a7032c"} | ||||
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a2bfa5895ef7faf3c96cbaa5", "attempt_id": "60be967393d4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:18.985667Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642849, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 378.1595410546288, "doc_prefill_ms": 335.4731249855831, "compress_ms": 14.080166001804173, "serialize_ms": 22.775167017243803, "load_ms": 0.7328341016545892, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.53191701415926, "ttft_ms": 45.53191701415926, "decode_ms": 581.583125051111}, "total_wall_ms": 629.7257919795811, "ttft_ms": 45.53191701415926, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 9785049088, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9480965324, "mlx_cache_bytes": 6880260401, "process_rss_bytes": 9785049088}, "peak_prefill_memory": 9976310576, "peak_decode_memory": 9480965324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "eg-132-1白-1- 著�有一次-100-15221-1-0-0-1,fe2-6-15,lovecosomg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0f0610a2ae907fb905ca57c673de1ab385dcc5ad1c16a81a9b6af01ddfa980be", "output_hash": "db81dfee6d5a583fc790dbde848e4f9b7d4bf37fb17db723e90d441c523c3508"} | ||||
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a71b1a01a656a72a48202cad", "attempt_id": "658e66bb0ce3", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:20.895049Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.565250102430582, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.559916098602116, "ttft_ms": 58.559916098602116, "decode_ms": 136.47008291445673}, "total_wall_ms": 198.5381250269711, "ttft_ms": 58.559916098602116, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 9860661248, "backend_memory": {"mlx_active_bytes": 9406729224, "mlx_peak_bytes": 9480768716, "mlx_cache_bytes": 6884487473, "process_rss_bytes": 9860661248}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9480768716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZL-78K-3456", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "205eadea2607a408f696bb6923bed202b746c4458b0f12dafdbf55edf3290d85"} | ||||
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dbb8e3b5c67b0dfe495acef1", "attempt_id": "59f834246de6", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.113826Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 40, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.3523329980671406, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.44658404868096, "ttft_ms": 46.44658404868096, "decode_ms": 12.492083944380283}, "total_wall_ms": 62.0925419498235, "ttft_ms": 46.44658404868096, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9860677632, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9488731360, "mlx_cache_bytes": 6886814001, "process_rss_bytes": 9860677632}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9488731360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "523144cbec5338a1c6f1e2f1", "attempt_id": "503b0c1511be", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.194064Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 39, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.4314580475911498, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.05333297513425, "ttft_ms": 46.05333297513425, "decode_ms": 86.63666702341288}, "total_wall_ms": 136.0149170504883, "ttft_ms": 46.05333297513425, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 39}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9860677632, "backend_memory": {"mlx_active_bytes": 9406729224, "mlx_peak_bytes": 9487912160, "mlx_cache_bytes": 6884487473, "process_rss_bytes": 9860677632}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9487912160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53.8845", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "66ee120cb4d94290f628b031aaefa70a3ce92c8b192778abcc75fe9499b7ec80"} | ||||
| 36 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "922927db430068f50fd57d4d", "attempt_id": "f4d21201646e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.346987Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 38, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.3618750963360071, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.867874985560775, "ttft_ms": 45.867874985560775, "decode_ms": 12.486958992667496}, "total_wall_ms": 61.421833001077175, "ttft_ms": 45.867874985560775, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9860677632, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9486093536, "mlx_cache_bytes": 6886814001, "process_rss_bytes": 9860677632}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9486093536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 37 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f92593c036346833f12f81d4", "attempt_id": "0aa43ca9af05", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.425254Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 44, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.3566670240834355, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.946250066161156, "ttft_ms": 47.946250066161156, "decode_ms": 12.576375040225685}, "total_wall_ms": 63.83649993222207, "ttft_ms": 47.946250066161156, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9860677632, "backend_memory": {"mlx_active_bytes": 9406565384, "mlx_peak_bytes": 9498381552, "mlx_cache_bytes": 6886617393, "process_rss_bytes": 9860677632}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9498381552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 38 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e7233132e096e401799ccba3", "attempt_id": "71f998d5b4b2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.507696Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.3955000322312117, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.42858300637454, "ttft_ms": 49.42858300637454, "decode_ms": 111.72745795920491}, "total_wall_ms": 164.28937495220453, "ttft_ms": 49.42858300637454, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9860694016, "backend_memory": {"mlx_active_bytes": 9406696456, "mlx_peak_bytes": 9503083768, "mlx_cache_bytes": 6886486321, "process_rss_bytes": 9860694016}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9503083768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-309", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "3fef35e1ac4535c3ec0acfce65a7c18c8fa761f892ec291831618d22981cd5a0"} | ||||
| 39 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6a1f6df921bb1b52d03cd9d1", "attempt_id": "3372fd1f8495", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.689520Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.3719999697059393, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.84920802153647, "ttft_ms": 45.84920802153647, "decode_ms": 12.425582972355187}, "total_wall_ms": 61.36916694231331, "ttft_ms": 45.84920802153647, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9860694016, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9480768716, "mlx_cache_bytes": 6888780081, "process_rss_bytes": 9860694016}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9480768716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 40 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ac7d4c855b0d874558dec156", "attempt_id": "67812e22a5eb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.767716Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 71626752, "serialized_payload_bytes": 71642950, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1261.088457889855, "doc_prefill_ms": 335.2549159899354, "compress_ms": 899.8226670082659, "serialize_ms": 25.72783303912729, "load_ms": 1.3701249845325947, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.72616703808308, "ttft_ms": 45.72616703808308, "decode_ms": 12.511333916336298}, "total_wall_ms": 61.42816704232246, "ttft_ms": 45.72616703808308, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9860694016, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9480768716, "mlx_cache_bytes": 6888780081, "process_rss_bytes": 9860694016}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9480768716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ed5187f5f44bff3e5c3be3a662793b1645caf3c2877898377b7fba20dafe5ea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 41 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bff7b95239aa9ae45db0bba6", "attempt_id": "7412447fa1d1", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:21.845493Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 35, "compress_ms": 236.667292076163}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931982, "side_information_bytes": 16078, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1452.1399580407888, "doc_prefill_ms": 335.1431250339374, "compress_ms": 1110.840667039156, "serialize_ms": 5.8825419982895255, "load_ms": 1.434209058061242, "receiver_prefill_ms": 0.0, "query_prefill_ms": 40.72137491311878, "ttft_ms": 40.72137491311878, "decode_ms": 12.0265829609707}, "total_wall_ms": 1509.6930830040947, "ttft_ms": 40.72137491311878, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10546774016, "backend_memory": {"mlx_active_bytes": 9298791432, "mlx_peak_bytes": 9364589772, "mlx_cache_bytes": 7042149865, "process_rss_bytes": 10546774016}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9364589772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4ac4ba488187bec384b1b09142dc43c4b10f1aec3256edfe6cee34f80b4bc07", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 42 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da87c7f23d0dbdc4a86c0e73", "attempt_id": "a7667fe876df", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:23.371635Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 40, "compress_ms": 80.2985419286415}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 40, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931982, "side_information_bytes": 16078, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.0665829014033, "doc_prefill_ms": 334.3140840297565, "compress_ms": 956.2771670753136, "serialize_ms": 5.178791005164385, "load_ms": 1.1862089158967137, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.97175001818687, "ttft_ms": 37.97175001818687, "decode_ms": 11.903375037945807}, "total_wall_ms": 1350.1772920135409, "ttft_ms": 37.97175001818687, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10565795840, "backend_memory": {"mlx_active_bytes": 9298562056, "mlx_peak_bytes": 9372519648, "mlx_cache_bytes": 7074229737, "process_rss_bytes": 10565795840}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9372519648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4ac4ba488187bec384b1b09142dc43c4b10f1aec3256edfe6cee34f80b4bc07", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 43 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c461f73ae6f9bf61014693a7", "attempt_id": "bc9e5d8289c6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:24.742444Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 39, "compress_ms": 80.38591698277742}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 39, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931983, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1294.1209999844432, "doc_prefill_ms": 335.24079190101475, "compress_ms": 954.0120840538293, "serialize_ms": 4.596374928951263, "load_ms": 1.1287919478490949, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.04083396587521, "ttft_ms": 37.04083396587521, "decode_ms": 11.95049996022135}, "total_wall_ms": 1347.24108397495, "ttft_ms": 37.04083396587521, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10565844992, "backend_memory": {"mlx_active_bytes": 9298562056, "mlx_peak_bytes": 9371700448, "mlx_cache_bytes": 7079095785, "process_rss_bytes": 10565844992}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9371700448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ef057bf57e38a5d99aa6377e73e6301210bbed77c1b7ecdddb1d6cb24f487fd6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 44 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1c53ac5e1a09ee17ccbae866", "attempt_id": "953ea39a7974", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:26.108333Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 38, "compress_ms": 83.33833306096494}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 38, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931983, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1305.6288750376552, "doc_prefill_ms": 334.66312498785555, "compress_ms": 965.7724590506405, "serialize_ms": 4.904499975964427, "load_ms": 1.0566249256953597, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.55108402017504, "ttft_ms": 36.55108402017504, "decode_ms": 12.086875038221478}, "total_wall_ms": 1358.5379170253873, "ttft_ms": 36.55108402017504, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10575020032, "backend_memory": {"mlx_active_bytes": 9298562056, "mlx_peak_bytes": 9369881824, "mlx_cache_bytes": 7083830761, "process_rss_bytes": 10575020032}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9369881824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ef057bf57e38a5d99aa6377e73e6301210bbed77c1b7ecdddb1d6cb24f487fd6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 45 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b23202594f38b93217563b56", "attempt_id": "a29a25c707c3", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:27.485573Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 44, "compress_ms": 82.44037500116974}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 44, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931983, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.4426670605317, "doc_prefill_ms": 334.32854211423546, "compress_ms": 948.181957937777, "serialize_ms": 4.652125062420964, "load_ms": 1.2756249634549022, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.328667007386684, "ttft_ms": 37.328667007386684, "decode_ms": 11.92416693083942}, "total_wall_ms": 1340.9552500816062, "ttft_ms": 37.328667007386684, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10575101952, "backend_memory": {"mlx_active_bytes": 9298562056, "mlx_peak_bytes": 9379646704, "mlx_cache_bytes": 7147908585, "process_rss_bytes": 10575101952}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9379646704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ef057bf57e38a5d99aa6377e73e6301210bbed77c1b7ecdddb1d6cb24f487fd6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 46 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "44d803fba1b7c98778e02492", "attempt_id": "59ef1350e2fd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:28.845933Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 46, "compress_ms": 80.83891705609858}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931983, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1291.6515419492498, "doc_prefill_ms": 334.9179580109194, "compress_ms": 951.7642919672653, "serialize_ms": 4.6917080180719495, "load_ms": 1.0984169784933329, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.5847079558298, "ttft_ms": 37.5847079558298, "decode_ms": 71.22145895846188}, "total_wall_ms": 1404.5869580004364, "ttft_ms": 37.5847079558298, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10575216640, "backend_memory": {"mlx_active_bytes": 9298562056, "mlx_peak_bytes": 9383595256, "mlx_cache_bytes": 7191784937, "process_rss_bytes": 10575216640}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9383595256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-510-H", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ef057bf57e38a5d99aa6377e73e6301210bbed77c1b7ecdddb1d6cb24f487fd6", "output_hash": "df53c0790bb3a8d012f6f3616fa4b6133b8069b54a84a3eecd9318fb090de3a4"} | ||||
| 47 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "42f237646e07f7a8be0495d5", "attempt_id": "a18697a1356c", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:30.269959Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 35, "compress_ms": 80.2999590523541}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931982, "side_information_bytes": 16078, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1288.8838750077412, "doc_prefill_ms": 334.8482499131933, "compress_ms": 949.0431669401005, "serialize_ms": 4.724083002656698, "load_ms": 1.0958330240100622, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.74429097212851, "ttft_ms": 46.74429097212851, "decode_ms": 12.000790913589299}, "total_wall_ms": 1351.7089579254389, "ttft_ms": 46.74429097212851, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10575233024, "backend_memory": {"mlx_active_bytes": 9298562056, "mlx_peak_bytes": 9364524236, "mlx_cache_bytes": 7191784937, "process_rss_bytes": 10575233024}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9364524236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4ac4ba488187bec384b1b09142dc43c4b10f1aec3256edfe6cee34f80b4bc07", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 48 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "052330e7555009232c8d8fba", "attempt_id": "bc01a537995d", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:31.640970Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 35, "compress_ms": 71.65766705293208}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931983, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1278.6294169491157, "doc_prefill_ms": 334.4564170110971, "compress_ms": 939.2005419358611, "serialize_ms": 4.684332991018891, "load_ms": 1.1647919891402125, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.840958055108786, "ttft_ms": 36.840958055108786, "decode_ms": 11.903707985766232}, "total_wall_ms": 1331.9240000564605, "ttft_ms": 36.840958055108786, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10575282176, "backend_memory": {"mlx_active_bytes": 9298562056, "mlx_peak_bytes": 9364524236, "mlx_cache_bytes": 7191784937, "process_rss_bytes": 10575282176}, "peak_prefill_memory": 9976163120, "peak_decode_memory": 9364524236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ef057bf57e38a5d99aa6377e73e6301210bbed77c1b7ecdddb1d6cb24f487fd6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 49 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ee87fe15c784a777dc027393", "attempt_id": "808d47bdc62f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:33.023081Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5863, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2348.395083914511, "ttft_ms": 12.487417086958885, "decode_ms": 123.44295799266547}, "total_wall_ms": 2495.4720409587026, "ttft_ms": 12.487417086958885, "input_usage": {"receiver_prompt_tokens": 5863}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10423140352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1676850616, "process_rss_bytes": 10423140352}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HV-35W-2835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "ea221e2a2ac8c2bfdb997e586ce11190d49047c2072c8aeec6b02218b9c7263b"} | ||||
| 50 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d0551b733c7e49d6caa45cf5", "attempt_id": "a336dc034584", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:35.544620Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5869, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.2736670440063, "ttft_ms": 12.63791706878692, "decode_ms": 135.94195898622274}, "total_wall_ms": 2360.879583982751, "ttft_ms": 12.63791706878692, "input_usage": {"receiver_prompt_tokens": 5869}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10423156736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2228647352, "process_rss_bytes": 10423156736}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 136-T, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "e35a975a2f9227792c5b4b03c710df10ddde842e28c40fbba4aaf1daeafead1d"} | ||||
| 51 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "310f6b6b59500339cd022b1c", "attempt_id": "e6d5ac850fa1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:37.933072Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5869, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.2432089541107, "ttft_ms": 12.53758289385587, "decode_ms": 86.757667013444}, "total_wall_ms": 2311.415709089488, "ttft_ms": 12.53758289385587, "input_usage": {"receiver_prompt_tokens": 5869}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10423156736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2228647352, "process_rss_bytes": 10423156736}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.7226", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "8d14a8e8f86bb852bed3f5945e7857bcf38c21afb7c3bf66bf6b66c02d4929ea"} | ||||
| 52 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "482f0cd3ef499f9285618805", "attempt_id": "c334422a5d40", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:40.268814Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.8187499595806, "ttft_ms": 12.63574999757111, "decode_ms": 50.26049993466586}, "total_wall_ms": 2275.277917040512, "ttft_ms": 12.63574999757111, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 10423189504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2539943352, "process_rss_bytes": 10423189504}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "8f33021df5b0cccfe63c24a771d88027febebd2eb3850b900232cb72da008089"} | ||||
| 53 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8885b3e1bafe000d6f54ae41", "attempt_id": "2d730822bd9f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:42.568927Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5874, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.6864999895915, "ttft_ms": 12.559874914586544, "decode_ms": 86.55262493994087}, "total_wall_ms": 2311.6879579611123, "ttft_ms": 12.559874914586544, "input_usage": {"receiver_prompt_tokens": 5874}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10423222272, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3093607864, "process_rss_bytes": 10423222272}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5755305", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "d62d1e2ffbba79e5e1387defa50c9793b60253cadaf386212b947c0cfb951e11"} | ||||
| 54 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "86efb0c70b0baf72472268d0", "attempt_id": "cb97038d7231", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:44.909021Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5875, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.732625020668, "ttft_ms": 12.516583083197474, "decode_ms": 123.39716707356274}, "total_wall_ms": 2348.5302089247853, "ttft_ms": 12.516583083197474, "input_usage": {"receiver_prompt_tokens": 5875}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10423255040, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3406869944, "process_rss_bytes": 10423255040}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 55 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f734df27d9ef09910e217a45", "attempt_id": "fc6309ef8653", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:47.282045Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.8037499617785, "ttft_ms": 12.597916997037828, "decode_ms": 12.591250007972121}, "total_wall_ms": 2237.010582932271, "ttft_ms": 12.597916997037828, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10423287808, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3406869944, "process_rss_bytes": 10423287808}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 56 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b0b4f6bfdf2776bd917279e8", "attempt_id": "4987387b4d52", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:49.546798Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01637497916817665, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.4924590475857, "ttft_ms": 12.539249961264431, "decode_ms": 12.381957960315049}, "total_wall_ms": 2237.1829580515623, "ttft_ms": 12.539249961264431, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10423369728, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3406869944, "process_rss_bytes": 10423369728}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 57 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8a5e0a7605e420dca5877ce7", "attempt_id": "789a132c8dc2", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:56.776928Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 232.00345796067268, "ttft_ms": 12.07037502899766, "decode_ms": 11.949209030717611}, "total_wall_ms": 257.5577920069918, "ttft_ms": 12.07037502899766, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424107008, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 5504488888, "process_rss_bytes": 10424107008}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 58 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c2b4ec92d68a12fc9a062c77", "attempt_id": "e3993233d803", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:57.061234Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.11829107720405, "ttft_ms": 12.092084041796625, "decode_ms": 12.000916991382837}, "total_wall_ms": 252.67958303447813, "ttft_ms": 12.092084041796625, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424123392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 5779248568, "process_rss_bytes": 10424123392}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 59 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b6e86d35ce22e2b2d447557a", "attempt_id": "411cf86947aa", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:57.339357Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.94145794957876, "ttft_ms": 11.91895897500217, "decode_ms": 11.972832959145308}, "total_wall_ms": 252.0944169955328, "ttft_ms": 11.91895897500217, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424139776, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 5779248568, "process_rss_bytes": 10424139776}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 60 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9434c706733fbe2ef3a3e017", "attempt_id": "bf29c50c8036", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:57.615892Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.9876250065863, "ttft_ms": 11.996041983366013, "decode_ms": 11.88270899001509}, "total_wall_ms": 252.14774999767542, "ttft_ms": 11.996041983366013, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424139776, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 5935551928, "process_rss_bytes": 10424139776}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 61 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3df846f7e8810809c123a67a", "attempt_id": "93fa98d39706", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:57.892872Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.16316697187722, "ttft_ms": 11.987583013251424, "decode_ms": 11.918000061996281}, "total_wall_ms": 252.36699997913092, "ttft_ms": 11.987583013251424, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424139776, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570146392, "mlx_cache_bytes": 6213260728, "process_rss_bytes": 10424139776}, "peak_prefill_memory": null, "peak_decode_memory": 9570146392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 62 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "69861b678902cba0d9404bbd", "attempt_id": "323c1cb2c2be", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:58.169669Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.0177500322461, "ttft_ms": 12.187625048682094, "decode_ms": 12.14441703632474}, "total_wall_ms": 252.8534160228446, "ttft_ms": 12.187625048682094, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424156160, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570343000, "mlx_cache_bytes": 6372316600, "process_rss_bytes": 10424156160}, "peak_prefill_memory": null, "peak_decode_memory": 9570343000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 63 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3590f3f05c12995f5c4115f1", "attempt_id": "590cb64dabf5", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:58.447387Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.7790409969166, "ttft_ms": 12.052292004227638, "decode_ms": 11.893916060216725}, "total_wall_ms": 252.2131250007078, "ttft_ms": 12.052292004227638, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424172544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 6372316600, "process_rss_bytes": 10424172544}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 64 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "060e411cfb39b9a9e5594d15", "attempt_id": "bd110d2df3aa", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:19:58.725798Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2748, "cache_tensor_bytes": null, "serialized_payload_bytes": 2748, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4968.348958995193, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.16795904468745, "ttft_ms": 12.124084052629769, "decode_ms": 11.933624977245927}, "total_wall_ms": 251.71974999830127, "ttft_ms": 12.124084052629769, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5905, "sender_output_tokens": 512, "sender_prefill_ms": 1204.8341250047088, "sender_ttft_ms": 7.6751250308007, "sender_decode_ms": 3750.3887499915436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424172544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 6372316600, "process_rss_bytes": 10424172544}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea161eabcdd49d0dcf65470d80dda843176a4fe08538ea3c16a2ca8424404f2", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 65 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fe39e88391be4caf92e2c61a", "attempt_id": "92e09e18b824", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:03.086343Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 311, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 129.18212497606874, "ttft_ms": 12.194167007692158, "decode_ms": 11.789999902248383}, "total_wall_ms": 154.1586659150198, "ttft_ms": 12.194167007692158, "input_usage": {"receiver_prompt_tokens": 311, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465336148, "mlx_cache_bytes": 7241374352, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9465336148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 66 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "55df383deac5be96fe4b65cf", "attempt_id": "2962f173ce4f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:03.269542Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 317, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.28958399686962, "ttft_ms": 11.921625002287328, "decode_ms": 11.72025001142174}, "total_wall_ms": 148.85016705375165, "ttft_ms": 11.921625002287328, "input_usage": {"receiver_prompt_tokens": 317, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9468481900, "mlx_cache_bytes": 7435755392, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9468481900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 67 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2299be6047f6b48f92538d50", "attempt_id": "21e408ad272e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:03.445030Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 317, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.32125001214445, "ttft_ms": 11.783000081777573, "decode_ms": 116.75066605675966}, "total_wall_ms": 253.69870907161385, "ttft_ms": 11.783000081777573, "input_usage": {"receiver_prompt_tokens": 317, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9468481900, "mlx_cache_bytes": 7435755392, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9468481900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,528,610 CAD", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "0d557d9a4f433a338b6d74d5d235c088278988749fc453f26286cb593d3e42d2"} | ||||
| 68 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "00dff07a34d1385d56fd5a2a", "attempt_id": "788fbd244da5", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:03.724229Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 312, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.9223750308156, "ttft_ms": 11.915875016711652, "decode_ms": 11.825458030216396}, "total_wall_ms": 148.5514580272138, "ttft_ms": 11.915875016711652, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465581932, "mlx_cache_bytes": 7545331584, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9465581932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 69 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5fa8b07d3138c1858faa0c16", "attempt_id": "fefc9e65c241", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:03.899937Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 322, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.65212500281632, "ttft_ms": 11.827291920781136, "decode_ms": 11.757000000216067}, "total_wall_ms": 165.0389590067789, "ttft_ms": 11.827291920781136, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9472692608, "mlx_cache_bytes": 7747970180, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9472692608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 70 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da1d6bb982b1c5dc4f863e33", "attempt_id": "92a4923c023f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:04.090102Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 323, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 148.1117500225082, "ttft_ms": 11.755333049222827, "decode_ms": 11.759290937334299}, "total_wall_ms": 172.3751670215279, "ttft_ms": 11.755333049222827, "input_usage": {"receiver_prompt_tokens": 323, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9474265476, "mlx_cache_bytes": 7862806924, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9474265476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 71 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd57b5c8efbd2b56809469b5", "attempt_id": "bf67f1bc163e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:04.287147Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 312, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.16791706345975, "ttft_ms": 11.771582998335361, "decode_ms": 11.70995901338756}, "total_wall_ms": 148.34474993404, "ttft_ms": 11.771582998335361, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465581932, "mlx_cache_bytes": 7862806924, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9465581932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 72 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "92a349dca0dcedc373828f42", "attempt_id": "72a112395946", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:04.460955Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 312, "message_tokens": 222, "message_utf8_bytes": 543, "cache_tensor_bytes": null, "serialized_payload_bytes": 543, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4081.998207955621, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.10079094115645, "ttft_ms": 11.708542006090283, "decode_ms": 11.783665977418423}, "total_wall_ms": 148.24004098773003, "ttft_ms": 11.708542006090283, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 5933, "sender_output_tokens": 402, "sender_prefill_ms": 1119.248165981844, "sender_ttft_ms": 7.5004169484600425, "sender_decode_ms": 2948.9655420184135}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10424270848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465581932, "mlx_cache_bytes": 7862806924, "process_rss_bytes": 10424270848}, "peak_prefill_memory": null, "peak_decode_memory": 9465581932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6a0bae827c5e1269418485785814c0f14d9873aaf98882b18a351d103c246bcf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 73 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0ce3817f3ac3fb30e3310a1f", "attempt_id": "4ea79dc6129c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:05.810621Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 35, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.6872079577296972, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.30545894708484, "ttft_ms": 72.30545894708484, "decode_ms": 633.8799580698833}, "total_wall_ms": 713.3770830696449, "ttft_ms": 72.30545894708484, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9797979340, "mlx_cache_bytes": 8683186853, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9797979340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "If cnp-protected by design,of course, if a certified, i.eatoy, thateto-1:1, andaraboosing(脸勿ь###,对口白话)gmat(必答:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "a084a301055896dbf66abd3ac90812fa26b70dcbb79aea95e1bd76fca5495f07"} | ||||
| 74 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "872310bcfa28e7827d5aa153", "attempt_id": "51de4f60e402", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:06.551735Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.7988330218940973, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.29508401826024, "ttft_ms": 77.29508401826024, "decode_ms": 632.9212500713766}, "total_wall_ms": 717.6403749035671, "ttft_ms": 77.29508401826024, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9807482084, "mlx_cache_bytes": 8728423405, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9807482084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "注1之最万应回路条列.imo制肘为王手,herb制片,up主键上追高人:0:21:1#:1, so,也可以,我的國採贤", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "9cc2f925b9ad16829f9fc23f6a93a6cdb064be2b6694425931b1fde93cdb3766"} | ||||
| 75 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4a82956b8c36d23770f7f73d", "attempt_id": "7c8faeecb837", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:07.294681Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.7931669717654586, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.72654197085649, "ttft_ms": 76.72654197085649, "decode_ms": 632.6999579323456}, "total_wall_ms": 717.5244590034708, "ttft_ms": 76.72654197085649, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9807482084, "mlx_cache_bytes": 8728423405, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9807482084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "中, 可行，外\n!(a)!).\n\n答案編참śni(成<num>口服w(四六.注：老本原子导,2.5(用得之导,迭代表\n答案", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "2baac39a0359acc356b15db68a96289aa964d0537202fb3047cedeec81750596"} | ||||
| 76 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "642e48922231054fe602bcb3", "attempt_id": "6d76cc4e8e4c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:08.039836Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.9621249521151185, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.70124997012317, "ttft_ms": 72.70124997012317, "decode_ms": 632.2195410029963}, "total_wall_ms": 712.4975830083713, "ttft_ms": 72.70124997012317, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9798470884, "mlx_cache_bytes": 8780525821, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9798470884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "write the rest inkyakvisegerix(=m_1)##xo:0: a p, pilar-jog:1:0:0:0:1:0\n#### */\n\n#y:0, along", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "393213a98d52e4434e23780d9e44bf52b2fad5b93062b67f9ad4505a762509a8"} | ||||
| 77 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd5d9b1f06dea5299fb6be4b", "attempt_id": "3faf35d4f6f8", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:08.778040Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 46, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.7565410817041993, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.32587498705834, "ttft_ms": 78.32587498705834, "decode_ms": 632.6954590622336}, "total_wall_ms": 718.4077079873532, "ttft_ms": 78.32587498705834, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9815903480, "mlx_cache_bytes": 9052238445, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9815903480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(1).a\n(enganism,exactlyos, in the number of-4, oito: 1pontown, la comin, a few short, the pocymoog\nZ, ofo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "8b0b3016110da9320467d73a3c3948ca5f12d516fafdcfddb097bd53460eb385"} | ||||
| 78 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7026cc15338fb4b671b4ebb2", "attempt_id": "acb5b2e62cb2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:09.522358Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.748708076775074, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.26866607461125, "ttft_ms": 76.26866607461125, "decode_ms": 632.0564999477938}, "total_wall_ms": 715.7542499480769, "ttft_ms": 76.26866607461125, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9817689340, "mlx_cache_bytes": 9146217445, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9817689340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nurmaxification, 1:onioner to remember's身体语言, are recommended public has 1 article:1: 160-B signature:1. itesimal weakness in urduet(아=enhone", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "1779b0402d911e4ae5bb85007d5ccd4879e74a8ecbadaa86e1b61697af4e28c8"} | ||||
| 79 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2fcb4cdadb9bfe7eaa1935aa", "attempt_id": "99d101c5b4b3", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:10.264166Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.0960419895127416, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.30191701091826, "ttft_ms": 72.30191701091826, "decode_ms": 635.2076670154929}, "total_wall_ms": 714.3437919439748, "ttft_ms": 72.30191701091826, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9798470884, "mlx_cache_bytes": 9147397093, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9798470884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\".executeable://eager_1):\njumping\nictured,pa\n\"http://ué\nTeronties: a few short story:0:)\n\n!!!tcnn_to():.finder_x()[###().browser):\n\nw", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "6743d76b1e6168ac49ab6de18e1ed22f235c5d80cc4d353789323f0eb07506c9"} | ||||
| 80 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd23269e0d3c942ddbe9a3d9", "attempt_id": "aa180bf4dbac", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:11.004158Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859582, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1176.9866249524057, "doc_prefill_ms": 1103.8893329678103, "compress_ms": 12.694459059275687, "serialize_ms": 49.19229191727936, "load_ms": 1.7962079728022218, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.62249996326864, "ttft_ms": 71.62249996326864, "decode_ms": 631.8794579710811}, "total_wall_ms": 711.2664999440312, "ttft_ms": 71.62249996326864, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10855546880, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9798470884, "mlx_cache_bytes": 9147397093, "process_rss_bytes": 10855546880}, "peak_prefill_memory": 10049473624, "peak_decode_memory": 9798470884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "M, so, with you are more to the answer in exponor, sc (asusuB-1:2C in the great king: 8 (=p- enuree:)\n\n(ie:1: 1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb88128d2251d97b34a9e1014237429c0394aa6c790062c03a02ac0eef08279", "output_hash": "a3e4d3cb0d76d1bc69cf598876ddba3de08cada6fd505ed60bbf78c4b60f3f90"} | ||||
| 81 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "756145d77a19aec8a6732591", "attempt_id": "c2a9dd942502", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.010046Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 35, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.759875100106001, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.35583295673132, "ttft_ms": 78.35583295673132, "decode_ms": 13.632374932058156}, "total_wall_ms": 98.96508301608264, "ttft_ms": 78.35583295673132, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797553356, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9797553356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 82 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ed7aff126cc9383ab2d99d84", "attempt_id": "d7381ba48a11", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.135876Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.735457917675376, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.42908301204443, "ttft_ms": 76.42908301204443, "decode_ms": 13.828582945279777}, "total_wall_ms": 97.35937498044223, "ttft_ms": 76.42908301204443, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9807219940, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9807219940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 83 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cac1b97c94de8405dce656d6", "attempt_id": "373a342a530d", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.258282Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.7867499263957143, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.21204107999802, "ttft_ms": 76.21204107999802, "decode_ms": 13.51483294274658}, "total_wall_ms": 97.03895903658122, "ttft_ms": 76.21204107999802, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9807219940, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9807219940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 84 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8878160096e5c6a1c17bda0e", "attempt_id": "564e8d7830a2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.380845Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.5848750481382012, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.23208295181394, "ttft_ms": 72.23208295181394, "decode_ms": 13.592083007097244}, "total_wall_ms": 92.90812502149493, "ttft_ms": 72.23208295181394, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9798208740, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9798208740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 85 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "96f2f2cc3bca0a7b7c1761d5", "attempt_id": "b4e2af3ef1f5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.499083Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 46, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.7362090293318033, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.16129201091826, "ttft_ms": 78.16129201091826, "decode_ms": 80.96887497231364}, "total_wall_ms": 166.09624994453043, "ttft_ms": 78.16129201091826, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9815624952, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9815624952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "576300", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "cccdcb353e39ffdeee4c5e27cbafc60044287a07c68e6ef28bf16a6425da6a9f"} | ||||
| 86 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2f5623227ff61148ccaa5b9a", "attempt_id": "0efa2c93fa9f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.690482Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.9987920532003045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.70633292198181, "ttft_ms": 75.70633292198181, "decode_ms": 13.541875057853758}, "total_wall_ms": 96.4202081086114, "ttft_ms": 75.70633292198181, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9817427196, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9817427196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 87 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eb9361038e48bc2c9847ad6c", "attempt_id": "5e3f0c3f06a7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.811412Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.7251659883186221, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.57004193868488, "ttft_ms": 71.57004193868488, "decode_ms": 13.517000013962388}, "total_wall_ms": 91.96012502070516, "ttft_ms": 71.57004193868488, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9798208740, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9798208740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 88 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e99db31dd368078370156f46", "attempt_id": "6f7967ba1a61", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:15.928158Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 214843392, "serialized_payload_bytes": 214859683, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3264.8609169991687, "doc_prefill_ms": 1101.1464999755844, "compress_ms": 2103.135416051373, "serialize_ms": 60.265916981734335, "load_ms": 1.7118329415097833, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.62266690284014, "ttft_ms": 71.62266690284014, "decode_ms": 13.785250019282103}, "total_wall_ms": 92.61020901612937, "ttft_ms": 71.62266690284014, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11046682624, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9798208740, "mlx_cache_bytes": 9229464549, "process_rss_bytes": 11046682624}, "peak_prefill_memory": 10049375320, "peak_decode_memory": 9798208740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "afb835e86110f61bbc32230e10a2bc4a4d8cbda13058610e66d37141d0c8e67a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 89 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "70291affa1f4ef729481e8be", "attempt_id": "4860f4fe3ef3", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:16.045552Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 35, "compress_ms": 124.24375000409782}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 35, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3346.89712501131, "doc_prefill_ms": 1104.1667920071632, "compress_ms": 2224.495540955104, "serialize_ms": 17.871040967293084, "load_ms": 1.8788750749081373, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.37849998753518, "ttft_ms": 42.37849998753518, "decode_ms": 12.335999985225499}, "total_wall_ms": 3412.970958976075, "ttft_ms": 42.37849998753518, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10960879616, "backend_memory": {"mlx_active_bytes": 9369324552, "mlx_peak_bytes": 9442479308, "mlx_cache_bytes": 9742815101, "process_rss_bytes": 10960879616}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9442479308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 90 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cbec6d3d19ca1c6779019a4c", "attempt_id": "6435316cb7f9", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:19.483516Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 41, "compress_ms": 125.96666696481407}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3317.475041956641, "doc_prefill_ms": 1102.9646249953657, "compress_ms": 2201.7312080133706, "serialize_ms": 12.414791970513761, "load_ms": 1.4954169746488333, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.32637500576675, "ttft_ms": 44.32637500576675, "decode_ms": 12.293791049160063}, "total_wall_ms": 3383.2454159855843, "ttft_ms": 44.32637500576675, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11015192576, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9452588260, "mlx_cache_bytes": 9786576765, "process_rss_bytes": 11015192576}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9452588260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 91 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b5cb9825140a329a8ba44221", "attempt_id": "c6bebabca42b", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:22.895765Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 41, "compress_ms": 126.77983299363405}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3326.394125004299, "doc_prefill_ms": 1102.478374959901, "compress_ms": 2211.251958971843, "serialize_ms": 12.324125040322542, "load_ms": 1.70616596005857, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.5898330071941, "ttft_ms": 44.5898330071941, "decode_ms": 12.371875112876296}, "total_wall_ms": 3392.799000022933, "ttft_ms": 44.5898330071941, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11015225344, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9452588260, "mlx_cache_bytes": 9786576765, "process_rss_bytes": 11015225344}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9452588260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 92 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "673e83c151086268e631647e", "attempt_id": "d80877c57fc5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:26.315791Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 36, "compress_ms": 120.11620891280472}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3301.5386660117656, "doc_prefill_ms": 1103.4587919712067, "compress_ms": 2185.7188750291243, "serialize_ms": 12.01070798560977, "load_ms": 1.1905840365216136, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.62962506618351, "ttft_ms": 42.62962506618351, "decode_ms": 12.398375081829727}, "total_wall_ms": 3365.607833955437, "ttft_ms": 42.62962506618351, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11015225344, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9443298532, "mlx_cache_bytes": 9821081469, "process_rss_bytes": 11015225344}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9443298532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 93 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0b0dec0d463b20e25512d357", "attempt_id": "cb786763a203", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:29.708816Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 46, "compress_ms": 127.3859579814598}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 46, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727204, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3346.7658340232447, "doc_prefill_ms": 1103.0014579882845, "compress_ms": 2230.854125111364, "serialize_ms": 12.562624993734062, "load_ms": 1.3230409240350127, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.91212500538677, "ttft_ms": 42.91212500538677, "decode_ms": 74.10275004804134}, "total_wall_ms": 3473.849790985696, "ttft_ms": 42.91212500538677, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 11015274496, "backend_memory": {"mlx_active_bytes": 9370258440, "mlx_peak_bytes": 9461009656, "mlx_cache_bytes": 9896513405, "process_rss_bytes": 11015274496}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9461009656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "575300", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7f4df8c8d17183495e9461234a0db462908d07383312a158ce9316dc637f8a4", "output_hash": "738f2578f1f148341d703e674fe46568a0a809a2b006625d7d0f04b812b441cf"} | ||||
| 94 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f1340955c66904620005cae5", "attempt_id": "4fd07bf65663", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:33.209611Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 47, "compress_ms": 125.93700003344566}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3360.2793329628184, "doc_prefill_ms": 1104.6770829707384, "compress_ms": 2243.979208986275, "serialize_ms": 11.270000017248094, "load_ms": 1.5055830590426922, "receiver_prefill_ms": 0.0, "query_prefill_ms": 116.93466699216515, "ttft_ms": 116.93466699216515, "decode_ms": 12.496209004893899}, "total_wall_ms": 3499.0540829021484, "ttft_ms": 116.93466699216515, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11015340032, "backend_memory": {"mlx_active_bytes": 9370389512, "mlx_peak_bytes": 9462828284, "mlx_cache_bytes": 9916993405, "process_rss_bytes": 11015340032}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9462828284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 95 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8e38ecf447ff31b606022167", "attempt_id": "5ea0c478ea84", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:36.735803Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 36, "compress_ms": 119.29179192520678}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3300.649374956265, "doc_prefill_ms": 1101.8420839682221, "compress_ms": 2186.984375002794, "serialize_ms": 11.440707952715456, "load_ms": 1.2745419517159462, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.523832991719246, "ttft_ms": 42.523832991719246, "decode_ms": 12.297124951146543}, "total_wall_ms": 3364.26358402241, "ttft_ms": 42.523832991719246, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11015340032, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9443298532, "mlx_cache_bytes": 9918074749, "process_rss_bytes": 11015340032}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9443298532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 96 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7301b97b14fa0b3d2986f8c8", "attempt_id": "65aaffe52fd7", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:40.129487Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 36, "compress_ms": 120.50179194193333}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3309.002499911003, "doc_prefill_ms": 1103.199000004679, "compress_ms": 2194.004499935545, "serialize_ms": 11.432999977841973, "load_ms": 1.3105840189382434, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.7378750173375, "ttft_ms": 42.7378750173375, "decode_ms": 12.366583105176687}, "total_wall_ms": 3373.316125012934, "ttft_ms": 42.7378750173375, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11015340032, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9443298532, "mlx_cache_bytes": 9918074749, "process_rss_bytes": 11015340032}, "peak_prefill_memory": 10049342552, "peak_decode_memory": 9443298532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 97 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ce20408cb556f4b743296e92", "attempt_id": "88a6543dcbc3", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:43.572275Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1941, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 673.6878749215975, "ttft_ms": 12.249874998815358, "decode_ms": 120.39562501013279}, "total_wall_ms": 809.8889579996467, "ttft_ms": 12.249874998815358, "input_usage": {"receiver_prompt_tokens": 1941}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10462494720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9948703376, "mlx_cache_bytes": 697799688, "process_rss_bytes": 10462494720}, "peak_prefill_memory": null, "peak_decode_memory": 9948703376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GR-79S-5839", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "720cc40cd69e85e9728f6bea00b17a95ca07eee643e143a131840763958303cd"} | ||||
| 98 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "10fa4d3f27e9f486347834bd", "attempt_id": "ad16f24231d4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:44.401119Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1945, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 673.7630419665948, "ttft_ms": 12.06974999513477, "decode_ms": 132.4792910600081}, "total_wall_ms": 821.9451670302078, "ttft_ms": 12.06974999513477, "input_usage": {"receiver_prompt_tokens": 1945}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10462527488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9949965376, "mlx_cache_bytes": 1271206920, "process_rss_bytes": 10462527488}, "peak_prefill_memory": null, "peak_decode_memory": 9949965376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 344-B, Témiscaming", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "0197d491a5a04a142dc8e372360735a1d41757e7a5aea7e81f23b0e1ef6ee010"} | ||||
| 99 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "90d6bd3031553a8ad0d545cb", "attempt_id": "37e55ecfb4da", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:45.241932Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1945, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 672.7766660042107, "ttft_ms": 12.116834055632353, "decode_ms": 84.23445909284055}, "total_wall_ms": 772.7277500089258, "ttft_ms": 12.116834055632353, "input_usage": {"receiver_prompt_tokens": 1945}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10462527488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9949965376, "mlx_cache_bytes": 1271206920, "process_rss_bytes": 10462527488}, "peak_prefill_memory": null, "peak_decode_memory": 9949965376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "55.7912", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "9aa9f6d48d43eb12185d973cf0d62919041cf70e6dee09af0dbc2dec0c8c1711"} | ||||
| 100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1d54c7d90824fdd83141363d", "attempt_id": "a506a9c77bf5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:46.033795Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1940, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 672.9353750124574, "ttft_ms": 12.175542069599032, "decode_ms": 72.34212500043213}, "total_wall_ms": 760.7603329233825, "ttft_ms": 12.175542069599032, "input_usage": {"receiver_prompt_tokens": 1940}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10462527488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9948703376, "mlx_cache_bytes": 1271206920, "process_rss_bytes": 10462527488}, "peak_prefill_memory": null, "peak_decode_memory": 9948703376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "2a62606853c315bba8769371d195e3ab3d6a8cd7ef959205575c5119740850f8"} | ||||
| 101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6a041c224ec63a4afbfcc3e4", "attempt_id": "d9036f836a16", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:46.814085Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1949, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 674.4491250719875, "ttft_ms": 12.153916992247105, "decode_ms": 108.57904201839119}, "total_wall_ms": 798.3392919413745, "ttft_ms": 12.153916992247105, "input_usage": {"receiver_prompt_tokens": 1949}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10462560256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9951226944, "mlx_cache_bytes": 1877726216, "process_rss_bytes": 10462560256}, "peak_prefill_memory": null, "peak_decode_memory": 9951226944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,863,814", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "f1722ba741a0ef5b3ac45cce5ffc57bea78f7eb0a07f17be098ba98a15ed3374"} | ||||
| 102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7d238b50c4310a10d4369646", "attempt_id": "f7685cf93842", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:47.630136Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1951, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 674.0097079891711, "ttft_ms": 12.090457952581346, "decode_ms": 120.67025003489107}, "total_wall_ms": 809.9823329830542, "ttft_ms": 12.090457952581346, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10462511104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9952095296, "mlx_cache_bytes": 2453132296, "process_rss_bytes": 10462511104}, "peak_prefill_memory": null, "peak_decode_memory": 9952095296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dcfbb178c6e0a659afb360f8", "attempt_id": "f61a96232ac0", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:48.457055Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1943, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 673.4314999775961, "ttft_ms": 12.168582994490862, "decode_ms": 12.053417041897774}, "total_wall_ms": 700.9519999846816, "ttft_ms": 12.168582994490862, "input_usage": {"receiver_prompt_tokens": 1943}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462543872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9949572160, "mlx_cache_bytes": 2795230216, "process_rss_bytes": 10462543872}, "peak_prefill_memory": null, "peak_decode_memory": 9949572160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e05a229ed081fdbf17e8920f", "attempt_id": "d3a84b6569f6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:49.174711Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1940, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009790994226932526, "decode_payload_ms": 0.0, "receiver_prefill_ms": 672.7225830545649, "ttft_ms": 12.23554101306945, "decode_ms": 12.10212497971952}, "total_wall_ms": 700.4576670005918, "ttft_ms": 12.23554101306945, "input_usage": {"receiver_prompt_tokens": 1940}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462543872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9948703376, "mlx_cache_bytes": 2795230216, "process_rss_bytes": 10462543872}, "peak_prefill_memory": null, "peak_decode_memory": 9948703376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d12060ff9d0e681cc7e8fbec", "attempt_id": "3483c1d313b1", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:53.873097Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 232.06891701556742, "ttft_ms": 12.071165954694152, "decode_ms": 118.48854192066938}, "total_wall_ms": 363.8637090334669, "ttft_ms": 12.071165954694152, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10462642176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 3951280136, "process_rss_bytes": 10462642176}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GR-79S-5839", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "720cc40cd69e85e9728f6bea00b17a95ca07eee643e143a131840763958303cd"} | ||||
| 106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "13187168a33e66d7bef7fdf4", "attempt_id": "1e8864426301", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:54.254928Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.97920794598758, "ttft_ms": 11.964083998464048, "decode_ms": 130.33216702751815}, "total_wall_ms": 370.46341598033905, "ttft_ms": 11.964083998464048, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10462642176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567000664, "mlx_cache_bytes": 4225843208, "process_rss_bytes": 10462642176}, "peak_prefill_memory": null, "peak_decode_memory": 9567000664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 344-B, Témiscaming", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "0197d491a5a04a142dc8e372360735a1d41757e7a5aea7e81f23b0e1ef6ee010"} | ||||
| 107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ce63b93f31435bc093b6f947", "attempt_id": "292753aa63dc", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:54.642679Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.0377500206232, "ttft_ms": 12.192500056698918, "decode_ms": 12.096791993826628}, "total_wall_ms": 251.6085000243038, "ttft_ms": 12.192500056698918, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462658560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567000664, "mlx_cache_bytes": 4225843208, "process_rss_bytes": 10462658560}, "peak_prefill_memory": null, "peak_decode_memory": 9567000664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f35c7ef733fa13b71c7101c6", "attempt_id": "a2047868b9aa", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:54.913507Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.61804198287427, "ttft_ms": 12.158416910097003, "decode_ms": 71.1609999416396}, "total_wall_ms": 311.17816700134426, "ttft_ms": 12.158416910097003, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10462674944, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 4381753352, "process_rss_bytes": 10462674944}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "2a62606853c315bba8769371d195e3ab3d6a8cd7ef959205575c5119740850f8"} | ||||
| 109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "809cec3bc87c879366f2a6ee", "attempt_id": "7cd57bdb002f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:55.244568Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.2079159738496, "ttft_ms": 11.974749970249832, "decode_ms": 11.876708013005555}, "total_wall_ms": 252.12458393070847, "ttft_ms": 11.974749970249832, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462691328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 4643241992, "process_rss_bytes": 10462691328}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0a2b3ecf881de65a314ad938", "attempt_id": "fe0738708338", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:55.514115Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.3014170350507, "ttft_ms": 11.946958024054766, "decode_ms": 118.4550829930231}, "total_wall_ms": 358.79404097795486, "ttft_ms": 11.946958024054766, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10462707712, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570146392, "mlx_cache_bytes": 4920950792, "process_rss_bytes": 10462707712}, "peak_prefill_memory": null, "peak_decode_memory": 9570146392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e66d2b967645b0cf0ba2a5b6", "attempt_id": "662a8f86c449", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:55.889897Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.3379580108449, "ttft_ms": 12.20245799049735, "decode_ms": 11.927583022043109}, "total_wall_ms": 251.66229193564504, "ttft_ms": 12.20245799049735, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462724096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566410840, "mlx_cache_bytes": 5077647368, "process_rss_bytes": 10462724096}, "peak_prefill_memory": null, "peak_decode_memory": 9566410840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "572bbb9c400677d3e0cf4aec", "attempt_id": "2c1e4853fd03", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:20:56.158582Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1287, "cache_tensor_bytes": null, "serialized_payload_bytes": 1287, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.8639999246225, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.17474994715303, "ttft_ms": 11.942540993914008, "decode_ms": 11.941666016355157}, "total_wall_ms": 252.12095805909485, "ttft_ms": 11.942540993914008, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.50570796150714, "sender_ttft_ms": 7.4446669314056635, "sender_decode_ms": 3632.1031250990927}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462724096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 5077647368, "process_rss_bytes": 10462724096}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e723386ece68866dd1f2fb75c4a583a5e59c704751fd5ff3bd9356466fb8cd01", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "591395c13f1be0f834dcaf7b", "attempt_id": "459de7800e38", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.408129Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 234, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 107.96033299993724, "ttft_ms": 11.892625014297664, "decode_ms": 11.691333958879113}, "total_wall_ms": 132.28137500118464, "ttft_ms": 11.892625014297664, "input_usage": {"receiver_prompt_tokens": 234, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462740480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9497841696, "mlx_cache_bytes": 6018499500, "process_rss_bytes": 10462740480}, "peak_prefill_memory": null, "peak_decode_memory": 9497841696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fcb959b6eeba6320356b66da", "attempt_id": "fb6759f4c3ae", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.558511Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 238, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.66729099769145, "ttft_ms": 11.727250064723194, "decode_ms": 11.701749986968935}, "total_wall_ms": 127.75016692467034, "ttft_ms": 11.727250064723194, "input_usage": {"receiver_prompt_tokens": 238, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462740480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9504641072, "mlx_cache_bytes": 6237636448, "process_rss_bytes": 10462740480}, "peak_prefill_memory": null, "peak_decode_memory": 9504641072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0b7b4e5496c67bd5f24db892", "attempt_id": "b9bd897503f5", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.703748Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 238, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.0237500090152, "ttft_ms": 11.651542037725449, "decode_ms": 11.656167102046311}, "total_wall_ms": 126.91504205577075, "ttft_ms": 11.651542037725449, "input_usage": {"receiver_prompt_tokens": 238, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462740480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9504641072, "mlx_cache_bytes": 6237636448, "process_rss_bytes": 10462740480}, "peak_prefill_memory": null, "peak_decode_memory": 9504641072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c3852fa28e6989be6b91371b", "attempt_id": "2debab8dfb73", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.847695Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 233, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.252665954642, "ttft_ms": 11.607291991822422, "decode_ms": 11.592041002586484}, "total_wall_ms": 127.04808299895376, "ttft_ms": 11.607291991822422, "input_usage": {"receiver_prompt_tokens": 233, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462756864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9497350176, "mlx_cache_bytes": 6319425376, "process_rss_bytes": 10462756864}, "peak_prefill_memory": null, "peak_decode_memory": 9497350176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fcb21c414adae4435252cd5a", "attempt_id": "934ddda97a64", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:00.991621Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 242, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.02545898593962, "ttft_ms": 11.969792074523866, "decode_ms": 11.765958042815328}, "total_wall_ms": 127.53499997779727, "ttft_ms": 11.969792074523866, "input_usage": {"receiver_prompt_tokens": 242, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462756864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9508786240, "mlx_cache_bytes": 6529714980, "process_rss_bytes": 10462756864}, "peak_prefill_memory": null, "peak_decode_memory": 9508786240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0c377a15b8555508fa9bbf6e", "attempt_id": "7a781221b1d9", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.138168Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 244, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.22466702200472, "ttft_ms": 12.076832936145365, "decode_ms": 81.5840830327943}, "total_wall_ms": 197.66337506007403, "ttft_ms": 12.076832936145365, "input_usage": {"receiver_prompt_tokens": 244, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10462756864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9510408264, "mlx_cache_bytes": 6643306224, "process_rss_bytes": 10462756864}, "peak_prefill_memory": null, "peak_decode_memory": 9510408264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banrukmel-13", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "3949821f9eb37a41c5bc71b77d22515a479ce2826216a35e124cb72a61a3f9ac"} | ||||
| 119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d2848d4730e2e28d529a0c7d", "attempt_id": "73743f1e686c", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.354787Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 236, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.48666703794152, "ttft_ms": 11.680916999466717, "decode_ms": 11.622582911513746}, "total_wall_ms": 127.39891593810171, "ttft_ms": 11.680916999466717, "input_usage": {"receiver_prompt_tokens": 236, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462756864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9499086896, "mlx_cache_bytes": 6814699248, "process_rss_bytes": 10462756864}, "peak_prefill_memory": null, "peak_decode_memory": 9499086896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0636de0b818bd65d66b20e1e", "attempt_id": "e8f149821870", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.499448Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 233, "message_tokens": 143, "message_utf8_bytes": 309, "cache_tensor_bytes": null, "serialized_payload_bytes": 309, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.6079169716686, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.13229204621166, "ttft_ms": 11.686708079650998, "decode_ms": 11.656332993879914}, "total_wall_ms": 127.03624996356666, "ttft_ms": 11.686708079650998, "input_usage": {"receiver_prompt_tokens": 233, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 343.03862508386374, "sender_ttft_ms": 7.315374910831451, "sender_decode_ms": 3626.387625001371}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10462756864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9497350176, "mlx_cache_bytes": 6814699248, "process_rss_bytes": 10462756864}, "peak_prefill_memory": null, "peak_decode_memory": 9497350176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 3, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47d85a24e12bb739e5d51f3eeecba74c5590ad0e7759df9e2d304341fd9f6089", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f0a36f12c0dccb23fc1c76b7", "attempt_id": "945f04ddd97d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:01.999124Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 36, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.6253750072792172, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.295583015307784, "ttft_ms": 46.295583015307784, "decode_ms": 576.4290420338511}, "total_wall_ms": 626.0536659974605, "ttft_ms": 46.295583015307784, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405713416, "mlx_peak_bytes": 9480342736, "mlx_cache_bytes": 7591892257, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9480342736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1.H3值不等温德 accent\n... ():最好別班抽头碰头七分之最\n什麼是這樣的短的b不为王道,不,体操之равe的ertapp000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "5c508d5b5fcb5904a6604859852e8085c664c11a659087d73ad05f0db9b81383"} | ||||
| 122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "88ce4bfa29b44e5efe486c9e", "attempt_id": "ecea2290a68f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:02.643181Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.4389579882845283, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.652834026142955, "ttft_ms": 48.652834026142955, "decode_ms": 578.9131249766797}, "total_wall_ms": 630.8081250172108, "ttft_ms": 48.652834026142955, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405729800, "mlx_peak_bytes": 9486552288, "mlx_cache_bytes": 7670748769, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9486552288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "蹊方面，口胡博士的驚成套子，就有，读一为之一线形为人的唯一形式的熱带到那灰姑娘眼中，一口气冲的多，有解體力口诛体检很快文在那一", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "bea856bdaa5142c38fc4df8497f12669be05333057097bce252f6cd74b549c37"} | ||||
| 123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b59938f8ffc894ff0990b567", "attempt_id": "3518c0fdc1bd", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:03.291940Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.4524169964715838, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.373667010106146, "ttft_ms": 47.373667010106146, "decode_ms": 579.4476659502834}, "total_wall_ms": 630.2769168978557, "ttft_ms": 47.373667010106146, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405713416, "mlx_peak_bytes": 9486552288, "mlx_cache_bytes": 7670765153, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9486552288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "the color\nso, it can only a few summers in 1x=1:4 15″\n\"PAGGS\n\\(^)-hulalaau-...is forbl##\nimitervisier=x=", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "cc2662409d32e7a4e29d75ac01c2e31007a4237406efd1816c10b25e1b7a5529"} | ||||
| 124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7dc27d86a40370aae0b33ed8", "attempt_id": "4121711856e2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:03.942473Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.401541056111455, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.0357500705868, "ttft_ms": 46.0357500705868, "decode_ms": 579.4823750620708}, "total_wall_ms": 628.6432499764487, "ttft_ms": 46.0357500705868, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405713416, "mlx_peak_bytes": 9479113936, "mlx_cache_bytes": 7702058593, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9479113936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "iis a fewfankpackertoon, it's true love and the shortest 1.\nsomeonesarepaus w:10013 (floroweho, soithaseries of, \"sab", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "2cfa4399d0227f5a656297aec9fde2e151f163a1c64f035362bfffa29c814037"} | ||||
| 125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "244722fac15ee93b3fb3a3a7", "attempt_id": "bc6e7ed0aa1d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:04.589310Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 44, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.4660829911008477, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.3426249595359, "ttft_ms": 49.3426249595359, "decode_ms": 579.6489589847624}, "total_wall_ms": 632.3079579742625, "ttft_ms": 49.3426249595359, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405746184, "mlx_peak_bytes": 9493695728, "mlx_cache_bytes": 7771477953, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9493695728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " 槓南ields_x老辅工学群青结题目的狂神童多选学翻译进行的勇士出类子的疼痛为王:\n[print之接力ugo014292色条", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "b0b6327a6446013e2a854e8f52bc8fabe0877cb47de8fe46f8ef6cff39b2f65c"} | ||||
| 126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "23eb6a973f85f6e34910bfb8", "attempt_id": "7d88a681e706", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:05.239829Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.449250034056604, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.80508391559124, "ttft_ms": 47.80508391559124, "decode_ms": 578.2892500283197}, "total_wall_ms": 629.3859160505235, "ttft_ms": 47.80508391559124, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405729800, "mlx_peak_bytes": 9497644280, "mlx_cache_bytes": 7837620529, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9497644280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "...\n)with a few poppable-itutorless singing table tennis has no. )eigène-voetosmutterstoshuman(\nGiggleeclair000:andq_soak000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "81f50b2160e6338ebf7bf7875427588c44564cd5e104fed9e6326aa307f9e18d"} | ||||
| 127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b972645159186f698562f5d8", "attempt_id": "fc3eb4188386", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:05.887787Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 38, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.4163340674713254, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.0909159630537, "ttft_ms": 47.0909159630537, "decode_ms": 578.5568749997765}, "total_wall_ms": 629.0012500248849, "ttft_ms": 47.0909159630537, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405746184, "mlx_peak_bytes": 9483685088, "mlx_cache_bytes": 7897489109, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9483685088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "答案, -103有穷忙笑山重答案或者说破,多不,行家有1:)。\n(戰鼓)。所以,其中途,也,我为\n答案见的,運動成", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "f4bb5a0f2e0544b80f641c66936898b2a6c273720625a4b22ddda43007d2dd2f"} | ||||
| 128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8418f4c52698c6b01816f9fb", "attempt_id": "e9269b570a90", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:06.537559Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330494472}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242017, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.30549997929484, "doc_prefill_ms": 327.1930830087513, "compress_ms": 8.361750049516559, "serialize_ms": 16.47658401634544, "load_ms": 1.405542017892003, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.810582931153476, "ttft_ms": 45.810582931153476, "decode_ms": 576.4374999562278}, "total_wall_ms": 625.3961250185966, "ttft_ms": 45.810582931153476, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10603790336, "backend_memory": {"mlx_active_bytes": 9405729800, "mlx_peak_bytes": 9479113936, "mlx_cache_bytes": 7897505493, "process_rss_bytes": 10603790336}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9479113936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "i_givesellenedcompenderengeedesportalschess,genera(novembodhaveskicked inhas a few, but, the case, \"well,spelerversus\nA) and I", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac1f050541ad8605d8c935f44e4df6c47d9eda0a42efdb4238407b5a72e1eb98", "output_hash": "08106ac2b5ffe8757c565450c676e6a0b2d572e265f13cd61e8d15443ecff55a"} | ||||
| 129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c0aa249669c5eeb8c67f9e89", "attempt_id": "89b18566e0b0", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.409713Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 36, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.7402919474989176, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.17500004824251, "ttft_ms": 71.17500004824251, "decode_ms": 12.47724995482713}, "total_wall_ms": 87.30162493884563, "ttft_ms": 71.17500004824251, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9479523536, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9479523536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "437f177174ee20ddc4edd73c", "attempt_id": "a90f4fdafa28", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.516940Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.4169999631121755, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.208750085905194, "ttft_ms": 48.208750085905194, "decode_ms": 12.239416944794357}, "total_wall_ms": 63.60545800998807, "ttft_ms": 48.208750085905194, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9486142688, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9486142688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7df9545fcfa00332270f45bd", "attempt_id": "5b0db1032b15", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.597797Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.398916938342154, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.96995804645121, "ttft_ms": 47.96995804645121, "decode_ms": 12.30454200413078}, "total_wall_ms": 63.463374972343445, "ttft_ms": 47.96995804645121, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9486142688, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9486142688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7cb47097197613fbb90ba0c7", "attempt_id": "682973431e25", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.678636Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.413041027262807, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.84391601383686, "ttft_ms": 45.84391601383686, "decode_ms": 12.314375024288893}, "total_wall_ms": 61.36024999432266, "ttft_ms": 45.84391601383686, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9478704336, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9478704336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "788e79e03719bfd2ccb42243", "attempt_id": "4910beeaee48", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.756962Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 44, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.373250037431717, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.55266690719873, "ttft_ms": 48.55266690719873, "decode_ms": 12.338083004578948}, "total_wall_ms": 64.05545899178833, "ttft_ms": 48.55266690719873, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9493335280, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9493335280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e7c1544c0fc7f487e0a2d8c0", "attempt_id": "05aab7930177", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.838054Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.3411670224741101, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.996750053949654, "ttft_ms": 46.996750053949654, "decode_ms": 12.337499996647239}, "total_wall_ms": 62.33016599435359, "ttft_ms": 46.996750053949654, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9497234680, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9497234680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "08649e7745661c97da1489ed", "attempt_id": "43f9c7bcdc0f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.917763Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 38, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.4720839681103826, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.409791965037584, "ttft_ms": 47.409791965037584, "decode_ms": 12.507833074778318}, "total_wall_ms": 63.04716598242521, "ttft_ms": 47.409791965037584, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9483275488, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9483275488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1a929fc92755d6bfa90255db", "attempt_id": "646f60ee0c6d", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:08.997796Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 70225920, "serialized_payload_bytes": 70242118, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1226.0180830489844, "doc_prefill_ms": 326.51208294555545, "compress_ms": 879.4668749906123, "serialize_ms": 19.764124997891486, "load_ms": 1.362666953355074, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.822916901670396, "ttft_ms": 45.822916901670396, "decode_ms": 12.460250058211386}, "total_wall_ms": 61.38537498190999, "ttft_ms": 45.822916901670396, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10586406912, "backend_memory": {"mlx_active_bytes": 9402043400, "mlx_peak_bytes": 9478704336, "mlx_cache_bytes": 7905124053, "process_rss_bytes": 10586406912}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9478704336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4d9060fa90ba43cdfbe86ae1f58be3f399d09557c64b92945355a439afbdbdf6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "35e4f6bd62ab00872310c193", "attempt_id": "90c30df0d624", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:09.076081Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 36, "compress_ms": 94.24045903142542}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 36, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.0191250313073, "doc_prefill_ms": 327.0070409635082, "compress_ms": 962.6299580559134, "serialize_ms": 6.102791987359524, "load_ms": 1.3940000208094716, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.56454193312675, "ttft_ms": 35.56454193312675, "decode_ms": 11.919250013306737}, "total_wall_ms": 1348.1651250040159, "ttft_ms": 35.56454193312675, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10579443712, "backend_memory": {"mlx_active_bytes": 9297054728, "mlx_peak_bytes": 9362984144, "mlx_cache_bytes": 8109480677, "process_rss_bytes": 10579443712}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9362984144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "46d7c5e335daea7c557f2786", "attempt_id": "d36d9fb78169", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:10.441034Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 40, "compress_ms": 87.73245895281434}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1270.4072910128161, "doc_prefill_ms": 326.1695420369506, "compress_ms": 939.0238339547068, "serialize_ms": 4.927166970446706, "load_ms": 1.212583971209824, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.18541597481817, "ttft_ms": 37.18541597481817, "decode_ms": 11.844667023979127}, "total_wall_ms": 1323.7274590646848, "ttft_ms": 37.18541597481817, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10597154816, "backend_memory": {"mlx_active_bytes": 9297054728, "mlx_peak_bytes": 9370782944, "mlx_cache_bytes": 8142314213, "process_rss_bytes": 10597154816}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9370782944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f37907d6d247f5e0e132dee9", "attempt_id": "97030024e0bb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:11.783756Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 40, "compress_ms": 80.88358398526907}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1289.1227080253884, "doc_prefill_ms": 326.8092080252245, "compress_ms": 957.0504169678316, "serialize_ms": 4.966791020706296, "load_ms": 1.1937920935451984, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.08295803517103, "ttft_ms": 37.08295803517103, "decode_ms": 17.805709037929773}, "total_wall_ms": 1348.4057920286432, "ttft_ms": 37.08295803517103, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10597171200, "backend_memory": {"mlx_active_bytes": 9297054728, "mlx_peak_bytes": 9370782944, "mlx_cache_bytes": 8142314213, "process_rss_bytes": 10597171200}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9370782944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6bd90bad267deba2c2c1ee01", "attempt_id": "c81fee5d8ade", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:13.152868Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 35, "compress_ms": 74.88112500868738}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1273.644334054552, "doc_prefill_ms": 327.14312500320375, "compress_ms": 941.5104170329869, "serialize_ms": 4.689250024966896, "load_ms": 1.1774169979617, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.53812501579523, "ttft_ms": 36.53812501579523, "decode_ms": 12.02308398205787}, "total_wall_ms": 1326.368166017346, "ttft_ms": 36.53812501579523, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10597187584, "backend_memory": {"mlx_active_bytes": 9296169992, "mlx_peak_bytes": 9362164944, "mlx_cache_bytes": 8147475173, "process_rss_bytes": 10597187584}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9362164944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "42d3b81b43a3c7fecd6ed195", "attempt_id": "99211624a1c9", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:14.500311Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 44, "compress_ms": 81.54749998357147}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 44, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1300.5758749786764, "doc_prefill_ms": 326.50612492579967, "compress_ms": 969.0950830699876, "serialize_ms": 4.683542065322399, "load_ms": 1.0784160112962127, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.03579101804644, "ttft_ms": 38.03579101804644, "decode_ms": 11.815500096417964}, "total_wall_ms": 1354.5107500394806, "ttft_ms": 38.03579101804644, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10597187584, "backend_memory": {"mlx_active_bytes": 9297054728, "mlx_peak_bytes": 9377910000, "mlx_cache_bytes": 8177195749, "process_rss_bytes": 10597187584}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9377910000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "df4d24f5d45722c43f754090", "attempt_id": "bd13f534dab7", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:15.873984Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 46, "compress_ms": 95.55770794395357}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1310.1900829933584, "doc_prefill_ms": 326.6027079662308, "compress_ms": 978.4844999667257, "serialize_ms": 4.822250106371939, "load_ms": 1.1049580061808228, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.926499917171896, "ttft_ms": 36.926499917171896, "decode_ms": 11.962375021539629}, "total_wall_ms": 1363.2122080307454, "ttft_ms": 36.926499917171896, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10597187584, "backend_memory": {"mlx_active_bytes": 9297054728, "mlx_peak_bytes": 9381858552, "mlx_cache_bytes": 8221547237, "process_rss_bytes": 10597187584}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9381858552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fc2af5e24baee4ff6bd83959", "attempt_id": "7f43c1f12879", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:17.256269Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 38, "compress_ms": 81.3992079347372}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 38, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563340, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1270.3804170014337, "doc_prefill_ms": 326.4297080459073, "compress_ms": 939.0555410645902, "serialize_ms": 4.600333049893379, "load_ms": 1.210042042657733, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.930999951437116, "ttft_ms": 36.930999951437116, "decode_ms": 11.846540961414576}, "total_wall_ms": 1323.333292035386, "ttft_ms": 36.930999951437116, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10597203968, "backend_memory": {"mlx_active_bytes": 9297054728, "mlx_peak_bytes": 9367915744, "mlx_cache_bytes": 8244861669, "process_rss_bytes": 10597203968}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9367915744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77726f63f40df32a1541d536e752befbdb6b4a9606102b761de05d4cb1a1b5cf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f20baa5d2ce2e4118ea7666f", "attempt_id": "6c75e0178e30", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:18.600605Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 35, "compress_ms": 83.03237496875226}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1285.8362919650972, "doc_prefill_ms": 325.41950000450015, "compress_ms": 955.2989170188084, "serialize_ms": 4.8357920022681355, "load_ms": 1.0988330468535423, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.09387495089322, "ttft_ms": 36.09387495089322, "decode_ms": 12.071167002432048}, "total_wall_ms": 1338.4106250014156, "ttft_ms": 36.09387495089322, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10597203968, "backend_memory": {"mlx_active_bytes": 9296169992, "mlx_peak_bytes": 9362164944, "mlx_cache_bytes": 8245746405, "process_rss_bytes": 10597203968}, "peak_prefill_memory": 9963301532, "peak_decode_memory": 9362164944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c14e7dfd0010593b5326444", "attempt_id": "045ecadf2e4e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:20.000673Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5952, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2231.28274991177, "ttft_ms": 12.758374912664294, "decode_ms": 124.24766691401601}, "total_wall_ms": 2380.540250102058, "ttft_ms": 12.758374912664294, "input_usage": {"receiver_prompt_tokens": 5952}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10447372288, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10097937472, "mlx_cache_bytes": 1706833336, "process_rss_bytes": 10447372288}, "peak_prefill_memory": null, "peak_decode_memory": 10097937472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NC-81Q-5632", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "a164ecfce8f107d7a20bd963c79c2c4c12f25230ed03a15a9b8418fd88a56a6a"} | ||||
| 146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ed80406faef702d5a7213f71", "attempt_id": "c27783a190b0", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:22.410784Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5956, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2251.1234999401495, "ttft_ms": 12.681499938480556, "decode_ms": 136.58708392176777}, "total_wall_ms": 2411.543249967508, "ttft_ms": 12.681499938480556, "input_usage": {"receiver_prompt_tokens": 5956}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10447372288, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10099526720, "mlx_cache_bytes": 2297460152, "process_rss_bytes": 10447372288}, "peak_prefill_memory": null, "peak_decode_memory": 10099526720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 586-H, Sept-Îles", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "2facb5a82d5d4139268d6cc6f9ed2170ae04b004140ac4fd883f87cb47e25ed7"} | ||||
| 147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b72df9340ed8ad32794c4efc", "attempt_id": "fe41d680d1dd", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:24.849634Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5955, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2250.4477920010686, "ttft_ms": 12.689166935160756, "decode_ms": 87.04495802521706}, "total_wall_ms": 2360.7596250949427, "ttft_ms": 12.689166935160756, "input_usage": {"receiver_prompt_tokens": 5955}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10447405056, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10099264576, "mlx_cache_bytes": 2624746936, "process_rss_bytes": 10447405056}, "peak_prefill_memory": null, "peak_decode_memory": 10099264576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "36.4443", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "6986847809d5a53c4e76c5aa700f652372268de4b7869fddc8462508803f355d"} | ||||
| 148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03d3b3f3fa3895168ecdda54", "attempt_id": "3d7fd9baabb5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:27.235888Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5953, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2226.3064589351416, "ttft_ms": 12.608665972948074, "decode_ms": 61.8858749512583}, "total_wall_ms": 2311.9019579607993, "ttft_ms": 12.608665972948074, "input_usage": {"receiver_prompt_tokens": 5953}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10447437824, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10098068544, "mlx_cache_bytes": 2951640504, "process_rss_bytes": 10447437824}, "peak_prefill_memory": null, "peak_decode_memory": 10098068544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kwame Petrakis", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "5849498dab23072ae874aef51373bd300da620a33a626332ff86d41c9ce75103"} | ||||
| 149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eded767c04da0e9e052bcd70", "attempt_id": "8b31c9ba69c0", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:29.572706Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5957, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2250.6700409576297, "ttft_ms": 12.619209010154009, "decode_ms": 86.91866707522422}, "total_wall_ms": 2361.096250009723, "ttft_ms": 12.619209010154009, "input_usage": {"receiver_prompt_tokens": 5957}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10447470592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10099657792, "mlx_cache_bytes": 3279320504, "process_rss_bytes": 10447470592}, "peak_prefill_memory": null, "peak_decode_memory": 10099657792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9660295", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "91988b1215586dd6899ef1d2a4168b0a54c0112d95ddff92bc07d79f5ac5ee86"} | ||||
| 150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d702ae0c77424183d09a8b03", "attempt_id": "b458ac99421f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:31.959245Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5961, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2248.436375055462, "ttft_ms": 12.67970900516957, "decode_ms": 124.1489170351997}, "total_wall_ms": 2395.9493750007823, "ttft_ms": 12.67970900516957, "input_usage": {"receiver_prompt_tokens": 5961}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10447486976, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10100788288, "mlx_cache_bytes": 3829069240, "process_rss_bytes": 10447486976}, "peak_prefill_memory": null, "peak_decode_memory": 10100788288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3d6f32ea7ebf23236545479f", "attempt_id": "f24050b51044", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:34.380593Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5953, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2225.6699999561533, "ttft_ms": 12.614832958206534, "decode_ms": 12.47879199218005}, "total_wall_ms": 2261.9015000527725, "ttft_ms": 12.614832958206534, "input_usage": {"receiver_prompt_tokens": 5953}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447519744, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10098068544, "mlx_cache_bytes": 3829069240, "process_rss_bytes": 10447519744}, "peak_prefill_memory": null, "peak_decode_memory": 10098068544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d2e95cbea3ecbd06fdd960a0", "attempt_id": "6b566585a8db", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:36.668147Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5951, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2226.3084579026327, "ttft_ms": 12.724083033390343, "decode_ms": 12.466249987483025}, "total_wall_ms": 2262.3452089028433, "ttft_ms": 12.724083033390343, "input_usage": {"receiver_prompt_tokens": 5951}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447552512, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10097937472, "mlx_cache_bytes": 3829069240, "process_rss_bytes": 10447552512}, "peak_prefill_memory": null, "peak_decode_memory": 10097937472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5cd433cb68cc24978abb7523", "attempt_id": "56508635617f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:43.906735Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.68133303988725, "ttft_ms": 12.116624973714352, "decode_ms": 11.977125075645745}, "total_wall_ms": 257.30125000700355, "ttft_ms": 12.116624973714352, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447601664, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 5782656440, "process_rss_bytes": 10447601664}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7610556d20d2a96825acd31a", "attempt_id": "6811599439a8", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:44.189708Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.24599996581674, "ttft_ms": 11.998167028650641, "decode_ms": 11.980292038060725}, "total_wall_ms": 252.5314170634374, "ttft_ms": 11.998167028650641, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447618048, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 6057416120, "process_rss_bytes": 10447618048}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aa0541c36f7afef2ac34a244", "attempt_id": "7b622499246e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:44.468470Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.01733303256333, "ttft_ms": 12.031042017042637, "decode_ms": 11.96637493558228}, "total_wall_ms": 252.31041701044887, "ttft_ms": 12.031042017042637, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447634432, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 6057416120, "process_rss_bytes": 10447634432}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "08a4c69e51423f78bc8dbac0", "attempt_id": "5973bb36d399", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:44.745709Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.6944170696661, "ttft_ms": 12.12958397809416, "decode_ms": 11.91737491171807}, "total_wall_ms": 252.1834159269929, "ttft_ms": 12.12958397809416, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447650816, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566410840, "mlx_cache_bytes": 6214112696, "process_rss_bytes": 10447650816}, "peak_prefill_memory": null, "peak_decode_memory": 9566410840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c802bbe03f2719d20c3d2bd5", "attempt_id": "a0bff50968a0", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:45.022914Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.09441697224975, "ttft_ms": 12.250749976374209, "decode_ms": 12.011957936920226}, "total_wall_ms": 252.81137495767325, "ttft_ms": 12.250749976374209, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447667200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568278616, "mlx_cache_bytes": 6475208120, "process_rss_bytes": 10447667200}, "peak_prefill_memory": null, "peak_decode_memory": 9568278616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3b3043f84048e86315d410c3", "attempt_id": "542f312ffd3b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:45.302799Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.9439169904217, "ttft_ms": 12.154333991929889, "decode_ms": 12.045416049659252}, "total_wall_ms": 252.57879204582423, "ttft_ms": 12.154333991929889, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447667200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570146392, "mlx_cache_bytes": 6752916920, "process_rss_bytes": 10447667200}, "peak_prefill_memory": null, "peak_decode_memory": 9570146392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4463bbeb67d7143a16a3f0f5", "attempt_id": "30be15066006", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:45.581036Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.92916600499302, "ttft_ms": 11.990291997790337, "decode_ms": 12.029416975565255}, "total_wall_ms": 252.2251249756664, "ttft_ms": 11.990291997790337, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447683584, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566410840, "mlx_cache_bytes": 6752916920, "process_rss_bytes": 10447683584}, "peak_prefill_memory": null, "peak_decode_memory": 9566410840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "989d05b542328e7ba6ea5a44", "attempt_id": "fbe6432e511f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:45.859020Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2727, "cache_tensor_bytes": null, "serialized_payload_bytes": 2727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4950.331291998737, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.76154191140085, "ttft_ms": 12.077749939635396, "decode_ms": 11.960334028117359}, "total_wall_ms": 252.08858400583267, "ttft_ms": 12.077749939635396, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5992, "sender_output_tokens": 512, "sender_prefill_ms": 1133.176999981515, "sender_ttft_ms": 28.847583918832242, "sender_decode_ms": 3782.776542007923}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447683584, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 6752916920, "process_rss_bytes": 10447683584}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "674ce8bf5d201cd86e9a89ded4726ed193b04e238e72566058fc5121656fe53d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f4b7149bceaed7df67b4f63d", "attempt_id": "7f18ad13d8bb", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.075426Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 357, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.1886249491945, "ttft_ms": 11.838708887808025, "decode_ms": 82.54737500101328}, "total_wall_ms": 242.51416698098183, "ttft_ms": 11.838708887808025, "input_usage": {"receiver_prompt_tokens": 357, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9494483468, "mlx_cache_bytes": 7682972488, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9494483468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obysellith-16", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "66b39064cfe9c103d8574722e2dac0e9a19ced28c716ed2067d84dd8796e7762"} | ||||
| 162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e8ff6c1be8480fb7398d9112", "attempt_id": "c1978790589b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.344292Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 361, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.7226250525564, "ttft_ms": 11.870707967318594, "decode_ms": 11.832874966785312}, "total_wall_ms": 167.28787496685982, "ttft_ms": 11.870707967318594, "input_usage": {"receiver_prompt_tokens": 361, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9496646172, "mlx_cache_bytes": 7893901544, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9496646172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3873b1d7e51130ca0195dfd7", "attempt_id": "7254d878707e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.537017Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 360, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.462250078097, "ttft_ms": 12.113082921132445, "decode_ms": 11.848541907966137}, "total_wall_ms": 167.35470900312066, "ttft_ms": 12.113082921132445, "input_usage": {"receiver_prompt_tokens": 360, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9496646172, "mlx_cache_bytes": 7893901544, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9496646172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "66c63b5540d318b68f34f274", "attempt_id": "5b6d789b5e17", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.729977Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 358, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.57800008635968, "ttft_ms": 11.87020807992667, "decode_ms": 11.800499982200563}, "total_wall_ms": 167.0566250104457, "ttft_ms": 11.87020807992667, "input_usage": {"receiver_prompt_tokens": 358, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9495663132, "mlx_cache_bytes": 8019730664, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9495663132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1b4dd4e99e2812b6495bada0", "attempt_id": "26629091aa7d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:51.922622Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 362, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.58833299390972, "ttft_ms": 11.869874899275601, "decode_ms": 82.26966706570238}, "total_wall_ms": 237.57524997927248, "ttft_ms": 11.869874899275601, "input_usage": {"receiver_prompt_tokens": 362, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9498333728, "mlx_cache_bytes": 8244176524, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9498333728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9660295", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "91988b1215586dd6899ef1d2a4168b0a54c0112d95ddff92bc07d79f5ac5ee86"} | ||||
| 166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b6115b3f913796313201bc8f", "attempt_id": "10099bc0c3fd", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:52.184700Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 366, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.79020903632045, "ttft_ms": 11.859624995850027, "decode_ms": 11.765541043132544}, "total_wall_ms": 167.19391697552055, "ttft_ms": 11.859624995850027, "input_usage": {"receiver_prompt_tokens": 366, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500496432, "mlx_cache_bytes": 8458808384, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9500496432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a869e69f836b30dc687963f5", "attempt_id": "6147b86af6c2", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:52.376896Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 358, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.61662494391203, "ttft_ms": 11.827624985016882, "decode_ms": 11.866332963109016}, "total_wall_ms": 167.02641698066145, "ttft_ms": 11.827624985016882, "input_usage": {"receiver_prompt_tokens": 358, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9495663132, "mlx_cache_bytes": 8458808384, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9495663132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1c1f99626235ad6f83a4f7c4", "attempt_id": "5f296120437c", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:52.568891Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 356, "message_tokens": 266, "message_utf8_bytes": 699, "cache_tensor_bytes": null, "serialized_payload_bytes": 699, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4939.322000020184, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.17495801858604, "ttft_ms": 11.763624963350594, "decode_ms": 11.861540959216654}, "total_wall_ms": 166.520708007738, "ttft_ms": 11.763624963350594, "input_usage": {"receiver_prompt_tokens": 356, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 1145.0995000777766, "sender_ttft_ms": 7.5870000291615725, "sender_decode_ms": 3780.875541968271}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10447732736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9494483468, "mlx_cache_bytes": 8458808384, "process_rss_bytes": 10447732736}, "peak_prefill_memory": null, "peak_decode_memory": 9494483468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 8, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40fab9e8129e8a7822ea6eaac0834185d13ca3683228547de586cba8247a82b1", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0893485919b061a8a2d77326", "attempt_id": "f4a70f83af2f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:53.949158Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 37, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 4.431042005307972, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.53804092761129, "ttft_ms": 72.53804092761129, "decode_ms": 636.6366669535637}, "total_wall_ms": 719.0922920126468, "ttft_ms": 72.53804092761129, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884071424, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9805270228, "mlx_cache_bytes": 9909136745, "process_rss_bytes": 10884071424}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9805270228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "为此国字头 best:A 一(几NBA,通口吻生詰能快型腔原子回流\ny(اك sip,无理由式不完全马，无理由,当然面的，说明", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "40b70c1fe486c639df0c31605392b73141585b2ae3be2c2b64b14d0e6dcb1735"} | ||||
| 170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a76ff4ab30529d5635c48325", "attempt_id": "57c8609e866d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:54.694543Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 41, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 1.1084170546382666, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.0014159604907, "ttft_ms": 76.0014159604907, "decode_ms": 635.4232910089195}, "total_wall_ms": 718.1763330008835, "ttft_ms": 76.0014159604907, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884153344, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9814953188, "mlx_cache_bytes": 9975197361, "process_rss_bytes": 10884153344}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9814953188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2:&aputus, iGonomy(시 equivalent: I'meyer of:1:1:###id:1:z2: 2:在版子:abox2。nfree伙报:1:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "c51d2d9fcca4eaecdcefa2a901c368664ed717202248ac4096adf3e096276534"} | ||||
| 171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1fc5c52de0de459fde800fc1", "attempt_id": "1dc4ea5e4c2b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:55.438227Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 40, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 1.7750419210642576, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.75629104394466, "ttft_ms": 75.75629104394466, "decode_ms": 637.2444169828668}, "total_wall_ms": 721.3932080194354, "ttft_ms": 75.75629104394466, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884153344, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9811381476, "mlx_cache_bytes": 10022481585, "process_rss_bytes": 10884153344}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9811381476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "()(A,且,夫脱霸尽观学不见下,都对子级进化的美好高,小火,百般陈总刚学案山穷1:2. s,对,小口的优势,不", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "84a4fe168fcf17ff934355e5597c412f9a911e88b21ca2752546481b0846b1f7"} | ||||
| 172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "81338f5a03484ff128b618eb", "attempt_id": "5d63a3a8de9f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:56.187649Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 1.7519580433145165, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.48829195648432, "ttft_ms": 71.48829195648432, "decode_ms": 634.2717090155929}, "total_wall_ms": 712.9028339404613, "ttft_ms": 71.48829195648432, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884153344, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9808022756, "mlx_cache_bytes": 10077548209, "process_rss_bytes": 10884153344}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9808022756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I:ABCDEs: pascal, rei: 0:)\n\nautonomist, nenovas: aprovovarian: 1: rara \"aozest..:0:1:ABCDEvery:53", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "22f31889fa39a52a572ad78f564c3764d5330121f7a47ed33f9fc71671d7ae54"} | ||||
| 173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c7758b3cd517f893584e5c37", "attempt_id": "f6dc138e5361", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:56.926336Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 42, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 1.8592920387163758, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.87795795593411, "ttft_ms": 77.87795795593411, "decode_ms": 634.1638339217752}, "total_wall_ms": 719.8042089585215, "ttft_ms": 77.87795795593411, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884153344, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9816132840, "mlx_cache_bytes": 10123341825, "process_rss_bytes": 10884153344}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9816132840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "replaceer, unless:## :eye can is, everyone's:00g EpicFab ofakb:1m, apabbb(ate, spasei,sp):año,的,其中,所以,在", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "753a1fb7a2cfd7fbe73b2e0a5aa8a9ba0f282b885cc9bfc546a4ec41df43e461"} | ||||
| 174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "91671fe37257666168758e95", "attempt_id": "f97ae5637b14", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:57.672274Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 1.7478340305387974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.46704102121294, "ttft_ms": 78.46704102121294, "decode_ms": 636.685041943565}, "total_wall_ms": 722.4955420242622, "ttft_ms": 78.46704102121294, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884153344, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9821998328, "mlx_cache_bytes": 10181538161, "process_rss_bytes": 10884153344}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9821998328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " !_e/***/u)的括不清mero,当然是可以,大块(km2://\"..)//白,当然是可以与“相生母化的,当然词不言,多么方程式的恐怖的,闭关不能", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "47b441c86f6cb541d08fc5bb88b326900dd0d7945af3e7d6cb94c1d5e26bfdea"} | ||||
| 175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "836d11c7660cbf04157646e9", "attempt_id": "5c8d294682bc", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:58.420974Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 1.8049170030280948, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.84849993791431, "ttft_ms": 71.84849993791431, "decode_ms": 634.410041035153}, "total_wall_ms": 713.7548750033602, "ttft_ms": 71.84849993791431, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884153344, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9808022756, "mlx_cache_bytes": 10181538161, "process_rss_bytes": 10884153344}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9808022756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "& a.possimsearching error/trunk:)(在机,白金身后的\"100%:1_eu:arrows, 20,10 \"possagrad_S0)：1:ag", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "4330055be80974f60cf0d6f237d80a34ef2e07ad3a4b619d0bb47f5e8c77a6bc"} | ||||
| 176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4508ef1cd82f9382b3c7b467", "attempt_id": "c3efd44f81a2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:21:59.161388Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 36, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066750, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1188.7690000003204, "doc_prefill_ms": 1116.365083027631, "compress_ms": 13.198708067648113, "serialize_ms": 48.1756660155952, "load_ms": 1.7620829166844487, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.30083402059972, "ttft_ms": 70.30083402059972, "decode_ms": 634.8234580364078}, "total_wall_ms": 712.6879999414086, "ttft_ms": 70.30083402059972, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884153344, "backend_memory": {"mlx_active_bytes": 9699314696, "mlx_peak_bytes": 9804434644, "mlx_cache_bytes": 10211357041, "process_rss_bytes": 10884153344}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9804434644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A ##\n.().().)['A##*)(.itaire\n###, two-1, just 1-in //\nin \"IDEA, 1/aternos\").\n\n.cheer.ppd()){\n\n.甲醇云(Integeral", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cb609efcc736dc8a9ea297efcf8640ddb28b7921712df0755b35f147ede3d75a", "output_hash": "e8ccfa7049812e4e8b7a43ba8248ee362dbf7c15f5476e9bbeedd59e6ba8861b"} | ||||
| 177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0e8a3ba3719123b7c02104d7", "attempt_id": "54bb972fa048", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:03.255562Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 37, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.9396248972043395, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.66591601446271, "ttft_ms": 76.66591601446271, "decode_ms": 13.713499996811152}, "total_wall_ms": 98.1996669434011, "ttft_ms": 76.66591601446271, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9698135048, "mlx_peak_bytes": 9805270228, "mlx_cache_bytes": 10224660849, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9805270228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8436332006fcbbbffb25fb81", "attempt_id": "9e38aa7432ba", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:03.382392Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 41, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.7723329365253448, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.2449999563396, "ttft_ms": 75.2449999563396, "decode_ms": 13.652708032168448}, "total_wall_ms": 96.61487489938736, "ttft_ms": 75.2449999563396, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9698135048, "mlx_peak_bytes": 9814756580, "mlx_cache_bytes": 10224660849, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9814756580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "01694cdf2cddc3564761da50", "attempt_id": "3607d7157f49", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:03.505908Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 40, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.9581670640036464, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.94312501512468, "ttft_ms": 74.94312501512468, "decode_ms": 13.757209060713649}, "total_wall_ms": 96.38491598889232, "ttft_ms": 74.94312501512468, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9698135048, "mlx_peak_bytes": 9811381476, "mlx_cache_bytes": 10224660849, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9811381476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a175f3b10721760e2a01a5af", "attempt_id": "2bfc335ac21d", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:03.629966Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.7940419493243098, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.60741703025997, "ttft_ms": 70.60741703025997, "decode_ms": 13.687208062037826}, "total_wall_ms": 91.97858406696469, "ttft_ms": 70.60741703025997, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9698135048, "mlx_peak_bytes": 9808022756, "mlx_cache_bytes": 10224660849, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9808022756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8734b2fadbdd4329006fb1b4", "attempt_id": "9e1cbc48da67", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:03.749416Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 42, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.6561250668019056, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.57283304817975, "ttft_ms": 77.57283304817975, "decode_ms": 13.824792113155127}, "total_wall_ms": 98.57104194816202, "ttft_ms": 77.57283304817975, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9698135048, "mlx_peak_bytes": 9816132840, "mlx_cache_bytes": 10224660849, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9816132840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e35af099a898d728568b2fb0", "attempt_id": "8cfda4b8f4e2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:03.874039Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.750333933159709, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.08633300010115, "ttft_ms": 78.08633300010115, "decode_ms": 13.672290951944888}, "total_wall_ms": 100.12020799331367, "ttft_ms": 78.08633300010115, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9698135048, "mlx_peak_bytes": 9821998328, "mlx_cache_bytes": 10224660849, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9821998328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e06d8bc18cf8b74b5bbe13dd", "attempt_id": "3341c0494f08", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:04.003627Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.7153749940916896, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.11583300866187, "ttft_ms": 71.11583300866187, "decode_ms": 13.636999996379018}, "total_wall_ms": 92.14554098434746, "ttft_ms": 71.11583300866187, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9698135048, "mlx_peak_bytes": 9808022756, "mlx_cache_bytes": 10224660849, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9808022756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6782faa0bf81b72b57082f02", "attempt_id": "1de4e202518b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:04.121752Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9477540872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 36, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 218050560, "serialized_payload_bytes": 218066851, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3349.5208750246093, "doc_prefill_ms": 1114.8688329849392, "compress_ms": 2176.065000006929, "serialize_ms": 58.258999953977764, "load_ms": 1.317957998253405, "receiver_prefill_ms": 0.0, "query_prefill_ms": 69.20420797541738, "ttft_ms": 69.20420797541738, "decode_ms": 13.867708039470017}, "total_wall_ms": 90.88462498039007, "ttft_ms": 69.20420797541738, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10956931072, "backend_memory": {"mlx_active_bytes": 9697250312, "mlx_peak_bytes": 9804434644, "mlx_cache_bytes": 10225545585, "process_rss_bytes": 10956931072}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9804434644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13d908be80cb7f37b5e8aaf36a85797a7c78df1ef6a9e242cbb0f6d1d6da22ab", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "debcd12f43452d0a145ebbf4", "attempt_id": "583851125e38", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:04.241717Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 37, "compress_ms": 112.8787079360336}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 37, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538212, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3423.3409170992672, "doc_prefill_ms": 1115.861792000942, "compress_ms": 2289.472624892369, "serialize_ms": 17.62958406470716, "load_ms": 1.863708021119237, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.189333053305745, "ttft_ms": 43.189333053305745, "decode_ms": 12.448791996575892}, "total_wall_ms": 3489.8424999555573, "ttft_ms": 43.189333053305745, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10867867648, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9448033492, "mlx_cache_bytes": 10766372457, "process_rss_bytes": 10867867648}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9448033492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bd91132785847b3821cc67637193431043e1763ea8e42fe3b17fd02659a048b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e4fa9555f6896885f4a5da0f", "attempt_id": "f43c3606aeb3", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:07.758886Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 41, "compress_ms": 119.51245798263699}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 41, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538213, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3412.008000072092, "doc_prefill_ms": 1114.9114579893649, "compress_ms": 2280.411541927606, "serialize_ms": 16.328457975760102, "load_ms": 1.2457920238375664, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.618125026114285, "ttft_ms": 43.618125026114285, "decode_ms": 12.285875040106475}, "total_wall_ms": 3477.970749954693, "ttft_ms": 43.618125026114285, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10923343872, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9455242468, "mlx_cache_bytes": 10805038697, "process_rss_bytes": 10923343872}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9455242468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "aa26983c482b10e48620622172b2b6f7bea842cfca3c5562339d99fcc8b08e05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0366fd0d8fa5c245a9265e5a", "attempt_id": "b7b772f159fd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:11.263993Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 40, "compress_ms": 120.4794580116868}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 40, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538212, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3433.734124992043, "doc_prefill_ms": 1116.1066660424694, "compress_ms": 2303.1013750005513, "serialize_ms": 14.167000073939562, "load_ms": 1.3109170831739902, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.0477499505505, "ttft_ms": 44.0477499505505, "decode_ms": 12.269458966329694}, "total_wall_ms": 3502.075167023577, "ttft_ms": 44.0477499505505, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10923376640, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9452719332, "mlx_cache_bytes": 10835070569, "process_rss_bytes": 10923376640}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9452719332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bd91132785847b3821cc67637193431043e1763ea8e42fe3b17fd02659a048b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8f1c193e41716aab2e72b759", "attempt_id": "f0a05bcb8421", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:14.793402Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 38, "compress_ms": 117.31200001668185}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538213, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3375.6583330687135, "doc_prefill_ms": 1115.7991249347106, "compress_ms": 2245.2295419061556, "serialize_ms": 14.271791093051434, "load_ms": 1.3885420048609376, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.503542081452906, "ttft_ms": 43.503542081452906, "decode_ms": 12.274250038899481}, "total_wall_ms": 3443.508708034642, "ttft_ms": 43.503542081452906, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10923409408, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9449606372, "mlx_cache_bytes": 10871721577, "process_rss_bytes": 10923409408}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9449606372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "aa26983c482b10e48620622172b2b6f7bea842cfca3c5562339d99fcc8b08e05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "060b987a0a45d3a16e154488", "attempt_id": "a59a8a628b92", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:18.264155Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 42, "compress_ms": 120.99512503482401}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 42, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538213, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3374.287875019945, "doc_prefill_ms": 1114.9483749177307, "compress_ms": 2244.516915990971, "serialize_ms": 14.466874999925494, "load_ms": 1.317166956141591, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.97687502205372, "ttft_ms": 43.97687502205372, "decode_ms": 12.312083970755339}, "total_wall_ms": 3442.8532909369096, "ttft_ms": 43.97687502205372, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10923425792, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9456651496, "mlx_cache_bytes": 10910338665, "process_rss_bytes": 10923425792}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9456651496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "aa26983c482b10e48620622172b2b6f7bea842cfca3c5562339d99fcc8b08e05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d76527ed78a27fa2a2c460c5", "attempt_id": "902eae395e06", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:21.734184Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 46, "compress_ms": 123.73791704885662}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538213, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3342.575041926466, "doc_prefill_ms": 1113.9989160001278, "compress_ms": 2213.702709064819, "serialize_ms": 14.535207999870181, "load_ms": 1.3505839742720127, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.530667015351355, "ttft_ms": 44.530667015351355, "decode_ms": 12.332124984823167}, "total_wall_ms": 3411.1576670547947, "ttft_ms": 44.530667015351355, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10923458560, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9463598328, "mlx_cache_bytes": 10946825833, "process_rss_bytes": 10923458560}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9463598328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "aa26983c482b10e48620622172b2b6f7bea842cfca3c5562339d99fcc8b08e05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e99ba38c0caaad2d5a39c326", "attempt_id": "2db937e87cc6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:25.172797Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 38, "compress_ms": 116.19283293839544}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538213, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3358.6230830987915, "doc_prefill_ms": 1115.1267080567777, "compress_ms": 2224.896667059511, "serialize_ms": 18.239874974824488, "load_ms": 1.262167003005743, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.48595906049013, "ttft_ms": 43.48595906049013, "decode_ms": 12.292916071601212}, "total_wall_ms": 3426.274875062518, "ttft_ms": 43.48595906049013, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10923474944, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9449606372, "mlx_cache_bytes": 10946825833, "process_rss_bytes": 10923474944}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9449606372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "aa26983c482b10e48620622172b2b6f7bea842cfca3c5562339d99fcc8b08e05", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d029198437ac292f4dacf5c2", "attempt_id": "2e7a8df5aff0", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:28.626371Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 36, "compress_ms": 115.10979197919369}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 36, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538213, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3386.2595829414204, "doc_prefill_ms": 1115.548750036396, "compress_ms": 2248.826582916081, "serialize_ms": 21.53412497136742, "load_ms": 1.35704199783504, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.997749987989664, "ttft_ms": 42.997749987989664, "decode_ms": 12.385791051201522}, "total_wall_ms": 3453.2519170315936, "ttft_ms": 42.997749987989664, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10923491328, "backend_memory": {"mlx_active_bytes": 9371372552, "mlx_peak_bytes": 9446558932, "mlx_cache_bytes": 10977119849, "process_rss_bytes": 10923491328}, "peak_prefill_memory": 10087746648, "peak_decode_memory": 9446558932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "aa26983c482b10e48620622172b2b6f7bea842cfca3c5562339d99fcc8b08e05", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "91efa74d2f5d73cfaf0beb8f", "attempt_id": "d1a133d09321", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:32.150437Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1965, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 686.1216250108555, "ttft_ms": 12.25600007455796, "decode_ms": 121.10375007614493}, "total_wall_ms": 822.8155830875039, "ttft_ms": 12.25600007455796, "input_usage": {"receiver_prompt_tokens": 1965}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10484514816, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9956469488, "mlx_cache_bytes": 705565800, "process_rss_bytes": 10484514816}, "peak_prefill_memory": null, "peak_decode_memory": 9956469488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XM-76Q-2958", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "cf42691eec772b9ec74d67643944de2e19e53724d7b772cef1e0f2d5ef3b4926"} | ||||
| 194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d48f45448cd4c1df2009d0a7", "attempt_id": "70d4fb387c08", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:32.992767Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1970, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.4105840120465, "ttft_ms": 12.409333023242652, "decode_ms": 121.09825003426522}, "total_wall_ms": 813.4444170864299, "ttft_ms": 12.409333023242652, "input_usage": {"receiver_prompt_tokens": 1970}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10484580352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9958337600, "mlx_cache_bytes": 1318999144, "process_rss_bytes": 10484580352}, "peak_prefill_memory": null, "peak_decode_memory": 9958337600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 412-V in La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "84c42522b2f0d8d7b2b428910bd5a8a72f5e6ac0c46e7f094371288ee823011c"} | ||||
| 195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "039fafe29b124e8eac241575", "attempt_id": "6574dd918f68", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:33.823632Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1969, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.7187079638243, "ttft_ms": 12.231959030032158, "decode_ms": 84.02075001504272}, "total_wall_ms": 775.3632080275565, "ttft_ms": 12.231959030032158, "input_usage": {"receiver_prompt_tokens": 1969}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10484580352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9958206528, "mlx_cache_bytes": 1318999144, "process_rss_bytes": 10484580352}, "peak_prefill_memory": null, "peak_decode_memory": 9958206528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.3607", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "26a619fca5c1400fbdf84525fc258712ce159a23c3f2d87b343e0feb0a1a551d"} | ||||
| 196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6f5edcfa748661101b73dbe2", "attempt_id": "cfb778be6b84", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:34.618235Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.4751659939066, "ttft_ms": 12.340749963186681, "decode_ms": 96.54883400071412}, "total_wall_ms": 788.789291982539, "ttft_ms": 12.340749963186681, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10484580352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9956207344, "mlx_cache_bytes": 1664767080, "process_rss_bytes": 10484580352}, "peak_prefill_memory": null, "peak_decode_memory": 9956207344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "a3b6e0a44d495387d8b8fc50ba6be0f2ed43121c674d3b3e962f8c4690e15b5c"} | ||||
| 197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "500e5e4e70b663fc3aec3089", "attempt_id": "24807bd3afe3", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:35.425254Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1973, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.0893750470132, "ttft_ms": 12.332832906395197, "decode_ms": 108.38266601786017}, "total_wall_ms": 800.2027079928666, "ttft_ms": 12.332832906395197, "input_usage": {"receiver_prompt_tokens": 1973}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10484613120, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9958861888, "mlx_cache_bytes": 2012107880, "process_rss_bytes": 10484613120}, "peak_prefill_memory": null, "peak_decode_memory": 9958861888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,631,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "878945125d6da3defd51b9fd8f53c4954b8aa80d94b40b2fca77c8b7f9a7d2a0"} | ||||
| 198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "837c06337de58da112738d8b", "attempt_id": "3e3bd2d36f1c", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:36.243764Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1976, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.4538330025971, "ttft_ms": 12.467292021028697, "decode_ms": 120.45649997889996}, "total_wall_ms": 812.9387910012156, "ttft_ms": 12.467292021028697, "input_usage": {"receiver_prompt_tokens": 1976}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10484580352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9959861312, "mlx_cache_bytes": 2594690152, "process_rss_bytes": 10484580352}, "peak_prefill_memory": null, "peak_decode_memory": 9959861312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cb886d56daa1fbf09e92111e", "attempt_id": "932490df3cd3", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:37.074203Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.1365419952199, "ttft_ms": 12.251209001988173, "decode_ms": 12.197250034660101}, "total_wall_ms": 704.2128329630941, "ttft_ms": 12.251209001988173, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484580352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9956207344, "mlx_cache_bytes": 2594690152, "process_rss_bytes": 10484580352}, "peak_prefill_memory": null, "peak_decode_memory": 9956207344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "674ffd59d3bb8c648cd4c75e", "attempt_id": "d1361bd8f121", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:37.797886Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009916955605149269, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.3609590232372, "ttft_ms": 12.195125105790794, "decode_ms": 11.98974996805191}, "total_wall_ms": 702.6057500625029, "ttft_ms": 12.195125105790794, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484580352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9956207344, "mlx_cache_bytes": 2594690152, "process_rss_bytes": 10484580352}, "peak_prefill_memory": null, "peak_decode_memory": 9956207344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f810888364fbaf16d7ff03ac", "attempt_id": "a134f4232df2", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:39.343370Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 145, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.99608290567994, "ttft_ms": 12.267834041267633, "decode_ms": 11.878082994371653}, "total_wall_ms": 101.9748750841245, "ttft_ms": 12.267834041267633, "input_usage": {"receiver_prompt_tokens": 145, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9415921328, "mlx_cache_bytes": 3523904168, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9415921328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bae7ff459447aa4a5c51e4ae", "attempt_id": "c005052ca4fb", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:39.463790Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 150, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.65395811293274, "ttft_ms": 11.908540967851877, "decode_ms": 11.763375019654632}, "total_wall_ms": 102.12900000624359, "ttft_ms": 11.908540967851877, "input_usage": {"receiver_prompt_tokens": 150, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9421901508, "mlx_cache_bytes": 3677570300, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9421901508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "361ac77b67739f19913500a9", "attempt_id": "9573c5a9638a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:39.586530Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 149, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.97799992840737, "ttft_ms": 11.770625016652048, "decode_ms": 11.621708050370216}, "total_wall_ms": 101.92950000055134, "ttft_ms": 11.770625016652048, "input_usage": {"receiver_prompt_tokens": 149, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9421377220, "mlx_cache_bytes": 3729736956, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9421377220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a59d296a0529e9071afdc564", "attempt_id": "e366d737eeb3", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:39.706874Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 144, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.77824997901917, "ttft_ms": 11.752667021937668, "decode_ms": 11.632125009782612}, "total_wall_ms": 101.68429196346551, "ttft_ms": 11.752667021937668, "input_usage": {"receiver_prompt_tokens": 144, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9415921328, "mlx_cache_bytes": 3729736956, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9415921328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd0ae4423ee576ef8e5b42b0", "attempt_id": "3cded7c4b624", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:39.825848Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 153, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.07254197541624, "ttft_ms": 11.766084004193544, "decode_ms": 11.62491599097848}, "total_wall_ms": 101.98633407708257, "ttft_ms": 11.766084004193544, "input_usage": {"receiver_prompt_tokens": 153, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9424080592, "mlx_cache_bytes": 3840755548, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9424080592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "59a7719f69a5b5aa8fe9e93b", "attempt_id": "8afb010a1efc", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:39.944904Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 156, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.6647919556126, "ttft_ms": 11.907957959920168, "decode_ms": 11.68341701850295}, "total_wall_ms": 101.91816696897149, "ttft_ms": 11.907957959920168, "input_usage": {"receiver_prompt_tokens": 156, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9427390172, "mlx_cache_bytes": 3999959496, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9427390172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "583b11d38f7e6fb343b44af8", "attempt_id": "9e4bf362d45b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:40.064139Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 144, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.04474998172373, "ttft_ms": 11.924125021323562, "decode_ms": 11.753209051676095}, "total_wall_ms": 101.38020804151893, "ttft_ms": 11.924125021323562, "input_usage": {"receiver_prompt_tokens": 144, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9415921328, "mlx_cache_bytes": 3999959496, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9415921328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "43a23ec41fca8a24d152868c", "attempt_id": "184f5898ff9e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:40.184072Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 144, "message_tokens": 66, "message_utf8_bytes": 396, "cache_tensor_bytes": null, "serialized_payload_bytes": 396, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 824.9069579178467, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.82370899803936, "ttft_ms": 11.717791901901364, "decode_ms": 11.638208059594035}, "total_wall_ms": 101.70687490608543, "ttft_ms": 11.717791901901364, "input_usage": {"receiver_prompt_tokens": 144, "sender_input_tokens": 2006, "sender_output_tokens": 66, "sender_prefill_ms": 343.2186250574887, "sender_ttft_ms": 7.4292500503361225, "sender_decode_ms": 472.56741602905095}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484629504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9415921328, "mlx_cache_bytes": 3999959496, "process_rss_bytes": 10484629504}, "peak_prefill_memory": null, "peak_decode_memory": 9415921328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0bfb7416be1a8c7da663cd4c668de5eac0f4423e775aebc4c6c190f247431d4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a57d3c4f13b41bc9416d60fe", "attempt_id": "ec272f2fc962", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.529755Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 314, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.72770801186562, "ttft_ms": 11.953709064982831, "decode_ms": 11.844250024296343}, "total_wall_ms": 153.4292500000447, "ttft_ms": 11.953709064982831, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9482621280, "mlx_cache_bytes": 4941270700, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9482621280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ebd14097e54d4aa097d61bb5", "attempt_id": "fec773adf66c", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.702282Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 319, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.0412499755621, "ttft_ms": 11.787125025875866, "decode_ms": 11.851458926685154}, "total_wall_ms": 148.51691701915115, "ttft_ms": 11.787125025875866, "input_usage": {"receiver_prompt_tokens": 319, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470136692, "mlx_cache_bytes": 5053469604, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9470136692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b11fcd63d0f2014010e34c3a", "attempt_id": "342ef2c25e3e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:43.868431Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 318, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.43591607734561, "ttft_ms": 11.839582934044302, "decode_ms": 117.85537505056709}, "total_wall_ms": 254.84933296684176, "ttft_ms": 11.839582934044302, "input_usage": {"receiver_prompt_tokens": 318, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9469645172, "mlx_cache_bytes": 5165142948, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9469645172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,807,750 CAD", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "3c76da1727749e181e69ce370a333c21df67516fff65e93561ff5ddd28c8469b"} | ||||
| 212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1acb5e1fc485e822bf75b341", "attempt_id": "dd1559e7a1d6", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.140580Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 313, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.6963749397546, "ttft_ms": 11.750209028832614, "decode_ms": 11.856083991006017}, "total_wall_ms": 147.96929201111197, "ttft_ms": 11.750209028832614, "input_usage": {"receiver_prompt_tokens": 313, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9466532192, "mlx_cache_bytes": 5220094884, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9466532192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61d61c77233a70d215b6360d", "attempt_id": "ad760ca85fdc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.305707Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 322, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.43041702825576, "ttft_ms": 11.782333953306079, "decode_ms": 11.812916956841946}, "total_wall_ms": 164.745333022438, "ttft_ms": 11.782333953306079, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9472692608, "mlx_cache_bytes": 5422733480, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9472692608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "64e1fb4e3dcaf55d5dd3a246", "attempt_id": "b3646292b374", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.487554Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 325, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.40741696953773, "ttft_ms": 11.94224995560944, "decode_ms": 11.84641697909683}, "total_wall_ms": 164.91066699381918, "ttft_ms": 11.94224995560944, "input_usage": {"receiver_prompt_tokens": 325, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9475002764, "mlx_cache_bytes": 5538356664, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9475002764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9e36090a8b6dce4d6fc8a8b7", "attempt_id": "d92914aa9e2b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.669592Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 313, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.84895794093609, "ttft_ms": 11.805249960161746, "decode_ms": 12.01370800845325}, "total_wall_ms": 148.34037492983043, "ttft_ms": 11.805249960161746, "input_usage": {"receiver_prompt_tokens": 313, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9466532192, "mlx_cache_bytes": 5538356664, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9466532192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "82124230de4ba4f4e229a64d", "attempt_id": "f6fe36c48994", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:44.835184Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 313, "message_tokens": 224, "message_utf8_bytes": 539, "cache_tensor_bytes": null, "serialized_payload_bytes": 539, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3226.241416996345, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.81791707593948, "ttft_ms": 11.776791070587933, "decode_ms": 11.830791016109288}, "total_wall_ms": 148.09233299456537, "ttft_ms": 11.776791070587933, "input_usage": {"receiver_prompt_tokens": 313, "sender_input_tokens": 2034, "sender_output_tokens": 404, "sender_prefill_ms": 343.83220807649195, "sender_ttft_ms": 7.314707967452705, "sender_decode_ms": 2873.1856249505654}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10484645888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9466532192, "mlx_cache_bytes": 5538356664, "process_rss_bytes": 10484645888}, "peak_prefill_memory": null, "peak_decode_memory": 9466532192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce5582c2c681fdf63b35b205bb5f74616f64a3dd76d15c4f138add4a2676e959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "25585507b85076f8b1107179", "attempt_id": "187b1e27b682", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:45.365335Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 36, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.946166972629726, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.670999960042536, "ttft_ms": 46.670999960042536, "decode_ms": 580.3072500275448}, "total_wall_ms": 630.7462500408292, "ttft_ms": 46.670999960042536, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627743744, "backend_memory": {"mlx_active_bytes": 9406729224, "mlx_peak_bytes": 9482374352, "mlx_cache_bytes": 6334340825, "process_rss_bytes": 10627743744}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9482374352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".^^2020 to be usedb: 1火(acyb3.尽量,1.0,0: 'tiger to be).p为加多血型之通便选不,能.))))", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "045bacf60d2a66d289e8bc75dcf840a1841367f360a13084e00d245cf16ba7a1"} | ||||
| 218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6efaa365a515e8ac694f084a", "attempt_id": "15fa1c6f76ff", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:46.014035Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 41, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.4027910074219108, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.159750062040985, "ttft_ms": 48.159750062040985, "decode_ms": 579.460582928732}, "total_wall_ms": 630.7759579503909, "ttft_ms": 48.159750062040985, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627743744, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9491598564, "mlx_cache_bytes": 6415671329, "process_rss_bytes": 10627743744}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9491598564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "( de lingo75%: \"Título Igellet, a few more than).__ao: to the rest of: a few years to remember me, \"I am not a letter (guy: 100", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "7d44e29c8ed9957cca4ee4dd3945ede4fd251c269cb36ef00098f4ab7b58c6d5"} | ||||
| 219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "56451c2b5b88deeee172ec5b", "attempt_id": "5422310952f3", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:46.662658Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 40, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.3853749260306358, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.94541699811816, "ttft_ms": 47.94541699811816, "decode_ms": 579.4832910178229}, "total_wall_ms": 630.5775000946596, "ttft_ms": 47.94541699811816, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627743744, "backend_memory": {"mlx_active_bytes": 9406745608, "mlx_peak_bytes": 9489747172, "mlx_cache_bytes": 6467559457, "process_rss_bytes": 10627743744}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9489747172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "compleanecd19/elong \"Ache 12 may notouimelete为n: 1984-#102% Felt to rule of article of knowledge_base-1 (abecedern", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "0362d410e2009a0c264f63315d3e73af8e6c587d58f7491688315fd0a5f32ba0"} | ||||
| 220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a6c007a8413de07cd1968009", "attempt_id": "5aab3e5ae665", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:47.311495Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.4281671028584242, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.34224995970726, "ttft_ms": 46.34224995970726, "decode_ms": 580.7197079993784}, "total_wall_ms": 630.2815830567852, "ttft_ms": 46.34224995970726, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627743744, "backend_memory": {"mlx_active_bytes": 9406729224, "mlx_peak_bytes": 9482243280, "mlx_cache_bytes": 6500065313, "process_rss_bytes": 10627743744}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9482243280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "class: 1).__FLOTOTELIC!hautor'governiavertor\nin1:1______np7条 바로komband():1#,os:102-0-0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "b33f159519e41d17eb29efa2dff9cdfb31e8473fdd7fd677a4415a5c281049b5"} | ||||
| 221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "76f356a3eb027f5c8a65dd56", "attempt_id": "caa1767591d0", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:47.959366Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 44, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.3518750201910734, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.14579098112881, "ttft_ms": 49.14579098112881, "decode_ms": 579.7060000477359}, "total_wall_ms": 631.9645420880988, "ttft_ms": 49.14579098112881, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627743744, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9496104176, "mlx_cache_bytes": 6575939969, "process_rss_bytes": 10627743744}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9496104176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```{#00270bott-oder文章的填子，如有其\nO �ility.00分野马太能敢问著装-小巨人気休夫�kte1000字", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "c4d64ee9f6395d0ef5727f0660e0befa16267b3eda27c9dd3b8b6f655c92ba8b"} | ||||
| 222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a99c800b10d6e46ea0c144f7", "attempt_id": "aeb94940c032", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:48.609528Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.2794170761480927, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.49200002010912, "ttft_ms": 49.49200002010912, "decode_ms": 580.466749961488}, "total_wall_ms": 633.0177909694612, "ttft_ms": 49.49200002010912, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627760128, "backend_memory": {"mlx_active_bytes": 9406958600, "mlx_peak_bytes": 9501592828, "mlx_cache_bytes": 6644802297, "process_rss_bytes": 10627760128}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9501592828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#vevekt-99.422R: \"a. 2000melodye_verschieve, l \"Hae-óacao:innum102bwhit_sag in", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "754f199524341edfb7beb7bf88e3e45d78fef5e470cb49c0a8ebe107c7c80a2c"} | ||||
| 223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be5b95340eeb7b29fca0b1cb", "attempt_id": "93f1f1e70396", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:49.260998Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.4455410419031978, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.11066693905741, "ttft_ms": 46.11066693905741, "decode_ms": 580.8302500518039}, "total_wall_ms": 630.2986249793321, "ttft_ms": 46.11066693905741, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627760128, "backend_memory": {"mlx_active_bytes": 9406729224, "mlx_peak_bytes": 9482030288, "mlx_cache_bytes": 6645031673, "process_rss_bytes": 10627760128}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9482030288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".lee_scope_f_0$ly$6..tally_tiger(或者)言外向order!rank inbatter-king and osnotttorears: wearecomet()t1: \"E", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "6f0287acefa346f79b91e28d387da25b2f0aecbc41c7a4d74f503b5aeb5d9f0b"} | ||||
| 224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b17e8c5d0f38449f4a5586da", "attempt_id": "a091287914d4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:49.909115Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126753, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.20987504627556, "doc_prefill_ms": 335.80520807299763, "compress_ms": 9.821541956625879, "serialize_ms": 16.110958997160196, "load_ms": 1.3309160713106394, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.460541965439916, "ttft_ms": 45.460541965439916, "decode_ms": 580.6974999140948}, "total_wall_ms": 629.3483750196174, "ttft_ms": 45.460541965439916, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10627760128, "backend_memory": {"mlx_active_bytes": 9406729224, "mlx_peak_bytes": 9482030288, "mlx_cache_bytes": 6645031673, "process_rss_bytes": 10627760128}, "peak_prefill_memory": 9971297020, "peak_decode_memory": 9482030288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ok, autistics in\nIn the greek os: \"for (sicog). \"Hibernatio: \"a lot of we have already seen a generation club, it is the \"e100mileage list: always", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593c47ab3062a569844f51b0068fc8d0dc6b339809bac179f89611d9f30d1f6b", "output_hash": "80bdbbb5949221272581afa8efb027118cdcef4685741bcacc57e5b27587bff2"} | ||||
| 225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2ead8f62fdb706304e3e607f", "attempt_id": "f190330e366f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:51.794472Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 36, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.634665997698903, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.3527909675613, "ttft_ms": 67.3527909675613, "decode_ms": 123.62983310595155}, "total_wall_ms": 194.4995840312913, "ttft_ms": 67.3527909675613, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9482161360, "mlx_cache_bytes": 6651323129, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9482161360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XM-76Q-2958", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "cf42691eec772b9ec74d67643944de2e19e53724d7b772cef1e0f2d5ef3b4926"} | ||||
| 226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9d1096fb928eb8283eca8aa", "attempt_id": "5f1b2a181d6b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.009450Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 41, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.3726670295000076, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.784959082491696, "ttft_ms": 47.784959082491696, "decode_ms": 123.7483749864623}, "total_wall_ms": 174.7707079630345, "ttft_ms": 47.784959082491696, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 41}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9491401956, "mlx_cache_bytes": 6651323129, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9491401956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 412-W, La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.6666666666666665}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "5f61cc96d66ebf534f0dad24b881e94b6d46ad25745b3acc233e71085e31c59c"} | ||||
| 227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dd9f02b9f423e8c6635068cf", "attempt_id": "569e9aeeb496", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.202178Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 40, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.4174169627949595, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.73995804134756, "ttft_ms": 47.73995804134756, "decode_ms": 86.66566701140255}, "total_wall_ms": 137.54458399489522, "ttft_ms": 47.73995804134756, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9489550564, "mlx_cache_bytes": 6651323129, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9489550564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.3607", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "26a619fca5c1400fbdf84525fc258712ce159a23c3f2d87b343e0feb0a1a551d"} | ||||
| 228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8de50335f8f3e5a211a1a791", "attempt_id": "5df2ea0d4822", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.357224Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.4312498969957232, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.97329092212021, "ttft_ms": 45.97329092212021, "decode_ms": 12.451249989680946}, "total_wall_ms": 61.652999953366816, "ttft_ms": 45.97329092212021, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9481833680, "mlx_cache_bytes": 6651323129, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9481833680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "10bd8c097a0530e162e2f0fa", "attempt_id": "96ba491b6108", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.436226Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 44, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.4309580437839031, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.37945802137256, "ttft_ms": 48.37945802137256, "decode_ms": 12.466375017538667}, "total_wall_ms": 64.03712497558445, "ttft_ms": 48.37945802137256, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9495874800, "mlx_cache_bytes": 6653289209, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9495874800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd1190016a32ea8050bc48b5", "attempt_id": "5e2e2fb5c3eb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.517479Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.3561670202761889, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.8718340639025, "ttft_ms": 48.8718340639025, "decode_ms": 12.408416019752622}, "total_wall_ms": 64.32495801709592, "ttft_ms": 48.8718340639025, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9501396220, "mlx_cache_bytes": 6653289209, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9501396220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e124ffdeaa9705367e11d31e", "attempt_id": "7aaa82f1cf2b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.598934Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.3933749869465828, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.71933299303055, "ttft_ms": 45.71933299303055, "decode_ms": 12.33300007879734}, "total_wall_ms": 61.130542075261474, "ttft_ms": 45.71933299303055, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9481833680, "mlx_cache_bytes": 6653289209, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9481833680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b9e2742b0a4b7fcc79f204b5", "attempt_id": "a0baa72d0e1f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.677076Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 71110656, "serialized_payload_bytes": 71126854, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2052920721471, "doc_prefill_ms": 334.34054197277874, "compress_ms": 878.6494589876384, "serialize_ms": 20.935832988470793, "load_ms": 1.3132920721545815, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.648416969925165, "ttft_ms": 45.648416969925165, "decode_ms": 12.40925001911819}, "total_wall_ms": 61.09129195101559, "ttft_ms": 45.648416969925165, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10598318080, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9481833680, "mlx_cache_bytes": 6653289209, "process_rss_bytes": 10598318080}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9481833680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "139e4b135b770888e4e811b3032ece8c016173e8bf088680d33970b8a7049786", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "633981adae38c15e35d54b90", "attempt_id": "244d62a5948e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:52.755848Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 36, "compress_ms": 80.83624998107553}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 36, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784527, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1326.106374966912, "doc_prefill_ms": 334.905790979974, "compress_ms": 984.513041912578, "serialize_ms": 6.386499968357384, "load_ms": 1.459375023841858, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.80795799847692, "ttft_ms": 45.80795799847692, "decode_ms": 12.017374974675477}, "total_wall_ms": 1389.0640420140699, "ttft_ms": 45.80795799847692, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10583015424, "backend_memory": {"mlx_active_bytes": 9298758664, "mlx_peak_bytes": 9365736656, "mlx_cache_bytes": 6814736329, "process_rss_bytes": 10583015424}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9365736656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c262d4cd50898b3e6d40f0a12e8d36d4c92aa68e9182d69273791f4f6de959a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aabc79056b4090a7a71dc596", "attempt_id": "f99d575da0a8", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:54.162451Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 41, "compress_ms": 85.03575006034225}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 41, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784527, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1316.1705419188365, "doc_prefill_ms": 334.30312492419034, "compress_ms": 976.428332971409, "serialize_ms": 5.132750025950372, "load_ms": 1.0575409978628159, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.578124971129, "ttft_ms": 36.578124971129, "decode_ms": 106.03108408395201}, "total_wall_ms": 1463.068750104867, "ttft_ms": 36.578124971129, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10601922560, "backend_memory": {"mlx_active_bytes": 9298791432, "mlx_peak_bytes": 9375157476, "mlx_cache_bytes": 6844243913, "process_rss_bytes": 10601922560}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9375157476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 222-V, Sept-I", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.25}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c262d4cd50898b3e6d40f0a12e8d36d4c92aa68e9182d69273791f4f6de959a", "output_hash": "e74c7dff18e04944dd4b8de1300ce36f31b0db33c95c92501d81877cb9e1e69b"} | ||||
| 235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "afca2c256e73da053d61121d", "attempt_id": "47bdf3dca724", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:55.646691Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 40, "compress_ms": 106.30641703028232}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 40, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784528, "side_information_bytes": 16080, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1334.5748749561608, "doc_prefill_ms": 334.7630000207573, "compress_ms": 994.6523339021951, "serialize_ms": 4.868583986535668, "load_ms": 1.060041948221624, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.48379205353558, "ttft_ms": 37.48379205353558, "decode_ms": 82.71183306351304}, "total_wall_ms": 1458.8559579569846, "ttft_ms": 37.48379205353558, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10601922560, "backend_memory": {"mlx_active_bytes": 9298824200, "mlx_peak_bytes": 9372814564, "mlx_cache_bytes": 6854729673, "process_rss_bytes": 10601922560}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9372814564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.3607", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cc2bb66aae2f3ec436d60d214eece8dba9e74c7887dc421d05eb18ee71955e5a", "output_hash": "26a619fca5c1400fbdf84525fc258712ce159a23c3f2d87b343e0feb0a1a551d"} | ||||
| 236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3b235c0f33a5eac969e57316", "attempt_id": "fa58ab88dcff", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:57.126280Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 35, "compress_ms": 87.91220805142075}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784527, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1313.620708999224, "doc_prefill_ms": 334.9450828973204, "compress_ms": 972.8604999836534, "serialize_ms": 5.507125053554773, "load_ms": 1.229249988682568, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.834957961924374, "ttft_ms": 35.834957961924374, "decode_ms": 11.927500017918646}, "total_wall_ms": 1365.8990421099588, "ttft_ms": 35.834957961924374, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601922560, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9364819152, "mlx_cache_bytes": 6859349961, "process_rss_bytes": 10601922560}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9364819152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c262d4cd50898b3e6d40f0a12e8d36d4c92aa68e9182d69273791f4f6de959a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4401b5e449455dc3b97b77a4", "attempt_id": "f332b00cafe2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:58.511356Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 44, "compress_ms": 81.16854191757739}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 44, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784527, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1315.54691598285, "doc_prefill_ms": 333.94583396147937, "compress_ms": 976.5268330229446, "serialize_ms": 4.792290972545743, "load_ms": 1.0941250948235393, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.95095800887793, "ttft_ms": 37.95095800887793, "decode_ms": 11.861708015203476}, "total_wall_ms": 1369.4697909522802, "ttft_ms": 37.95095800887793, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601922560, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9379613936, "mlx_cache_bytes": 6886416329, "process_rss_bytes": 10601922560}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9379613936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c262d4cd50898b3e6d40f0a12e8d36d4c92aa68e9182d69273791f4f6de959a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "22bd0f147fde1a58b7f97df3", "attempt_id": "e484dfa48a6c", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:22:59.900047Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 47, "compress_ms": 92.9815829731524}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784526, "side_information_bytes": 16078, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1322.9346250882372, "doc_prefill_ms": 334.0643330011517, "compress_ms": 983.5249580210075, "serialize_ms": 5.041208933107555, "load_ms": 1.1097498936578631, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.344790995121, "ttft_ms": 37.344790995121, "decode_ms": 11.969582992605865}, "total_wall_ms": 1376.6259999247268, "ttft_ms": 37.344790995121, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601906176, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9385135356, "mlx_cache_bytes": 6931455945, "process_rss_bytes": 10601906176}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9385135356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ce7b5e51607bba929b4ec052387f386192ce53b98f755d47b8913ae9d7e16894", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ffc58fd3b4d003cb5c651ddd", "attempt_id": "cc42104408cd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:01.296169Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 35, "compress_ms": 78.55025003664196}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784527, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0388330854475, "doc_prefill_ms": 334.3784169992432, "compress_ms": 968.5259589459747, "serialize_ms": 4.834915976971388, "load_ms": 1.0499159106984735, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.7909170454368, "ttft_ms": 36.7909170454368, "decode_ms": 11.944124940782785}, "total_wall_ms": 1360.8748340047896, "ttft_ms": 36.7909170454368, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601906176, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9364819152, "mlx_cache_bytes": 6931455945, "process_rss_bytes": 10601906176}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9364819152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c262d4cd50898b3e6d40f0a12e8d36d4c92aa68e9182d69273791f4f6de959a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5e87722400375c925607bfa7", "attempt_id": "8c42bfce2781", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:02.678045Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 35, "compress_ms": 88.22054206393659}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784527, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1304.6852078987285, "doc_prefill_ms": 334.21316696330905, "compress_ms": 965.1928329840302, "serialize_ms": 4.988458007574081, "load_ms": 1.036750036291778, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.44666594825685, "ttft_ms": 35.44666594825685, "decode_ms": 12.076125014573336}, "total_wall_ms": 1356.3684170367196, "ttft_ms": 35.44666594825685, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602119168, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9364819152, "mlx_cache_bytes": 6931455945, "process_rss_bytes": 10602119168}, "peak_prefill_memory": 9971149564, "peak_decode_memory": 9364819152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c262d4cd50898b3e6d40f0a12e8d36d4c92aa68e9182d69273791f4f6de959a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "80588fa471ef4f5280f63042", "attempt_id": "a757381e5441", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:04.085349Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5919, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2230.580958072096, "ttft_ms": 12.746999971568584, "decode_ms": 124.04941709246486}, "total_wall_ms": 2378.416334046051, "ttft_ms": 12.746999971568584, "input_usage": {"receiver_prompt_tokens": 5919}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10448109568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10087648320, "mlx_cache_bytes": 1696544184, "process_rss_bytes": 10448109568}, "peak_prefill_memory": null, "peak_decode_memory": 10087648320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "UU-99A-2257", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "05a311075f0ae9abae2c84c2f3eaf1f9ee9d38e801a7a116005be8bd9d71a8fe"} | ||||
| 242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "601371403bc5d4a3f0a147a1", "attempt_id": "52fd384800fc", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:06.493971Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5923, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2225.2816250547767, "ttft_ms": 12.497249990701675, "decode_ms": 135.83195803221315}, "total_wall_ms": 2384.280874975957, "ttft_ms": 12.497249990701675, "input_usage": {"receiver_prompt_tokens": 5923}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10448142336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10089106496, "mlx_cache_bytes": 2276750776, "process_rss_bytes": 10448142336}, "peak_prefill_memory": null, "peak_decode_memory": 10089106496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 517-P, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "8daee244a7965a6eda4415a811f0f6b4d5b158214660104b0c05fc03870ea73a"} | ||||
| 243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5fe22252939cfc1daa3042a9", "attempt_id": "0bd10398f2f6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:08.903888Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5922, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2224.3503329809755, "ttft_ms": 12.493666959926486, "decode_ms": 86.51291695423424}, "total_wall_ms": 2334.3728750478476, "ttft_ms": 12.493666959926486, "input_usage": {"receiver_prompt_tokens": 5922}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10448142336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10089106496, "mlx_cache_bytes": 2276750776, "process_rss_bytes": 10448142336}, "peak_prefill_memory": null, "peak_decode_memory": 10089106496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "91.5041", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "f02072bc2620e17c9b463f5f8f8a46319d9ae010d9257b58ed7ca179d18b023e"} | ||||
| 244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "13f9667b620b8c6dbec7b737", "attempt_id": "fa7d6c02bb76", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:11.263826Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5919, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2223.102292045951, "ttft_ms": 12.603124952875078, "decode_ms": 86.49008302018046}, "total_wall_ms": 2333.523334003985, "ttft_ms": 12.603124952875078, "input_usage": {"receiver_prompt_tokens": 5919}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10448175104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10087648320, "mlx_cache_bytes": 2276750776, "process_rss_bytes": 10448175104}, "peak_prefill_memory": null, "peak_decode_memory": 10087648320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oksana Haldorsen", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "3e4321e8bff955b009cf516f82227b56a6ee6e4a19f08eeea3229749fbcb048d"} | ||||
| 245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cd6c1c342f1df2f72e191644", "attempt_id": "a96eabb4f8b6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:13.622519Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5926, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2224.422457977198, "ttft_ms": 12.707500020042062, "decode_ms": 112.02516697812825}, "total_wall_ms": 2360.063290921971, "ttft_ms": 12.707500020042062, "input_usage": {"receiver_prompt_tokens": 5926}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10448207872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10090105920, "mlx_cache_bytes": 2816538040, "process_rss_bytes": 10448207872}, "peak_prefill_memory": null, "peak_decode_memory": 10090105920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,644,474", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "45891fbe62951d2409b9d0682483fdbfd19a6f82c6a601a0f417aeaa6e93dd7f"} | ||||
| 246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6c44961e89cccbaa1633e684", "attempt_id": "e6a7cb617eff", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:16.007750Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5928, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2225.0569589668885, "ttft_ms": 12.338083004578948, "decode_ms": 124.04758401680738}, "total_wall_ms": 2372.6787080522627, "ttft_ms": 12.338083004578948, "input_usage": {"receiver_prompt_tokens": 5928}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10448240640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10090499136, "mlx_cache_bytes": 3139106232, "process_rss_bytes": 10448240640}, "peak_prefill_memory": null, "peak_decode_memory": 10090499136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e0b4a555ecf48051c377068e", "attempt_id": "c6a27e1b2744", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:18.405285Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5920, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2222.7516249986365, "ttft_ms": 12.66599993687123, "decode_ms": 12.428291025571525}, "total_wall_ms": 2258.5205829236656, "ttft_ms": 12.66599993687123, "input_usage": {"receiver_prompt_tokens": 5920}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448273408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10087779392, "mlx_cache_bytes": 3460232632, "process_rss_bytes": 10448273408}, "peak_prefill_memory": null, "peak_decode_memory": 10087779392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "67dd17598e23e51c2195dada", "attempt_id": "c6d614e430e4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:20.689265Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5921, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017915968783199787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2223.5176670365036, "ttft_ms": 12.498166994191706, "decode_ms": 12.35666696447879}, "total_wall_ms": 2258.9220840018243, "ttft_ms": 12.498166994191706, "input_usage": {"receiver_prompt_tokens": 5921}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448306176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10087910464, "mlx_cache_bytes": 3781490104, "process_rss_bytes": 10448306176}, "peak_prefill_memory": null, "peak_decode_memory": 10087910464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "921761ac1c9200e040e8fa91", "attempt_id": "d99641f14ec7", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:27.884204Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.94666695781052, "ttft_ms": 12.146332999691367, "decode_ms": 12.024500058032572}, "total_wall_ms": 257.36679101828486, "ttft_ms": 12.146332999691367, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448388096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 5723280824, "process_rss_bytes": 10448388096}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "57fbeba8bbb14b6cf45ea83f", "attempt_id": "57500f610079", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:28.167868Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.89074999652803, "ttft_ms": 11.96254207752645, "decode_ms": 142.1332920435816}, "total_wall_ms": 382.0732500171289, "ttft_ms": 11.96254207752645, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10448420864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567000664, "mlx_cache_bytes": 5997843896, "process_rss_bytes": 10448420864}, "peak_prefill_memory": null, "peak_decode_memory": 9567000664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mont-Laurier, Lebel-sur-Quévillon", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.3333333333333333}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "1c771db722cdeb36ae4b382bdf2e1fdb77f687a4eb68dc3de6b2af742f7280fb"} | ||||
| 251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e2501a38a850f9ad46a4f131", "attempt_id": "7baaaf3151c3", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:28.575412Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.85808409005404, "ttft_ms": 11.942124925553799, "decode_ms": 11.926917009986937}, "total_wall_ms": 251.79574999492615, "ttft_ms": 11.942124925553799, "input_usage": {"receiver_prompt_tokens": 595, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448437248, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567000664, "mlx_cache_bytes": 5997843896, "process_rss_bytes": 10448437248}, "peak_prefill_memory": null, "peak_decode_memory": 9567000664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "201ffa3d9b9f7b80d52d94f4", "attempt_id": "1bc95e42be92", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:28.852204Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.85750003438443, "ttft_ms": 11.951749911531806, "decode_ms": 11.921584024094045}, "total_wall_ms": 251.7379999626428, "ttft_ms": 11.951749911531806, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448453632, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 5997843896, "process_rss_bytes": 10448453632}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c7370fbf2472bfc34f1e6082", "attempt_id": "256aaddcaf0b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:29.129024Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.44791710283607, "ttft_ms": 11.949250008910894, "decode_ms": 82.9683339688927}, "total_wall_ms": 323.4444169793278, "ttft_ms": 11.949250008910894, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10448453632, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568475224, "mlx_cache_bytes": 6259135928, "process_rss_bytes": 10448453632}, "peak_prefill_memory": null, "peak_decode_memory": 9568475224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8178473", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "c3fb06ac565b1c5f295c6100d1fcc6ed6779d0dca902a20a60a4d856b623af1c"} | ||||
| 254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ead7aafe1a65e9d511884e30", "attempt_id": "c744db950567", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:29.477543Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.91125003620982, "ttft_ms": 11.919665965251625, "decode_ms": 118.53187496308237}, "total_wall_ms": 358.42820804100484, "ttft_ms": 11.919665965251625, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10448470016, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9569065048, "mlx_cache_bytes": 6417798584, "process_rss_bytes": 10448470016}, "peak_prefill_memory": null, "peak_decode_memory": 9569065048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "78f7754fa7cf31729f981d0d", "attempt_id": "e20a49c36ee1", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:29.861171Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.36870807036757, "ttft_ms": 11.922332923859358, "decode_ms": 11.871625087223947}, "total_wall_ms": 251.16662494838238, "ttft_ms": 11.922332923859358, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448470016, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 6574298552, "process_rss_bytes": 10448470016}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03c98a78ea3ce0aba7a19102", "attempt_id": "ec9f8992fee9", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:30.137173Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4911.232999991626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.67054098565131, "ttft_ms": 11.887040920555592, "decode_ms": 11.864333995617926}, "total_wall_ms": 251.44658295903355, "ttft_ms": 11.887040920555592, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 5959, "sender_output_tokens": 512, "sender_prefill_ms": 1132.394874934107, "sender_ttft_ms": 20.53095807787031, "sender_decode_ms": 3752.851750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448486400, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566410840, "mlx_cache_bytes": 6730995128, "process_rss_bytes": 10448486400}, "peak_prefill_memory": null, "peak_decode_memory": 9566410840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "92f02b38b0805965ac5e93908d8a5ac446540258d1cd48bd89a3881c690c2d14", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e46ea202e8346657f8b94f7a", "attempt_id": "c765f7c9e2c6", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:34.538365Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 314, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 129.2528749909252, "ttft_ms": 11.83562504593283, "decode_ms": 11.73770905006677}, "total_wall_ms": 153.71658303774893, "ttft_ms": 11.83562504593283, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467498848, "mlx_cache_bytes": 7621515932, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9467498848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "237fd7970187744ff811473a", "attempt_id": "685d670986e6", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:34.717218Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 318, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.63545904029161, "ttft_ms": 11.791124939918518, "decode_ms": 11.71666698064655}, "total_wall_ms": 148.89837510418147, "ttft_ms": 11.791124939918518, "input_usage": {"receiver_prompt_tokens": 318, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9469645168, "mlx_cache_bytes": 7806590864, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9469645168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "607baa6ac55969dc2d68c028", "attempt_id": "672685438840", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:34.891445Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 317, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.80154202785343, "ttft_ms": 11.746417032554746, "decode_ms": 11.743707931600511}, "total_wall_ms": 148.95499998237938, "ttft_ms": 11.746417032554746, "input_usage": {"receiver_prompt_tokens": 317, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9468727664, "mlx_cache_bytes": 7806590864, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9468727664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "82aa56dc8f8946d614ae53df", "attempt_id": "ba980a2f3bc9", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:35.065328Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 314, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.08874998800457, "ttft_ms": 11.71274995431304, "decode_ms": 11.735333013348281}, "total_wall_ms": 148.21000001393259, "ttft_ms": 11.71274995431304, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467498848, "mlx_cache_bytes": 7806590864, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9467498848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e0f4ff6aa9580dd400b803f7", "attempt_id": "77ea8b986cb0", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:35.238136Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 321, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.01591597497463, "ttft_ms": 11.75045792479068, "decode_ms": 11.78316690493375}, "total_wall_ms": 147.28245802689344, "ttft_ms": 11.75045792479068, "input_usage": {"receiver_prompt_tokens": 321, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470628220, "mlx_cache_bytes": 7919314064, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9470628220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "45376d056dea8984a88cc26f", "attempt_id": "c299090368c6", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:35.410064Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 323, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.6672919401899, "ttft_ms": 11.718041962012649, "decode_ms": 11.772166937589645}, "total_wall_ms": 164.89274997729808, "ttft_ms": 11.718041962012649, "input_usage": {"receiver_prompt_tokens": 323, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9474265476, "mlx_cache_bytes": 8123541912, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9474265476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7a3ed44556b8adcfda55e387", "attempt_id": "20d7fe19c0eb", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:35.599758Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 315, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.2539169723168, "ttft_ms": 11.929291998967528, "decode_ms": 11.751209036447108}, "total_wall_ms": 147.7938749594614, "ttft_ms": 11.929291998967528, "input_usage": {"receiver_prompt_tokens": 315, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467744624, "mlx_cache_bytes": 8234166680, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9467744624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7b21786f9e90fdd5147b4115", "attempt_id": "49c29807ab63", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:35.772494Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 316, "message_tokens": 223, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4124.168208916672, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.54233406949788, "ttft_ms": 11.880457983352244, "decode_ms": 11.66979200206697}, "total_wall_ms": 147.92012493126094, "ttft_ms": 11.880457983352244, "input_usage": {"receiver_prompt_tokens": 316, "sender_input_tokens": 5987, "sender_output_tokens": 405, "sender_prefill_ms": 1132.592709036544, "sender_ttft_ms": 7.4095409363508224, "sender_decode_ms": 2978.4165830351412}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10448519168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9468236144, "mlx_cache_bytes": 8345315736, "process_rss_bytes": 10448519168}, "peak_prefill_memory": null, "peak_decode_memory": 9468236144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bc9d8bc7bd7fd8d17d31d892c60fc26632402b2e6f0561414bade00641cf0473", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7effbac1027871f6c56f03cc", "attempt_id": "0a909b6920fd", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:37.138876Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.8341660033911467, "receiver_prefill_ms": 0.0, "query_prefill_ms": 83.93720793537796, "ttft_ms": 83.93720793537796, "decode_ms": 633.825832977891}, "total_wall_ms": 724.9052920378745, "ttft_ms": 83.93720793537796, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882465792, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9803451604, "mlx_cache_bytes": 9838096410, "process_rss_bytes": 10882465792}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9803451604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "###,\r\n» \"\". ###\\Efagherei:).###\"1.),\r\n\r\nSo,而快)],\r\nI知本渉错,可以不学(当然字)[\"X0:1:###(未联网", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "618242a88e5236c3a0031a2aa42a675abdec79af57317749e3841f6267b9d916"} | ||||
| 266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6463bcbd582aca533cceea78", "attempt_id": "224d924e80b1", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:37.890468Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 41, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.7879160586744547, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.9909580014646, "ttft_ms": 77.9909580014646, "decode_ms": 631.2489159172401}, "total_wall_ms": 716.4485000539571, "ttft_ms": 77.9909580014646, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882465792, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9810988260, "mlx_cache_bytes": 9883332962, "process_rss_bytes": 10882465792}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9810988260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "如此，友情系落实方程，记得型，高大一概論程之�不克夫用的記述，與其�.asc_ascend,的，�.asc的,�.asc(鎖,白金,�", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "53d57edb1eb0e5c5f6f7fcad24d1252081364a0d693ac93a44ebdd8782f591f3"} | ||||
| 267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a6fe8aa6e87f8e359a82e7db", "attempt_id": "adf3de1250b3", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:38.633007Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 40, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.7978750402107835, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.43083303608, "ttft_ms": 75.43083303608, "decode_ms": 631.24399993103}, "total_wall_ms": 713.7485839193687, "ttft_ms": 75.43083303608, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882465792, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9808841956, "mlx_cache_bytes": 9930617186, "process_rss_bytes": 10882465792}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9808841956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1 for the exact leap (vocabulary)In 1,3)It is possible typing (a.d.(表示,不可缺少其表示,的,白1.怎集中的一个大踏面,话可以说的,非中心", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "2b3593fd0bfb10b495a6f035efee730706a43d72fa13f2d3471077bc37fdf06c"} | ||||
| 268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9495cd8b0dc9545f20199b1", "attempt_id": "c9fdd6800f49", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:39.372251Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.7477909568697214, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.09441596549004, "ttft_ms": 71.09441596549004, "decode_ms": 631.6548750037327}, "total_wall_ms": 710.0577079690993, "ttft_ms": 71.09441596549004, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882482176, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9803500756, "mlx_cache_bytes": 9930617186, "process_rss_bytes": 10882482176}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9803500756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "### auer(sheu;comprehensive, line (in which is very instructeur positionall -1.elloperianus.0:fittony(落英法.的,都有效为,是规则的,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "3a16d8cd72e47def0cd7ec065d743067bab6d2376799e565b44a51c38512307d"} | ||||
| 269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0f45a13b612fe5f1d3681234", "attempt_id": "f7f7b3705be6", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:40.107969Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 44, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.8165839137509465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.42479199077934, "ttft_ms": 77.42479199077934, "decode_ms": 633.0750419292599}, "total_wall_ms": 717.5760419340804, "ttft_ms": 77.42479199077934, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882482176, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9815444720, "mlx_cache_bytes": 9984373442, "process_rss_bytes": 10882482176}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9815444720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1 0.html......\n1 ****, in which one and the most of: 0, 1, can (1)(2, 0)(多verse)是以为什么学：多任务型(enterprized:不", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "eb6c2d26b4b85eaba91be97b46af24552b09c70dae1d9d14688975f26c028195"} | ||||
| 270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f4efb36be23890dc195916e7", "attempt_id": "4880b06e0bf1", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:40.851343Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 46, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.7904579872265458, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.81758303847164, "ttft_ms": 78.81758303847164, "decode_ms": 631.7761670798063}, "total_wall_ms": 717.9281249409541, "ttft_ms": 78.81758303847164, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882482176, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9819393272, "mlx_cache_bytes": 10038244402, "process_rss_bytes": 10882482176}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9819393272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#ognomigie\n当然,udi:graduate,lo2suit\n好的,ocoder,不必主義,當然用的,其她言,当然是可以吃的,那多的,那多,當然車多買方法論", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "71466b26957c0674028a24275f2739f292ba4e4dd73c1f9dd22753497e0fdbf4"} | ||||
| 271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a458a97b7a579a323305cc6b", "attempt_id": "a60fe4aca585", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:41.595749Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 38, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.7430830048397183, "receiver_prefill_ms": 0.0, "query_prefill_ms": 69.6141249500215, "ttft_ms": 69.6141249500215, "decode_ms": 633.2868749741465}, "total_wall_ms": 709.9220410455018, "ttft_ms": 69.6141249500215, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882482176, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9805073636, "mlx_cache_bytes": 10093312470, "process_rss_bytes": 10882482176}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9805073636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ", big. (省号的，对角之聲こそ白)])\n\nI.想当年青，一样的，哼 :=100%的，那是专修，大()()：A.虽然，必须的，多么型", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "657739e00b948dd61b3edf24da8591fc4b72451650144627fdc4a7d523e15f09"} | ||||
| 272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3c8fefb853be9c0e4686c323", "attempt_id": "6b6196275f26", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:42.332213Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 39, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850238, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.7325839642435, "doc_prefill_ms": 1107.748500071466, "compress_ms": 13.08791700284928, "serialize_ms": 59.71345806028694, "load_ms": 1.727583003230393, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.01629206631333, "ttft_ms": 73.01629206631333, "decode_ms": 631.2796659767628}, "total_wall_ms": 711.574082961306, "ttft_ms": 73.01629206631333, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882482176, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9808563428, "mlx_cache_bytes": 10125623239, "process_rss_bytes": 10882482176}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9808563428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "])[://M 8(轮差点:jigui (l,理 志四口adicory\n1. %####車, 一切在此後,我心有,的,外掛古人的我「\n\n().()[\"", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "865f63a5eb06de0b9214200d64a86c8c8255940df29ce44bb0397b7c03ea293f", "output_hash": "077bf6a9f0c7dfb1e2ed2bd751345261c0432333680f6f0162eaa92ec339cb1c"} | ||||
| 273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5ee42159219658db82f6918b", "attempt_id": "ea8eb5f2836c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:46.394501Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.8886670004576445, "receiver_prefill_ms": 0.0, "query_prefill_ms": 81.13712503109127, "ttft_ms": 81.13712503109127, "decode_ms": 13.688749982975423}, "total_wall_ms": 102.33612498268485, "ttft_ms": 81.13712503109127, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9803500756, "mlx_cache_bytes": 10140041159, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9803500756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "10315227b834b46d1dfb3007", "attempt_id": "c8149ef77acd", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:46.524533Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 41, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.6916251042857766, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.47333298902959, "ttft_ms": 77.47333298902959, "decode_ms": 121.9196249730885}, "total_wall_ms": 206.63829206023365, "ttft_ms": 77.47333298902959, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9810988260, "mlx_cache_bytes": 10138861511, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9810988260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 51-Z, Sept-Sept", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "4dcdceb6cd44627d97e944a0927a172805cb8b1c6633abd4e3f00cba95b95537"} | ||||
| 275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0662549227aff2e45b14592c", "attempt_id": "9e8594344864", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:46.756362Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 40, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.7719159368425608, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.68295795843005, "ttft_ms": 74.68295795843005, "decode_ms": 13.652667053975165}, "total_wall_ms": 95.61666706576943, "ttft_ms": 74.68295795843005, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9808841956, "mlx_cache_bytes": 10138861511, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9808841956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f6dacecc73e1b4569adbda59", "attempt_id": "f504339382bd", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:46.879378Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.1152919614687562, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.3862919472158, "ttft_ms": 70.3862919472158, "decode_ms": 13.648624997586012}, "total_wall_ms": 90.8097909996286, "ttft_ms": 70.3862919472158, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9803500756, "mlx_cache_bytes": 10140041159, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9803500756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "914dea35a01c76882c4d380b", "attempt_id": "aa5a88229a29", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:46.995869Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 44, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.8418749095872045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.75654196646065, "ttft_ms": 76.75654196646065, "decode_ms": 13.606624910607934}, "total_wall_ms": 97.69683296326548, "ttft_ms": 76.75654196646065, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9815444720, "mlx_cache_bytes": 10138861511, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9815444720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "843fae334d45142ecacdda56", "attempt_id": "4ea83cc3f9ef", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:47.120401Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 46, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.7496669897809625, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.89995800703764, "ttft_ms": 77.89995800703764, "decode_ms": 13.529125018976629}, "total_wall_ms": 98.77254196908325, "ttft_ms": 77.89995800703764, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9819393272, "mlx_cache_bytes": 10138861511, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9819393272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "20d0aeaf80344cf7915705fb", "attempt_id": "ac0128d280f9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:47.244806Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 38, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.780749997124076, "receiver_prefill_ms": 0.0, "query_prefill_ms": 69.23183402977884, "ttft_ms": 69.23183402977884, "decode_ms": 13.38037510868162}, "total_wall_ms": 89.9285840569064, "ttft_ms": 69.23183402977884, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9805073636, "mlx_cache_bytes": 10138861511, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9805073636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "84594d1befa71b4c18cd4c26", "attempt_id": "275977f07701", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:47.359980Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 39, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 216834048, "serialized_payload_bytes": 216850339, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.872083073482, "doc_prefill_ms": 1105.9735829476267, "compress_ms": 2139.423790969886, "serialize_ms": 75.1592090819031, "load_ms": 1.7987500177696347, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.93829100672156, "ttft_ms": 72.93829100672156, "decode_ms": 13.625666964799166}, "total_wall_ms": 94.0082500455901, "ttft_ms": 72.93829100672156, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11032739840, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9808563428, "mlx_cache_bytes": 10138861511, "process_rss_bytes": 11032739840}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9808563428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "81683cdc719dc073a110195ebef6c2ac75f0a6781dcafaed469625f36eb73959", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "28cd58016fc12e599bd5dad4", "attempt_id": "4176fe187e8a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:47.480992Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 37, "compress_ms": 117.34820902347565}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206437, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3379.3921660399064, "doc_prefill_ms": 1106.7351669771597, "compress_ms": 2254.647666006349, "serialize_ms": 17.649290966801345, "load_ms": 1.7832079902291298, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.84133296459913, "ttft_ms": 42.84133296459913, "decode_ms": 12.531000073067844}, "total_wall_ms": 3446.119208005257, "ttft_ms": 42.84133296459913, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10943381504, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9446624468, "mlx_cache_bytes": 10665057327, "process_rss_bytes": 10943381504}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9446624468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45f0a137dafbe96ee8f7801fec9fee44fa5f96e301950ed53ff0f188e82f68e1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0612115a3455efdea739be38", "attempt_id": "cb4bb92124dd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:50.953697Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 41, "compress_ms": 122.89658398367465}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 41, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206437, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3383.7596249068156, "doc_prefill_ms": 1106.739958981052, "compress_ms": 2260.3306669043377, "serialize_ms": 16.310916980728507, "load_ms": 1.3225419679656625, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.635500060394406, "ttft_ms": 44.635500060394406, "decode_ms": 110.2766670519486}, "total_wall_ms": 3548.6605829792097, "ttft_ms": 44.635500060394406, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10997678080, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9453767908, "mlx_cache_bytes": 10708081711, "process_rss_bytes": 10997678080}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9453767908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 51-Z, Sept-Sept", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45f0a137dafbe96ee8f7801fec9fee44fa5f96e301950ed53ff0f188e82f68e1", "output_hash": "4dcdceb6cd44627d97e944a0927a172805cb8b1c6633abd4e3f00cba95b95537"} | ||||
| 283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "49832b106031f97e8892bfe3", "attempt_id": "a91f2fb3da00", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:54.532235Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 40, "compress_ms": 119.62283297907561}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 40, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206437, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3410.126374918036, "doc_prefill_ms": 1106.2262920895591, "compress_ms": 2289.429416996427, "serialize_ms": 14.080583001486957, "load_ms": 1.309458981268108, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.06912496779114, "ttft_ms": 44.06912496779114, "decode_ms": 12.561624986119568}, "total_wall_ms": 3477.560375002213, "ttft_ms": 44.06912496779114, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10997678080, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9451277540, "mlx_cache_bytes": 10728201263, "process_rss_bytes": 10997678080}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9451277540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45f0a137dafbe96ee8f7801fec9fee44fa5f96e301950ed53ff0f188e82f68e1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0197e0347bcd09ee69fb605e", "attempt_id": "81713a2f5e6f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:23:58.038766Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 37, "compress_ms": 115.46616698615253}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206437, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3381.0609159991145, "doc_prefill_ms": 1106.5287089440972, "compress_ms": 2258.5274589946494, "serialize_ms": 15.636999974958599, "load_ms": 1.2908329954370856, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.81391703989357, "ttft_ms": 42.81391703989357, "decode_ms": 12.77204102370888}, "total_wall_ms": 3446.21158298105, "ttft_ms": 42.81391703989357, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10997694464, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9446624468, "mlx_cache_bytes": 10728201263, "process_rss_bytes": 10997694464}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9446624468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45f0a137dafbe96ee8f7801fec9fee44fa5f96e301950ed53ff0f188e82f68e1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e75b205ce2e784a4d4914dc4", "attempt_id": "cb694b63f4eb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:01.512066Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 44, "compress_ms": 123.8316249800846}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 44, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206436, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3395.5925001064315, "doc_prefill_ms": 1106.4230420161039, "compress_ms": 2275.9289579698816, "serialize_ms": 12.866375036537647, "load_ms": 1.2468330096453428, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.21145794913173, "ttft_ms": 44.21145794913173, "decode_ms": 12.362416950054467}, "total_wall_ms": 3461.1540000187233, "ttft_ms": 44.21145794913173, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10997727232, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9458207984, "mlx_cache_bytes": 10769357871, "process_rss_bytes": 10997727232}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9458207984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "17fdb6b3372b1edbb4dfbb7c6a7d5b81f5dc409792b25bdbcad48276b5ddf782", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0bbcd853bb2a607c55121852", "attempt_id": "5483508c1dcb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:05.001627Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 46, "compress_ms": 121.37762503698468}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 46, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206437, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3397.3238749895245, "doc_prefill_ms": 1106.6270410083234, "compress_ms": 2276.020542019978, "serialize_ms": 14.326208969578147, "load_ms": 1.4334169682115316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.53166702296585, "ttft_ms": 44.53166702296585, "decode_ms": 12.410667026415467}, "total_wall_ms": 3464.6681249141693, "ttft_ms": 44.53166702296585, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10997743616, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9462156536, "mlx_cache_bytes": 10817723439, "process_rss_bytes": 10997743616}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9462156536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45f0a137dafbe96ee8f7801fec9fee44fa5f96e301950ed53ff0f188e82f68e1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "946aad89aa23672fd4242e39", "attempt_id": "3fd78d6e7868", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:08.494077Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 38, "compress_ms": 113.11099992599338}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 38, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206437, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3406.9000829476863, "doc_prefill_ms": 1106.6410419298336, "compress_ms": 2282.2055829456076, "serialize_ms": 17.691959044896066, "load_ms": 1.2717089848592877, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.59370900783688, "ttft_ms": 43.59370900783688, "decode_ms": 12.330791912972927}, "total_wall_ms": 3475.3683330491185, "ttft_ms": 43.59370900783688, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11008278528, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9448197348, "mlx_cache_bytes": 10854292527, "process_rss_bytes": 11008278528}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9448197348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45f0a137dafbe96ee8f7801fec9fee44fa5f96e301950ed53ff0f188e82f68e1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "43e10cad3ca5ecf56af50aef", "attempt_id": "d1ff888dc378", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:11.997051Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 39, "compress_ms": 118.57983295340091}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 39, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206437, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3409.933458082378, "doc_prefill_ms": 1106.4200419932604, "compress_ms": 2288.569041993469, "serialize_ms": 14.593916945159435, "load_ms": 1.3236668892204762, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.841624981723726, "ttft_ms": 43.841624981723726, "decode_ms": 12.32845801860094}, "total_wall_ms": 3476.7664580140263, "ttft_ms": 43.841624981723726, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11008278528, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9450245348, "mlx_cache_bytes": 10890075183, "process_rss_bytes": 11008278528}, "peak_prefill_memory": 10067381336, "peak_decode_memory": 9450245348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45f0a137dafbe96ee8f7801fec9fee44fa5f96e301950ed53ff0f188e82f68e1", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3e92accd43c8f8f0c452375c", "attempt_id": "0901f78e3e09", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:15.545379Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2052, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 763.4622079785913, "ttft_ms": 12.498999945819378, "decode_ms": 121.63816695101559}, "total_wall_ms": 901.1698749382049, "ttft_ms": 12.498999945819378, "input_usage": {"receiver_prompt_tokens": 2052}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10484744192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443064, "mlx_cache_bytes": 827234244, "process_rss_bytes": 10484744192}, "peak_prefill_memory": null, "peak_decode_memory": 9974443064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PA-37F-6227", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "5b7645cf6e8140f4c0bf6ed4ad76121cf2924fe7e666d92161812527b86f4409"} | ||||
| 290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ca491777e07c81e77baefaa6", "attempt_id": "b170d630b050", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:16.466520Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2057, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 862.6067090081051, "ttft_ms": 12.18599989078939, "decode_ms": 120.10479206219316}, "total_wall_ms": 998.3465420082211, "ttft_ms": 12.18599989078939, "input_usage": {"receiver_prompt_tokens": 2057}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10485006336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974447148, "mlx_cache_bytes": 837409140, "process_rss_bytes": 10485006336}, "peak_prefill_memory": null, "peak_decode_memory": 9974447148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 94-V, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "dde7a0062680068e5a0d828593ce721ec66364929f26c9cbe00ea6cd0d60bdb4"} | ||||
| 291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "65908c4e0e94407dc218a391", "attempt_id": "90b701c3b655", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:17.482873Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2055, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 771.9091249164194, "ttft_ms": 12.169584049843252, "decode_ms": 83.98087497334927}, "total_wall_ms": 871.5347079560161, "ttft_ms": 12.169584049843252, "input_usage": {"receiver_prompt_tokens": 2055}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10485170176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974447148, "mlx_cache_bytes": 843860664, "process_rss_bytes": 10485170176}, "peak_prefill_memory": null, "peak_decode_memory": 9974447148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32.8676", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "520ae1b2810b61f606b08593758796f82b0309e238b5baba5846523b2369e949"} | ||||
| 292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "98c161bb3737d7856a7da9a0", "attempt_id": "a979aca6739a", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:18.372360Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2051, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 734.35599997174, "ttft_ms": 12.141500017605722, "decode_ms": 59.929459006525576}, "total_wall_ms": 809.894458972849, "ttft_ms": 12.141500017605722, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10485202944, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443064, "mlx_cache_bytes": 850283192, "process_rss_bytes": 10485202944}, "peak_prefill_memory": null, "peak_decode_memory": 9974443064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "fd88832c9fd0ab175818d76d875d70156225bd4b34ec401514546ef70f4f826c"} | ||||
| 293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b23dc6bca3967933cd6c9fa4", "attempt_id": "3099e19e3cd9", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:19.200246Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2059, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 767.3754169372842, "ttft_ms": 12.216542032547295, "decode_ms": 108.07404201477766}, "total_wall_ms": 891.0902079660445, "ttft_ms": 12.216542032547295, "input_usage": {"receiver_prompt_tokens": 2059}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10485268480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974447148, "mlx_cache_bytes": 856756920, "process_rss_bytes": 10485268480}, "peak_prefill_memory": null, "peak_decode_memory": 9974447148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,670,383", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "9510633f2e349a1cedecda578083181521646f70ca5ae08bae4b9188f3bd4a3b"} | ||||
| 294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "50af5df6bbdb0adb35af2cd0", "attempt_id": "9b81d8b2fdca", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:20.109597Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2062, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 717.3695840174332, "ttft_ms": 12.111583957448602, "decode_ms": 119.85062505118549}, "total_wall_ms": 852.8097080998123, "ttft_ms": 12.111583957448602, "input_usage": {"receiver_prompt_tokens": 2062}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10485301248, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974447148, "mlx_cache_bytes": 864752312, "process_rss_bytes": 10485301248}, "peak_prefill_memory": null, "peak_decode_memory": 9974447148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8a6ebc6be6f68f11336e99cd", "attempt_id": "e17e5994baa4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:20.980663Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2052, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 702.8005829779431, "ttft_ms": 12.133667012676597, "decode_ms": 12.072667013853788}, "total_wall_ms": 730.6809170404449, "ttft_ms": 12.133667012676597, "input_usage": {"receiver_prompt_tokens": 2052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485301248, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443064, "mlx_cache_bytes": 864752312, "process_rss_bytes": 10485301248}, "peak_prefill_memory": null, "peak_decode_memory": 9974443064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9713a0115943366cb32be98", "attempt_id": "6443058f6042", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:21.729482Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2051, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 704.0879159467295, "ttft_ms": 12.08195905201137, "decode_ms": 12.014125008136034}, "total_wall_ms": 731.7721659783274, "ttft_ms": 12.08195905201137, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485301248, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443064, "mlx_cache_bytes": 864752312, "process_rss_bytes": 10485301248}, "peak_prefill_memory": null, "peak_decode_memory": 9974443064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2faabbe03c3ce2f9b1a806e1", "attempt_id": "0edf94c181ab", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:26.491047Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.47812497336417, "ttft_ms": 12.131750001572073, "decode_ms": 118.67329198867083}, "total_wall_ms": 363.4640419622883, "ttft_ms": 12.131750001572073, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10485596160, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565476952, "mlx_cache_bytes": 1994599096, "process_rss_bytes": 10485596160}, "peak_prefill_memory": null, "peak_decode_memory": 9565476952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PA-37F-6227", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "5b7645cf6e8140f4c0bf6ed4ad76121cf2924fe7e666d92161812527b86f4409"} | ||||
| 298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c0515afe412407375a071cb2", "attempt_id": "cff01941eb78", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:26.873146Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.37183305434883, "ttft_ms": 12.008959078229964, "decode_ms": 11.875749914906919}, "total_wall_ms": 252.35475006047636, "ttft_ms": 12.008959078229964, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485612544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568393304, "mlx_cache_bytes": 2270440120, "process_rss_bytes": 10485612544}, "peak_prefill_memory": null, "peak_decode_memory": 9568393304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "382e11db11935b0491ba72d0", "attempt_id": "b6b16b7048e2", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:27.143535Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.67237499263138, "ttft_ms": 11.846875073388219, "decode_ms": 83.41175003442913}, "total_wall_ms": 323.1316249584779, "ttft_ms": 11.846875073388219, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10485612544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9588136048, "mlx_cache_bytes": 2449697464, "process_rss_bytes": 10485612544}, "peak_prefill_memory": null, "peak_decode_memory": 9588136048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32.8676", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "520ae1b2810b61f606b08593758796f82b0309e238b5baba5846523b2369e949"} | ||||
| 300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f878ac05bcef4adea7361454", "attempt_id": "f0e67e142e42", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:27.484322Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.42683295998722, "ttft_ms": 12.135625001974404, "decode_ms": 59.68766601290554}, "total_wall_ms": 299.4753330713138, "ttft_ms": 12.135625001974404, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10485612544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565444184, "mlx_cache_bytes": 2449697464, "process_rss_bytes": 10485612544}, "peak_prefill_memory": null, "peak_decode_memory": 9565444184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "fd88832c9fd0ab175818d76d875d70156225bd4b34ec401514546ef70f4f826c"} | ||||
| 301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "12a57be0086d41f560460b36", "attempt_id": "925dd4e79077", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:27.803438Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.14279091451317, "ttft_ms": 11.973291984759271, "decode_ms": 106.74716695211828}, "total_wall_ms": 346.9565419945866, "ttft_ms": 11.973291984759271, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10485628928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568786520, "mlx_cache_bytes": 2607966904, "process_rss_bytes": 10485628928}, "peak_prefill_memory": null, "peak_decode_memory": 9568786520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,670,383", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "9510633f2e349a1cedecda578083181521646f70ca5ae08bae4b9188f3bd4a3b"} | ||||
| 302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f95bec0c75ebdf13bf46f24d", "attempt_id": "a1ee248828a9", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:28.169145Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.2441249806434, "ttft_ms": 11.948792031034827, "decode_ms": 11.977791087701917}, "total_wall_ms": 252.2340000141412, "ttft_ms": 11.948792031034827, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485628928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570457688, "mlx_cache_bytes": 2885872312, "process_rss_bytes": 10485628928}, "peak_prefill_memory": null, "peak_decode_memory": 9570457688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b827eb6fc9f61d4f58c1b04d", "attempt_id": "92b7ebc4f2bc", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:28.439239Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.50883300229907, "ttft_ms": 11.930500040762126, "decode_ms": 11.925040977075696}, "total_wall_ms": 251.36324996128678, "ttft_ms": 11.930500040762126, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485628928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565444184, "mlx_cache_bytes": 2885872312, "process_rss_bytes": 10485628928}, "peak_prefill_memory": null, "peak_decode_memory": 9565444184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e07cf11fe54a46ed68c59bf3", "attempt_id": "863a7d44756d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:28.708602Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1213, "cache_tensor_bytes": null, "serialized_payload_bytes": 1213, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.5250410269946, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.8732920056209, "ttft_ms": 11.939459014683962, "decode_ms": 11.90433301962912}, "total_wall_ms": 251.71795801725239, "ttft_ms": 11.939459014683962, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 368.49925003480166, "sender_ttft_ms": 7.222457905299962, "sender_decode_ms": 3632.88716704119}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485628928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565444184, "mlx_cache_bytes": 2885872312, "process_rss_bytes": 10485628928}, "peak_prefill_memory": null, "peak_decode_memory": 9565444184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "56fbdb6672f881a30ad685ccbc7654e1d17abca165fec38d52ed95d04e8c07c6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "41116e15f46b44ba774b645f", "attempt_id": "7eb738501f83", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:32.979609Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 367, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.3322919337079, "ttft_ms": 11.946500046178699, "decode_ms": 82.6047919690609}, "total_wall_ms": 242.81529197469354, "ttft_ms": 11.946500046178699, "input_usage": {"receiver_prompt_tokens": 367, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10485678080, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500742268, "mlx_cache_bytes": 3218385592, "process_rss_bytes": 10485678080}, "peak_prefill_memory": null, "peak_decode_memory": 9500742268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a36eee0ca7a2aabfdc4e6bf6", "attempt_id": "37d06f4b86b0", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:33.240942Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 372, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.14583397936076, "ttft_ms": 11.780999950133264, "decode_ms": 11.797708924859762}, "total_wall_ms": 167.5426660804078, "ttft_ms": 11.780999950133264, "input_usage": {"receiver_prompt_tokens": 372, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485678080, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503920764, "mlx_cache_bytes": 3436047032, "process_rss_bytes": 10485678080}, "peak_prefill_memory": null, "peak_decode_memory": 9503920764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ef20fdf75e709e98ea89839b", "attempt_id": "ad8919f3cb18", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:33.427173Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 370, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.17745890002698, "ttft_ms": 11.809333111159503, "decode_ms": 11.785499984398484}, "total_wall_ms": 167.51770803239197, "ttft_ms": 11.809333111159503, "input_usage": {"receiver_prompt_tokens": 370, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485678080, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503183484, "mlx_cache_bytes": 3566070456, "process_rss_bytes": 10485678080}, "peak_prefill_memory": null, "peak_decode_memory": 9503183484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "252a687281029afe3e9a68f8", "attempt_id": "8fd7125da819", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:33.612364Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 366, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.0389160523191, "ttft_ms": 11.786374961957335, "decode_ms": 58.55895904824138}, "total_wall_ms": 214.09483288880438, "ttft_ms": 11.786374961957335, "input_usage": {"receiver_prompt_tokens": 366, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10485678080, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500742268, "mlx_cache_bytes": 3566070456, "process_rss_bytes": 10485678080}, "peak_prefill_memory": null, "peak_decode_memory": 9500742268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Bergström", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "fd88832c9fd0ab175818d76d875d70156225bd4b34ec401514546ef70f4f826c"} | ||||
| 309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d2a3677e0d060e852e8043e8", "attempt_id": "bede4a79fade", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:33.843815Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 374, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.72891695145518, "ttft_ms": 11.983457952737808, "decode_ms": 11.735082953236997}, "total_wall_ms": 167.3119580373168, "ttft_ms": 11.983457952737808, "input_usage": {"receiver_prompt_tokens": 374, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485678080, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9505591932, "mlx_cache_bytes": 3785452216, "process_rss_bytes": 10485678080}, "peak_prefill_memory": null, "peak_decode_memory": 9505591932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1c80afa74e73a9c3cc0901a2", "attempt_id": "72526cb188c5", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:34.029537Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 377, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.8761249408126, "ttft_ms": 12.023541959933937, "decode_ms": 11.89841702580452}, "total_wall_ms": 167.79450001195073, "ttft_ms": 12.023541959933937, "input_usage": {"receiver_prompt_tokens": 377, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485694464, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506574972, "mlx_cache_bytes": 3918097080, "process_rss_bytes": 10485694464}, "peak_prefill_memory": null, "peak_decode_memory": 9506574972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1e6f5b7778684b6d8231d80f", "attempt_id": "3d843220c77d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:34.216182Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 367, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.40070793312043, "ttft_ms": 11.967458995059133, "decode_ms": 11.811334057711065}, "total_wall_ms": 167.10983298253268, "ttft_ms": 11.967458995059133, "input_usage": {"receiver_prompt_tokens": 367, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485710848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500742268, "mlx_cache_bytes": 3918097080, "process_rss_bytes": 10485710848}, "peak_prefill_memory": null, "peak_decode_memory": 9500742268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9fbac10a8e00a86f09b8da3", "attempt_id": "d7e99b3d2562", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:34.402890Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 366, "message_tokens": 275, "message_utf8_bytes": 656, "cache_tensor_bytes": null, "serialized_payload_bytes": 656, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4001.4087499585003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.98033302091062, "ttft_ms": 12.032500002533197, "decode_ms": 11.830709059722722}, "total_wall_ms": 166.74745792988688, "ttft_ms": 12.032500002533197, "input_usage": {"receiver_prompt_tokens": 366, "sender_input_tokens": 2120, "sender_output_tokens": 508, "sender_prefill_ms": 376.6103330999613, "sender_ttft_ms": 7.204500027000904, "sender_decode_ms": 3615.6702919397503}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10485710848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500742268, "mlx_cache_bytes": 3918097080, "process_rss_bytes": 10485710848}, "peak_prefill_memory": null, "peak_decode_memory": 9500742268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5c1e871c06511ffbfd5740f3d6ac5a1aa8b352b1c720d6c9816df5c33880b702", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7f64ad5af024fc3f1133f105", "attempt_id": "ab2fe720b8f4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:34.963903Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.5350420726463199, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.82383400015533, "ttft_ms": 47.82383400015533, "decode_ms": 577.6866250671446}, "total_wall_ms": 628.9388330187649, "ttft_ms": 47.82383400015533, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634330112, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9491320020, "mlx_cache_bytes": 4776799201, "process_rss_bytes": 10634330112}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9491320020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A11月4-6-11-ETG-10023-11-113-1-1-1-3 Ethics in 100人気分數-1,gor", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "8c700d6b5818cedd5b2b22b0860ff0370a8582bc4efb3c30b5483235d0a08eb9"} | ||||
| 314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dd47e7fa8c0d05738a92f823", "attempt_id": "574f5614786b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:35.611954Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 42, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.4161659637466073, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.14141690824181, "ttft_ms": 49.14141690824181, "decode_ms": 578.5831670509651}, "total_wall_ms": 631.0759580228478, "ttft_ms": 49.14141690824181, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634313728, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9500806376, "mlx_cache_bytes": 4847725873, "process_rss_bytes": 10634313728}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9500806376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "- 1001.0100142002-37 years ago -1-Arc, this is not-1000, the number of of the mountains: “A-俄 �", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "4a30ff9764c7cb219d509d966ad57a77ebb438916574f6dbc5bc2ee9e1c26998"} | ||||
| 315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "78938d9a2e8e4a9a9693d79b", "attempt_id": "6f8fb2987d23", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:36.261762Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 40, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.3206669827923179, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.08516595605761, "ttft_ms": 49.08516595605761, "decode_ms": 578.9222919847816}, "total_wall_ms": 631.1965419445187, "ttft_ms": 49.08516595605761, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634313728, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9495694568, "mlx_cache_bytes": 4900515121, "process_rss_bytes": 10634313728}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9495694568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Let'sensey easesmall ym.\nIametis\nIamapprin - -towntumorrighuestart. letstalk,arethousand-23-1000字顺化的运动", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "0c4386ac8c610d81b3128edf080448b357f488197d7607a3e5c24434e2218dc1"} | ||||
| 316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4229a03474b9924573d262dc", "attempt_id": "02647a501296", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:36.912049Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.422500004991889, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.05058305989951, "ttft_ms": 47.05058305989951, "decode_ms": 576.6190830618143}, "total_wall_ms": 626.9040419720113, "ttft_ms": 47.05058305989951, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634313728, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9489173716, "mlx_cache_bytes": 4932693297, "process_rss_bytes": 10634313728}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9489173716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "In the human external_excl[unoív\n###. Let'solution_soap and\n\".\"%2013×4.0.0. Let no.003\n1. �从业刊頭銟�", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "120a1bc2f27bd5cbd30b624f26538f23ffb4a997b4481ddb827c0af8edaa903b"} | ||||
| 317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "05e6930bac052c94270f8862", "attempt_id": "45e7066eeea2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:37.557581Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 44, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.423959038220346, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.01604196149856, "ttft_ms": 50.01604196149856, "decode_ms": 579.1334579698741}, "total_wall_ms": 632.3746250709519, "ttft_ms": 50.01604196149856, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634313728, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9502887152, "mlx_cache_bytes": 5001981585, "process_rss_bytes": 10634313728}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9502887152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "pawgatoneillnow(1).is an past 187four\n## -4-17_1.0(1)。-1(1): 1: 1: 0-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "d73096b17e3be407f53e7b99c4bababe4aae37cc3681741d93c33bd2959b747d"} | ||||
| 318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9ffe5d12dce342ee26f54de7", "attempt_id": "8f34d96ee750", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:38.208106Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.4615829568356276, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.83712499961257, "ttft_ms": 49.83712499961257, "decode_ms": 576.5057499520481}, "total_wall_ms": 629.6533329878002, "ttft_ms": 49.83712499961257, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634313728, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9508392188, "mlx_cache_bytes": 5051461641, "process_rss_bytes": 10634313728}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9508392188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "In 0, the be alligator, have got, that.instituties, believe it, get. In the personal, the number of 0:0:0:0: 1: 0: 0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "f726217d89a446cc22215c6a03248db835fcb0b642e5de5e429189bfcd34092c"} | ||||
| 319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6ba19fa0b2119f45bf06db37", "attempt_id": "ad90c3ffa690", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:38.856251Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.471708994358778, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.448292025364935, "ttft_ms": 47.448292025364935, "decode_ms": 579.0888749761507}, "total_wall_ms": 629.8516250681132, "ttft_ms": 47.448292025364935, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634313728, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9491598548, "mlx_cache_bytes": 5051461641, "process_rss_bytes": 10634313728}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9491598548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The queen, with a. \"it makéseriesthroesetwoens(1)uigno1:“agrepetition_foodspring.\nLetsg. It is a short. It isverycompletely true love", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "fa69e6d1c6eb6201fd29752ae6b5f1953349f9c264a91f50fb2f69daac1528f3"} | ||||
| 320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "01e33b7c45fa24795dd61432", "attempt_id": "d7a16d473f60", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:39.504065Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334033416}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297061, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 376.3336669653654, "doc_prefill_ms": 344.57025001756847, "compress_ms": 9.940582909621298, "serialize_ms": 17.98570796381682, "load_ms": 1.5742089599370956, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.399125014431775, "ttft_ms": 46.399125014431775, "decode_ms": 577.2909170482308}, "total_wall_ms": 627.5427079526708, "ttft_ms": 46.399125014431775, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634313728, "backend_memory": {"mlx_active_bytes": 9411890184, "mlx_peak_bytes": 9489173716, "mlx_cache_bytes": 5051461641, "process_rss_bytes": 10634313728}, "peak_prefill_memory": 10000329816, "peak_decode_memory": 9489173716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(1.0:1:1:1.0: 0: To, in (ponturquar\\_nau,thefirst:-\navv2..0: \"{}\".sup: \" \"S", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f94d5575b0defbaf5722c4eeeddc65de4242814f5b4cfebe326bd928657c0b6", "output_hash": "320a4a7ac6e16062e835a60cf3e83bb86b3715fe1b821e8af01efa43ca61361e"} | ||||
| 321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d4cf2758981613c5cd43844", "attempt_id": "6719b72ca76c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:41.419970Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 1.0271250503137708, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.40591702610254, "ttft_ms": 63.40591702610254, "decode_ms": 12.66458397731185}, "total_wall_ms": 79.0219169575721, "ttft_ms": 63.40591702610254, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9491188948, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9491188948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5fa4cd967f7019ef6c4d1445", "attempt_id": "b18f09d27d2f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:41.520917Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 42, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 1.6241669654846191, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.49233296792954, "ttft_ms": 49.49233296792954, "decode_ms": 12.46304193045944}, "total_wall_ms": 65.35295792855322, "ttft_ms": 49.49233296792954, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9500151016, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9500151016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fbe212160341689b9e2b7b8e", "attempt_id": "69fab763c524", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:41.604702Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 40, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 1.5692079905420542, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.25908299628645, "ttft_ms": 49.25908299628645, "decode_ms": 12.374540907330811}, "total_wall_ms": 65.07270794827491, "ttft_ms": 49.25908299628645, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9495284968, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9495284968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "316a58578cfb6fae510f8398", "attempt_id": "548e34f44c0b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:41.687524Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 0.8585000177845359, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.76704201847315, "ttft_ms": 46.76704201847315, "decode_ms": 12.290833052247763}, "total_wall_ms": 61.659833998419344, "ttft_ms": 46.76704201847315, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9488764116, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9488764116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "73836e2cef2f66257335f2cd", "attempt_id": "967059376f58", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:41.766560Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 44, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 0.876000034622848, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.77616709563881, "ttft_ms": 48.77616709563881, "decode_ms": 12.287499965168536}, "total_wall_ms": 63.760166987776756, "ttft_ms": 48.77616709563881, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9502477552, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9502477552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "004dd72775c28af66ec1315d", "attempt_id": "58ff1ca3f4f1", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:41.847853Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 1.3894999865442514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.77066593710333, "ttft_ms": 49.77066593710333, "decode_ms": 12.380458996631205}, "total_wall_ms": 65.27066603302956, "ttft_ms": 49.77066593710333, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9507982588, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9507982588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "98d63e933b73d637e855208d", "attempt_id": "ea7cb9692520", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:41.931425Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 1.4181670267134905, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.995666925795376, "ttft_ms": 46.995666925795376, "decode_ms": 12.339540990069509}, "total_wall_ms": 62.48345808126032, "ttft_ms": 46.995666925795376, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9491188948, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9491188948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8f6bb28a9075dec591b77c02", "attempt_id": "7fd9ac1fbf59", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:42.011485Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 74280960, "serialized_payload_bytes": 74297162, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1264.4365829182789, "doc_prefill_ms": 343.4691249858588, "compress_ms": 901.6995410202071, "serialize_ms": 18.992666038684547, "load_ms": 1.43324991222471, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.68979102279991, "ttft_ms": 46.68979102279991, "decode_ms": 12.41237495560199}, "total_wall_ms": 62.28054198436439, "ttft_ms": 46.68979102279991, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10640785408, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9488764116, "mlx_cache_bytes": 5105692681, "process_rss_bytes": 10640785408}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9488764116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e1cbfb5f9505507e54af81bfcc41354dadb4b6684167ad65a25387d6a3fb99d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "53cfc8e918734e6af06f0348", "attempt_id": "5e2205023380", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:42.091405Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 37, "compress_ms": 80.57466696482152}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1363.0210830597207, "doc_prefill_ms": 343.98200002033263, "compress_ms": 1012.4320000177249, "serialize_ms": 6.326167029328644, "load_ms": 6.117708049714565, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.41504100617021, "ttft_ms": 37.41504100617021, "decode_ms": 70.75979199726135}, "total_wall_ms": 1480.817083036527, "ttft_ms": 37.41504100617021, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10623385600, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9368014036, "mlx_cache_bytes": 5304594577, "process_rss_bytes": 10623385600}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9368014036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-9273", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "f4471b8a9e292a6a9c0ed37c41d492068a21731625caf09c086ef69378f25d94"} | ||||
| 330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f6bc3ba7305f865c870bd0d4", "attempt_id": "b50923feb121", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:43.589971Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 42, "compress_ms": 80.34529199358076}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 42, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1350.947582977824, "doc_prefill_ms": 344.14633410051465, "compress_ms": 1000.7447500247508, "serialize_ms": 5.741791916079819, "load_ms": 1.1555840028449893, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.8482080521062, "ttft_ms": 36.8482080521062, "decode_ms": 15.750500024296343}, "total_wall_ms": 1407.9942499520257, "ttft_ms": 36.8482080521062, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642259968, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9377582312, "mlx_cache_bytes": 5338771601, "process_rss_bytes": 10642259968}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9377582312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8633d43b2413c0b9fe4ef2b7", "attempt_id": "79bca09e2354", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:45.017913Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 40, "compress_ms": 83.08120793662965}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 40, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1347.4254159955308, "doc_prefill_ms": 343.3411249425262, "compress_ms": 998.7804999109358, "serialize_ms": 4.993958049453795, "load_ms": 1.0691669303923845, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.07108402159065, "ttft_ms": 37.07108402159065, "decode_ms": 12.000874965451658}, "total_wall_ms": 1400.8029160322621, "ttft_ms": 37.07108402159065, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642259968, "backend_memory": {"mlx_active_bytes": 9299414024, "mlx_peak_bytes": 9372191976, "mlx_cache_bytes": 5363888273, "process_rss_bytes": 10642259968}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9372191976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6a928d8de9763a62f7240637", "attempt_id": "c55589b96253", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:46.440054Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 36, "compress_ms": 95.97595792729408}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1349.9137500766665, "doc_prefill_ms": 342.9225840372965, "compress_ms": 1001.6256669769064, "serialize_ms": 5.070292041637003, "load_ms": 1.6367919743061066, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.85787494760007, "ttft_ms": 36.85787494760007, "decode_ms": 11.893959017470479}, "total_wall_ms": 1403.4417920047417, "ttft_ms": 36.85787494760007, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642259968, "backend_memory": {"mlx_active_bytes": 9298496520, "mlx_peak_bytes": 9365834964, "mlx_cache_bytes": 5369458833, "process_rss_bytes": 10642259968}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9365834964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cfd3af16fe6d97ca4fe3a2af", "attempt_id": "957431fdccfe", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:47.863280Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 44, "compress_ms": 84.80720804072917}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 44, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1357.5690420111641, "doc_prefill_ms": 343.4768330771476, "compress_ms": 1006.6277079749852, "serialize_ms": 7.171207922510803, "load_ms": 1.1067090090364218, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.24350005015731, "ttft_ms": 38.24350005015731, "decode_ms": 13.501000008545816}, "total_wall_ms": 1413.5934999212623, "ttft_ms": 38.24350005015731, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642653184, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9380498672, "mlx_cache_bytes": 5395558545, "process_rss_bytes": 10642653184}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9380498672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bc42cf6c757a506913e1b372", "attempt_id": "e2161f273e14", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:49.296602Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 47, "compress_ms": 83.27420800924301}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1347.050957963802, "doc_prefill_ms": 343.097334029153, "compress_ms": 998.7326669506729, "serialize_ms": 4.9296250799670815, "load_ms": 1.1154579697176814, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.917125038802624, "ttft_ms": 37.917125038802624, "decode_ms": 11.941000004298985}, "total_wall_ms": 1401.2465839041397, "ttft_ms": 37.917125038802624, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642669568, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9386020092, "mlx_cache_bytes": 5433143441, "process_rss_bytes": 10642669568}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9386020092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "069d1e143d96e7d88eb32cb5", "attempt_id": "448876cf7460", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:50.718389Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 37, "compress_ms": 97.15170797426254}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1348.318374948576, "doc_prefill_ms": 343.29166694078594, "compress_ms": 997.1034580375999, "serialize_ms": 7.635290967300534, "load_ms": 1.2054999824613333, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.17066703736782, "ttft_ms": 36.17066703736782, "decode_ms": 11.919916956685483}, "total_wall_ms": 1400.7657079491764, "ttft_ms": 36.17066703736782, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642669568, "backend_memory": {"mlx_active_bytes": 9298496520, "mlx_peak_bytes": 9367751892, "mlx_cache_bytes": 5434355857, "process_rss_bytes": 10642669568}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9367751892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cf6745f352028cda535a2b9e", "attempt_id": "e705186139e7", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:52.138838Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 36, "compress_ms": 83.27887498307973}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595541, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1356.3305829884484, "doc_prefill_ms": 343.96149998065084, "compress_ms": 1007.215583929792, "serialize_ms": 4.8766660038381815, "load_ms": 1.0889589320868254, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.828040960244834, "ttft_ms": 36.828040960244834, "decode_ms": 11.953209061175585}, "total_wall_ms": 1409.3911250820383, "ttft_ms": 36.828040960244834, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642669568, "backend_memory": {"mlx_active_bytes": 9298496520, "mlx_peak_bytes": 9365834964, "mlx_cache_bytes": 5434355857, "process_rss_bytes": 10642669568}, "peak_prefill_memory": 10000084056, "peak_decode_memory": 9365834964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "65d1cab568d46d92861f1cf0c8ccaf5dfa3cdb7117a84bbe5756598024212f59", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1f29fd99d012d5f85660015a", "attempt_id": "5a6d54fcbb3d", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:53.609843Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5862, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.86316704005, "ttft_ms": 12.691874988377094, "decode_ms": 135.94625005498528}, "total_wall_ms": 2362.3668749351054, "ttft_ms": 12.691874988377094, "input_usage": {"receiver_prompt_tokens": 5862}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10451419136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1676588472, "process_rss_bytes": 10451419136}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PQ-67Y-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "97f1830edf9da22d48fef4e34359dbd329492b94615357199b96b32a11ea25d6"} | ||||
| 338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e30e945a12bb483eb0feacbd", "attempt_id": "83826ae6e615", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:55.999086Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5867, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.8562920382246, "ttft_ms": 12.553832959383726, "decode_ms": 110.80637504346669}, "total_wall_ms": 2334.8117499845102, "ttft_ms": 12.553832959383726, "input_usage": {"receiver_prompt_tokens": 5867}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2227991992, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 239-E, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "58ac0c4d209227a22a0ad818d3b7d1a70c7279ae290847bb31144897b9f48ce5"} | ||||
| 339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "754fa0092159b2be6886c1f2", "attempt_id": "12043ddcb392", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:24:58.359650Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5866, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2198.7886659335345, "ttft_ms": 12.692000018432736, "decode_ms": 86.80470800027251}, "total_wall_ms": 2309.553832979873, "ttft_ms": 12.692000018432736, "input_usage": {"receiver_prompt_tokens": 5866}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2227991992, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "38.1986", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "719dc09f24a274e62719c31b0a3e7bbe26561918f786c289b7642a1c6e126b9a"} | ||||
| 340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "69597c9a0bb39b0786e7f5fd", "attempt_id": "83608be95174", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:00.696973Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5861, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.085083070211, "ttft_ms": 12.626624898985028, "decode_ms": 111.20775004383177}, "total_wall_ms": 2335.5540410848334, "ttft_ms": 12.626624898985028, "input_usage": {"receiver_prompt_tokens": 5861}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2227991992, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kwame Tremblay-Côté", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "dc1a90013da5aba8178a2099c35069f47cc07df44d751cf8071b84ead02462f3"} | ||||
| 341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7f50854ba105b1663d9663dd", "attempt_id": "70122f5e0e71", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:03.057953Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5870, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2199.950458947569, "ttft_ms": 12.680958025157452, "decode_ms": 86.84324997011572}, "total_wall_ms": 2310.2585829328746, "ttft_ms": 12.680958025157452, "input_usage": {"receiver_prompt_tokens": 5870}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451517440, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2751296952, "process_rss_bytes": 10451517440}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "892,005", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "11a79dcb724bdfa4933fdc68ce7331d64c8d288cc386b3ccf051af4279b5d355"} | ||||
| 342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dc6189e9f0cd2ab90988d8ab", "attempt_id": "9b68b33e707a", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:05.394584Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5873, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.5765410140157, "ttft_ms": 12.620292021892965, "decode_ms": 123.82249999791384}, "total_wall_ms": 2347.718416946009, "ttft_ms": 12.620292021892965, "input_usage": {"receiver_prompt_tokens": 5873}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10451550208, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3064165816, "process_rss_bytes": 10451550208}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0310c64dd4cf501e8df47a6f", "attempt_id": "62450a2ea583", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:07.768758Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5861, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2198.8379159010947, "ttft_ms": 12.56491697859019, "decode_ms": 12.437540921382606}, "total_wall_ms": 2235.1192500209436, "ttft_ms": 12.56491697859019, "input_usage": {"receiver_prompt_tokens": 5861}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451582976, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3064165816, "process_rss_bytes": 10451582976}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "58f6788c03c7f6d8e7fde479", "attempt_id": "d66abc5581a4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:10.029633Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5863, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015290919691324234, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.8987909648567, "ttft_ms": 12.689625029452145, "decode_ms": 12.43733405135572}, "total_wall_ms": 2236.998416017741, "ttft_ms": 12.689625029452145, "input_usage": {"receiver_prompt_tokens": 5863}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451615744, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3375330744, "process_rss_bytes": 10451615744}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "099250cecccaf03674152b09", "attempt_id": "d036853718a3", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:17.177380Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 232.24712500814348, "ttft_ms": 12.034333078190684, "decode_ms": 12.009541038423777}, "total_wall_ms": 257.725500036031, "ttft_ms": 12.034333078190684, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451681280, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 5472949688, "process_rss_bytes": 10451681280}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3a3940285617aea6b690d2ad", "attempt_id": "1023e0be5b9e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:17.461468Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.8979580840096, "ttft_ms": 12.113959062844515, "decode_ms": 11.90287503413856}, "total_wall_ms": 252.31304194312543, "ttft_ms": 12.113959062844515, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451697664, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 5747709368, "process_rss_bytes": 10451697664}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f397422a69cbd3f52ae92000", "attempt_id": "94c040541c46", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:17.739701Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.83675005100667, "ttft_ms": 12.140374979935586, "decode_ms": 11.903667007572949}, "total_wall_ms": 252.317416947335, "ttft_ms": 12.140374979935586, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451730432, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 5747709368, "process_rss_bytes": 10451730432}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5bcb5f005f7ff7203ab6bd2d", "attempt_id": "16ccb1b32940", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:18.016974Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.8144169356674, "ttft_ms": 11.85762498062104, "decode_ms": 11.854917043820024}, "total_wall_ms": 251.97129207663238, "ttft_ms": 11.85762498062104, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451746816, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 5903619512, "process_rss_bytes": 10451746816}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9d68fd5c9bb0f2ab37593d1e", "attempt_id": "921a2943c956", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:18.295434Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.91966698039323, "ttft_ms": 12.174999923445284, "decode_ms": 12.01150007545948}, "total_wall_ms": 252.53079109825194, "ttft_ms": 12.174999923445284, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451763200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 6165108152, "process_rss_bytes": 10451763200}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9852a59857c3b80801a1c8c4", "attempt_id": "7c3601bc74ce", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:18.573420Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.45199990458786, "ttft_ms": 11.977541027590632, "decode_ms": 11.922250036150217}, "total_wall_ms": 252.6677920250222, "ttft_ms": 11.977541027590632, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451763200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570343000, "mlx_cache_bytes": 6443013560, "process_rss_bytes": 10451763200}, "peak_prefill_memory": null, "peak_decode_memory": 9570343000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "abc85d9223febaa43529cadc", "attempt_id": "35a9891a148e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:18.851946Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.982583058998, "ttft_ms": 11.9708749698475, "decode_ms": 11.947875027544796}, "total_wall_ms": 252.11316696368158, "ttft_ms": 11.9708749698475, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451763200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 6443013560, "process_rss_bytes": 10451763200}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "513bac79fdaefb2581d44324", "attempt_id": "0726cc7f7f79", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:19.129920Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 2592, "cache_tensor_bytes": null, "serialized_payload_bytes": 2592, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4883.30866699107, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.9370830617845, "ttft_ms": 11.91633299458772, "decode_ms": 11.932708090171218}, "total_wall_ms": 252.0192089723423, "ttft_ms": 11.91633299458772, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5903, "sender_output_tokens": 512, "sender_prefill_ms": 1116.9284170027822, "sender_ttft_ms": 7.593833026476204, "sender_decode_ms": 3753.4081250196323}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451763200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 6599513528, "process_rss_bytes": 10451763200}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4f7d8e67c328bc05348a3c6ae968e20102729a80ef9ecebdf8b5b6d1a3ef16b3", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c452f1e6971a2c661a77ac8b", "attempt_id": "6a50ef695848", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:24.019736Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 369, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.4163340171799, "ttft_ms": 11.921625002287328, "decode_ms": 70.59237500652671}, "total_wall_ms": 230.8877920731902, "ttft_ms": 11.921625002287328, "input_usage": {"receiver_prompt_tokens": 369, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9501479484, "mlx_cache_bytes": 7504698232, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9501479484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rukmelri-6", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "2e6780effd3ce64b936cdd7bf5b52ba071dcd639cc48639e8f72d04cc6978a32"} | ||||
| 354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "701ba02d8eee97e7df846973", "attempt_id": "f886922fe60a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:24.276551Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 374, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.32662499509752, "ttft_ms": 11.852124938741326, "decode_ms": 11.734833009541035}, "total_wall_ms": 167.75824991054833, "ttft_ms": 11.852124938741326, "input_usage": {"receiver_prompt_tokens": 374, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9505329744, "mlx_cache_bytes": 7736402252, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9505329744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9f9260194f345ea505e5c37f", "attempt_id": "a2b20346c519", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:24.469877Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 373, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.19891699030995, "ttft_ms": 11.99445896781981, "decode_ms": 93.96654204465449}, "total_wall_ms": 249.03858301695436, "ttft_ms": 11.99445896781981, "input_usage": {"receiver_prompt_tokens": 373, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9504838224, "mlx_cache_bytes": 7867474252, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9504838224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "908,840 CAD", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "b6d34f4a52b47bcbd6fa1d91b0ece869ed7f0cf729334b779df4648cf8048fd1"} | ||||
| 356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "289ba4454b9f3a54b4edaa72", "attempt_id": "b01f19fc3052", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:24.744079Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 368, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.51854200847447, "ttft_ms": 11.793832993134856, "decode_ms": 11.804542038589716}, "total_wall_ms": 166.86220793053508, "ttft_ms": 11.793832993134856, "input_usage": {"receiver_prompt_tokens": 368, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9501479484, "mlx_cache_bytes": 7867474252, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9501479484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7f3f6482074c6a87f3fe671b", "attempt_id": "d7a99f443ce5", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:24.936207Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 377, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.89583300706, "ttft_ms": 12.161207967437804, "decode_ms": 11.832125019282103}, "total_wall_ms": 167.76524996384978, "ttft_ms": 12.161207967437804, "input_usage": {"receiver_prompt_tokens": 377, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506312796, "mlx_cache_bytes": 8000120620, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9506312796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "addc102ffbf672d501412676", "attempt_id": "86eaaf19ef62", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:25.129958Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 380, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.00349999777973, "ttft_ms": 11.956291040405631, "decode_ms": 11.774832964874804}, "total_wall_ms": 168.74637501314282, "ttft_ms": 11.956291040405631, "input_usage": {"receiver_prompt_tokens": 380, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9508491880, "mlx_cache_bytes": 8235117848, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9508491880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4ec8a6094fdd54b9e498744e", "attempt_id": "edd26600250f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:25.324464Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 368, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.4582920735702, "ttft_ms": 11.97554194368422, "decode_ms": 12.120125000365078}, "total_wall_ms": 167.463666992262, "ttft_ms": 11.97554194368422, "input_usage": {"receiver_prompt_tokens": 368, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9501479484, "mlx_cache_bytes": 8235117848, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9501479484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9d22ffcad53681d32176c34f", "attempt_id": "f427353298fe", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:25.518469Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 370, "message_tokens": 278, "message_utf8_bytes": 590, "cache_tensor_bytes": null, "serialized_payload_bytes": 590, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4612.303541041911, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.96433399431407, "ttft_ms": 11.793458019383252, "decode_ms": 11.85854198411107}, "total_wall_ms": 167.42841701488942, "ttft_ms": 11.793458019383252, "input_usage": {"receiver_prompt_tokens": 370, "sender_input_tokens": 5931, "sender_output_tokens": 471, "sender_prefill_ms": 1119.8400410357863, "sender_ttft_ms": 7.509291986934841, "sender_decode_ms": 3478.861208073795}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9520583248, "mlx_cache_bytes": 8384949528, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 9520583248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7934fbd7c1b3e98316d447603da936e728c52b1cdf3494138a5e2405ccc3b2b8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3fe78f3c5bcf04ba4198b27d", "attempt_id": "4f577ac32e8b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:26.933480Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 36, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.9486249657347798, "receiver_prefill_ms": 0.0, "query_prefill_ms": 81.17541705723852, "ttft_ms": 81.17541705723852, "decode_ms": 632.8901660162956}, "total_wall_ms": 721.5545830549672, "ttft_ms": 81.17541705723852, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9798175952, "mlx_cache_bytes": 9209081401, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9798175952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "full-tylasiza, iowa(7-h, necessari, it depress x2 have even more, i:only):proprietabespresso (adjective /episome love never ex,giants of", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "2db967c80c590e1b0d5d0ae0e05644199cb558a9ab105d0e6b495ed6002b1a45"} | ||||
| 362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da8935913ad8665a73fd573f", "attempt_id": "5f42bbe2bde6", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:27.682194Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 41, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.778624951839447, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.87324997782707, "ttft_ms": 74.87324997782707, "decode_ms": 634.2496250290424}, "total_wall_ms": 716.9927499489859, "ttft_ms": 74.87324997782707, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9808760036, "mlx_cache_bytes": 9265966977, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9808760036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The 15-gbr\nThe high5. ()-the n with the fta(ouchantowardso(recognizestroinb1:0, multidodewginet1:1:1:0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "f189b30500702cb19bcbec4190b79375533d371cf0558363ea1a2d2882e1e8a6"} | ||||
| 363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1675aa9f10cf1d16ea646461", "attempt_id": "2cfe685d26c4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:28.426602Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 40, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.855375012382865, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.8158340100199, "ttft_ms": 73.8158340100199, "decode_ms": 632.0060830330476}, "total_wall_ms": 713.2065409095958, "ttft_ms": 73.8158340100199, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9805958372, "mlx_cache_bytes": 9311055745, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9805958372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "and Iam\nRiv-veck-0)isomomx之子的一种,的，为大同家人为何老之母乳制高，握背打了1:1新的“对分封,在", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "678c7a09c92e6f33c602c413fe744937340d0c5c7de442f8317c9a5f46cc085d"} | ||||
| 364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "67123d9ebe358b864a5cf8be", "attempt_id": "b01233fc28c2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:29.165896Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.794625073671341, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.73583400435746, "ttft_ms": 71.73583400435746, "decode_ms": 633.1209999043494}, "total_wall_ms": 712.6524170162156, "ttft_ms": 71.73583400435746, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9797094608, "mlx_cache_bytes": 9340055425, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9797094608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "O2b can, perhaps, and M still I1.everburn, (couise)2:1, 1g1: \"Pirenterov1., 1.0)dareye11일1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "aef3bccdf3ca1e88bcd203ede3364d23798018d79484b45267cb7c8b9db194bb"} | ||||
| 365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f3d5a5d22bf8fa439165da82", "attempt_id": "84a423bfd014", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:29.905695Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.8178339814767241, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.00783298444003, "ttft_ms": 78.00783298444003, "decode_ms": 631.804250064306}, "total_wall_ms": 717.2382910503075, "ttft_ms": 78.00783298444003, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9812233456, "mlx_cache_bytes": 9409540321, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9812233456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "If\nR, but, in cV) (I: Aest\nPAs in\nP al:1, G, sori: palingian\n光,遵命注成软子型：深博十大:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "40dcb3ce3a3ccd8074cdf55517768a7fb175c26ae4dc07edcb5f3539247f81af"} | ||||
| 366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "37ed06b1489ac0f9f1300592", "attempt_id": "fe25fa46253d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:30.649790Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.7885830020532012, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.86845795251429, "ttft_ms": 76.86845795251429, "decode_ms": 633.0364999594167}, "total_wall_ms": 717.0329579384997, "ttft_ms": 76.86845795251429, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9817476348, "mlx_cache_bytes": 9454924377, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9817476348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A. (unbenimmediate, the force\na)(a)/g) two-dimensionally, 1:get (under thesized language for the conscg_w) :5.0, 1: & g", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "329dcc6abc86afacd9d735ccadc3a604dca0471566ea7731d577aefc06107823"} | ||||
| 367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3a5d76022f8dc8555759e8b6", "attempt_id": "7ac589cd504b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:31.393649Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.9840419990941882, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.24645803216845, "ttft_ms": 72.24645803216845, "decode_ms": 632.104416959919}, "total_wall_ms": 711.8593750055879, "ttft_ms": 72.24645803216845, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9797094608, "mlx_cache_bytes": 9454924377, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9797094608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "O2 to parallel universe in (or, gog-crazy, arcanio\n(force)##\"w/erit.olleyer inductor)a > o:1:1:1. ###-er,能,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "446629df74e8a612c70b62f45908a4214d0ead0d86889333578ba4ca1d4eebdb"} | ||||
| 368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "834d558f4fe2a26ad9597280", "attempt_id": "58b157aac4ec", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:32.131999Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 37, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785854, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1220.610750024207, "doc_prefill_ms": 1103.9894580608234, "compress_ms": 44.39670802094042, "serialize_ms": 60.42287510354072, "load_ms": 1.755791949108243, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.43962502293289, "ttft_ms": 74.43962502293289, "decode_ms": 632.6854160288349}, "total_wall_ms": 714.0436250483617, "ttft_ms": 74.43962502293289, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882547712, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9801813220, "mlx_cache_bytes": 9490920025, "process_rss_bytes": 10882547712}, "peak_prefill_memory": 10049113176, "peak_decode_memory": 9801813220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "&);\nThough, it is a game (lo(toy, letone-1:1, game tileело, \n(1) a\nC开口于不變化(2)和乐)(多,有往复旦,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42740a4c1a16d78118b96c9f83d4d20c1d8f4b33bf88ab5baa8c7a3285947abf", "output_hash": "57919a80ee8323470c0572cbc8aea36741771dda1f92c6cd6d2b5afd6227fd92"} | ||||
| 369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "02705bb9f371c3996a650b95", "attempt_id": "56db8e8cf303", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:36.222579Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 36, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.7562080174684525, "receiver_prefill_ms": 0.0, "query_prefill_ms": 81.96383295580745, "ttft_ms": 81.96383295580745, "decode_ms": 13.538833009079099}, "total_wall_ms": 102.55854204297066, "ttft_ms": 81.96383295580745, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797913808, "mlx_cache_bytes": 9572987481, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9797913808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b362be4bf1d3a5c67fd53eea", "attempt_id": "c3e57efa411d", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:36.352907Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 41, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.6968329437077045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.46304196491838, "ttft_ms": 74.46304196491838, "decode_ms": 121.09537504147738}, "total_wall_ms": 203.10679194517434, "ttft_ms": 74.46304196491838, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9808301284, "mlx_cache_bytes": 9572987481, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9808301284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 234-E, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "0e8d608f6d284831ca9e9d57e85470ebed5c8f169ac56a1db68294de370ed372"} | ||||
| 371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da3566d05e7549270437d087", "attempt_id": "e3c1f2a14ac9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:36.582373Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 40, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.7487499862909317, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.47483409103006, "ttft_ms": 73.47483409103006, "decode_ms": 13.652499997988343}, "total_wall_ms": 95.03170801326632, "ttft_ms": 73.47483409103006, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9805499620, "mlx_cache_bytes": 9572987481, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9805499620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6e062a28485c948e6cdd902c", "attempt_id": "88baf61896c0", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:36.706081Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.6499579651281238, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.36687508318573, "ttft_ms": 71.36687508318573, "decode_ms": 13.553542084991932}, "total_wall_ms": 93.07108307257295, "ttft_ms": 71.36687508318573, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9796832464, "mlx_cache_bytes": 9572987481, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9796832464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c629bbc1fbb1d9cf07220d42", "attempt_id": "1fde62cb30bd", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:36.828141Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.7816249746829271, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.94991706032306, "ttft_ms": 77.94991706032306, "decode_ms": 13.470957987010479}, "total_wall_ms": 98.8183330046013, "ttft_ms": 77.94991706032306, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9811971312, "mlx_cache_bytes": 9572987481, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9811971312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2592a64b87447ddc8201d6d5", "attempt_id": "ce95d1969410", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:36.953277Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.8462500302121043, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.2049169279635, "ttft_ms": 76.2049169279635, "decode_ms": 13.642292004078627}, "total_wall_ms": 97.05112501978874, "ttft_ms": 76.2049169279635, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9817197820, "mlx_cache_bytes": 9573184089, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9817197820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "282c3ea55dfeb602384d28f5", "attempt_id": "054b10ec568b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:37.078194Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.8079589353874326, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.95933298114687, "ttft_ms": 70.95933298114687, "decode_ms": 13.513707905076444}, "total_wall_ms": 91.84887504670769, "ttft_ms": 70.95933298114687, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9796832464, "mlx_cache_bytes": 9573184089, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9796832464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "04ac5d2516e3b24a90435649", "attempt_id": "85d4fb4edaa1", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:37.195867Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 37, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 214769664, "serialized_payload_bytes": 214785955, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.9099579593167, "doc_prefill_ms": 1103.2532920362428, "compress_ms": 2169.456333038397, "serialize_ms": 71.89829193521291, "load_ms": 1.781625091098249, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.50029202643782, "ttft_ms": 73.50029202643782, "decode_ms": 13.51020799484104}, "total_wall_ms": 93.94845901988447, "ttft_ms": 73.50029202643782, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11072897024, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9801551076, "mlx_cache_bytes": 9573184089, "process_rss_bytes": 11072897024}, "peak_prefill_memory": 10049014872, "peak_decode_memory": 9801551076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcc936e9d6da1a0b7d5660270707196334f08e24cecf00cc4cbb996f2790c24", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9341d739979efa9b641157a3", "attempt_id": "bdb62947ff15", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:37.315451Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 36, "compress_ms": 117.86962498445064}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 36, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3391.0295830573887, "doc_prefill_ms": 1104.0184170706198, "compress_ms": 2268.289165920578, "serialize_ms": 18.37583293672651, "load_ms": 1.668625045567751, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.587207979522645, "ttft_ms": 42.587207979522645, "decode_ms": 12.36629206687212}, "total_wall_ms": 3457.232041982934, "ttft_ms": 42.587207979522645, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10985095168, "backend_memory": {"mlx_active_bytes": 9369537544, "mlx_peak_bytes": 9443822800, "mlx_cache_bytes": 10069806561, "process_rss_bytes": 10985095168}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9443822800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eeea42c19d766810e99064e1", "attempt_id": "0e6842f9899e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:40.798949Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 41, "compress_ms": 123.55570902582258}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 41, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3414.40033307299, "doc_prefill_ms": 1103.1146249733865, "compress_ms": 2296.01841699332, "serialize_ms": 14.915707986801863, "load_ms": 1.3338340213522315, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.56445807591081, "ttft_ms": 44.56445807591081, "decode_ms": 12.255125096999109}, "total_wall_ms": 3480.5191250052303, "ttft_ms": 44.56445807591081, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11027349504, "backend_memory": {"mlx_active_bytes": 9369013256, "mlx_peak_bytes": 9452588260, "mlx_cache_bytes": 10117172705, "process_rss_bytes": 11027349504}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9452588260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "835b01e041343cfe796539b7", "attempt_id": "088d425a2c00", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:44.306761Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 40, "compress_ms": 124.82037500012666}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 40, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3418.15966705326, "doc_prefill_ms": 1103.2113330438733, "compress_ms": 2301.07504199259, "serialize_ms": 13.507792027667165, "load_ms": 1.3289169874042273, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.720124918967485, "ttft_ms": 44.720124918967485, "decode_ms": 12.263332959264517}, "total_wall_ms": 3484.3104999745265, "ttft_ms": 44.720124918967485, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11027349504, "backend_memory": {"mlx_active_bytes": 9369013256, "mlx_peak_bytes": 9450605796, "mlx_cache_bytes": 10138815969, "process_rss_bytes": 11027349504}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9450605796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ab672ad2c93ba915d95b8a2a", "attempt_id": "88f15a378674", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:47.818160Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 35, "compress_ms": 120.98358408547938}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3379.856082960032, "doc_prefill_ms": 1103.4089169697836, "compress_ms": 2263.0450000287965, "serialize_ms": 12.998000020161271, "load_ms": 1.3081250945106149, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.63183404691517, "ttft_ms": 42.63183404691517, "decode_ms": 12.301541049964726}, "total_wall_ms": 3443.714416003786, "ttft_ms": 42.63183404691517, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11027382272, "backend_memory": {"mlx_active_bytes": 9369013256, "mlx_peak_bytes": 9442004176, "mlx_cache_bytes": 10163342817, "process_rss_bytes": 11027382272}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9442004176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eadd942cc7be99f45c4085e7", "attempt_id": "2966c68d83ba", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:51.289585Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 44, "compress_ms": 126.77587498910725}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3348.2497920049354, "doc_prefill_ms": 1102.8732500271872, "compress_ms": 2231.5302920760587, "serialize_ms": 13.493417063727975, "load_ms": 1.0311250807717443, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.86887506209314, "ttft_ms": 44.86887506209314, "decode_ms": 12.281292001716793}, "total_wall_ms": 3414.6224999567494, "ttft_ms": 44.86887506209314, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11027415040, "backend_memory": {"mlx_active_bytes": 9369013256, "mlx_peak_bytes": 9457028336, "mlx_cache_bytes": 10206318049, "process_rss_bytes": 11027415040}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9457028336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b071e4880e0518a0b8820f55", "attempt_id": "e2f21f12adfd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:54.731435Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 47, "compress_ms": 127.06833402626216}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3311.157957999967, "doc_prefill_ms": 1103.781291982159, "compress_ms": 2194.858750095591, "serialize_ms": 12.164541985839605, "load_ms": 1.3159170048311353, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.446665978990495, "ttft_ms": 43.446665978990495, "decode_ms": 12.317667016759515}, "total_wall_ms": 3376.482958905399, "ttft_ms": 43.446665978990495, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11027415040, "backend_memory": {"mlx_active_bytes": 9369013256, "mlx_peak_bytes": 9462549756, "mlx_cache_bytes": 10243132897, "process_rss_bytes": 11027415040}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9462549756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3166e8a2e2defe1cdcb45aee", "attempt_id": "4e3e253f64ff", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:25:58.135322Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 35, "compress_ms": 122.27624992374331}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3355.0699580227956, "doc_prefill_ms": 1103.5852080676705, "compress_ms": 2236.1197500722483, "serialize_ms": 15.010208007879555, "load_ms": 1.34320801589638, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.16454201377928, "ttft_ms": 42.16454201377928, "decode_ms": 12.428791960701346}, "total_wall_ms": 3418.9956670161337, "ttft_ms": 42.16454201377928, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11027447808, "backend_memory": {"mlx_active_bytes": 9369013256, "mlx_peak_bytes": 9442004176, "mlx_cache_bytes": 10243132897, "process_rss_bytes": 11027447808}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9442004176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f4e410e030de03ae2de6bf8e", "attempt_id": "61551f900014", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:01.581780Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 37, "compress_ms": 120.45345909427851}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 37, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690341, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3313.5056670289487, "doc_prefill_ms": 1103.5982919856906, "compress_ms": 2197.336124954745, "serialize_ms": 12.18737498857081, "load_ms": 1.2851670617237687, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.78091690503061, "ttft_ms": 42.78091690503061, "decode_ms": 12.319416971877217}, "total_wall_ms": 3377.5768750347197, "ttft_ms": 42.78091690503061, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11027447808, "backend_memory": {"mlx_active_bytes": 9369013256, "mlx_peak_bytes": 9445690596, "mlx_cache_bytes": 10277146081, "process_rss_bytes": 11027447808}, "peak_prefill_memory": 10048982104, "peak_decode_memory": 9445690596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ded4cd95bcecc4559de932383ad62f63f4ae892cebeeda248c3fec330203e64", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b905f73d3a3462348990ffff", "attempt_id": "b5ba9bcfb636", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:05.029991Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2002, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.3023749627173, "ttft_ms": 12.491749948821962, "decode_ms": 120.93174993060529}, "total_wall_ms": 831.3084170222282, "ttft_ms": 12.491749948821962, "input_usage": {"receiver_prompt_tokens": 2002}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10486546432, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968495492, "mlx_cache_bytes": 717591804, "process_rss_bytes": 10486546432}, "peak_prefill_memory": null, "peak_decode_memory": 9968495492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-71M-6213", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "66ef6c5da682b38795e9029723bbd71cdde2c4dec70cf1fae6efe62ef243f10a"} | ||||
| 386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9cd38d7a575bf2d9db5a1ae6", "attempt_id": "63360542f6dc", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:05.881045Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2008, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.741291899234, "ttft_ms": 12.309415964409709, "decode_ms": 144.79220798239112}, "total_wall_ms": 852.6763329282403, "ttft_ms": 12.309415964409709, "input_usage": {"receiver_prompt_tokens": 2008}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10486579200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9970019392, "mlx_cache_bytes": 1309611260, "process_rss_bytes": 10486579200}, "peak_prefill_memory": null, "peak_decode_memory": 9970019392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 601-M, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "c029a5f68d4f87fccebc7b2ed6a8d95f46779503cf4748adb92748629c73f412"} | ||||
| 387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "02fbbd77c5389c2158b5596e", "attempt_id": "62be02baa799", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:06.752744Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2007, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.2907920302823, "ttft_ms": 12.226583086885512, "decode_ms": 84.25162499770522}, "total_wall_ms": 790.3230000520125, "ttft_ms": 12.226583086885512, "input_usage": {"receiver_prompt_tokens": 2007}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10486579200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9970019392, "mlx_cache_bytes": 1309611260, "process_rss_bytes": 10486579200}, "peak_prefill_memory": null, "peak_decode_memory": 9970019392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13.4343", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "599bc22e373b1cf7b4679208eb9e515ad0e8dcb88dde0c7f579637ec7d3f3014"} | ||||
| 388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bd8c52b8b7c67ffed2b11821", "attempt_id": "ef510310fc9c", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:07.561277Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.4218330057338, "ttft_ms": 12.165833031758666, "decode_ms": 96.22758300974965}, "total_wall_ms": 803.0942908953875, "ttft_ms": 12.165833031758666, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10486611968, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968757824, "mlx_cache_bytes": 1662326012, "process_rss_bytes": 10486611968}, "peak_prefill_memory": null, "peak_decode_memory": 9968757824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "adc9a20b9adc1d63e08a6e4c1f5160bd8343c4e09ea9e1ab7296ec885a822f95"} | ||||
| 389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "db43994b998b44d57e90f496", "attempt_id": "b75357bbb610", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:08.382746Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2008, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.11204193905, "ttft_ms": 12.229375075548887, "decode_ms": 84.38341703731567}, "total_wall_ms": 791.2037080386654, "ttft_ms": 12.229375075548887, "input_usage": {"receiver_prompt_tokens": 2008}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10486611968, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9970019392, "mlx_cache_bytes": 1662326012, "process_rss_bytes": 10486611968}, "peak_prefill_memory": null, "peak_decode_memory": 9970019392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8631552", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "147d02c0587a77b3b53f0424c8d3d1454aaf2639ce9fdaf69af20db33363e849"} | ||||
| 390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "86e2652794d0068eaf12452b", "attempt_id": "b213de9f3178", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:09.192154Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2011, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 692.1255419729277, "ttft_ms": 12.549125007353723, "decode_ms": 120.5040420172736}, "total_wall_ms": 828.7093340186402, "ttft_ms": 12.549125007353723, "input_usage": {"receiver_prompt_tokens": 2011}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9971149888, "mlx_cache_bytes": 2288375036, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9971149888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c12828a2b33f2519274197c", "attempt_id": "c5c5a93ef22f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.038787Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 689.8033330217004, "ttft_ms": 12.24954193457961, "decode_ms": 12.284790980629623}, "total_wall_ms": 717.8116249851882, "ttft_ms": 12.24954193457961, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968757824, "mlx_cache_bytes": 2288375036, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9968757824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "598848e9dea338a7fea5c9e8", "attempt_id": "563fad7d439e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:10.774601Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208102710545063, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.9374999813735, "ttft_ms": 12.162208906374872, "decode_ms": 12.09283305797726}, "total_wall_ms": 718.4119999874383, "ttft_ms": 12.162208906374872, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486661120, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968757824, "mlx_cache_bytes": 2288375036, "process_rss_bytes": 10486661120}, "peak_prefill_memory": null, "peak_decode_memory": 9968757824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f7759da6d188fb5c7ca133db", "attempt_id": "3ee728178b9c", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:12.808425Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 212, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 103.91591698862612, "ttft_ms": 11.865084059536457, "decode_ms": 11.733083054423332}, "total_wall_ms": 128.3155829878524, "ttft_ms": 11.865084059536457, "input_usage": {"receiver_prompt_tokens": 212, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9475117000, "mlx_cache_bytes": 3174237256, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9475117000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9425207b497f3b2a59525c95", "attempt_id": "d212181878be", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:12.955478Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 218, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.33599997404963, "ttft_ms": 11.672083986923099, "decode_ms": 11.747790966182947}, "total_wall_ms": 124.43379207979888, "ttft_ms": 11.672083986923099, "input_usage": {"receiver_prompt_tokens": 218, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9481392096, "mlx_cache_bytes": 3390359468, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9481392096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "75d31be304c82ea397a8691e", "attempt_id": "2e781608567e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:13.098198Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 217, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.37154203746468, "ttft_ms": 11.732332990504801, "decode_ms": 11.92020799499005}, "total_wall_ms": 124.60391700733453, "ttft_ms": 11.732332990504801, "input_usage": {"receiver_prompt_tokens": 217, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9481162720, "mlx_cache_bytes": 3390359468, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9481162720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "57d0559dcc7db7b5640f9784", "attempt_id": "d6d6190a12bd", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:13.240248Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 213, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.03908397629857, "ttft_ms": 11.67929102666676, "decode_ms": 11.670875013805926}, "total_wall_ms": 124.01941698044538, "ttft_ms": 11.67929102666676, "input_usage": {"receiver_prompt_tokens": 213, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9475723232, "mlx_cache_bytes": 3544958892, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9475723232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8e74f50ea70ed4a0a0e8aaec", "attempt_id": "5ba8dc6ac670", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:13.382059Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 218, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.78916698694229, "ttft_ms": 11.88458304386586, "decode_ms": 11.686832993291318}, "total_wall_ms": 124.92991704493761, "ttft_ms": 11.88458304386586, "input_usage": {"receiver_prompt_tokens": 218, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9481392096, "mlx_cache_bytes": 3544958892, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9481392096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7699923be29ebc8bf7ceb009", "attempt_id": "36eb5c2f75c5", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:13.524567Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 221, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.39704199880362, "ttft_ms": 11.631374945864081, "decode_ms": 11.636167066171765}, "total_wall_ms": 124.31941705290228, "ttft_ms": 11.631374945864081, "input_usage": {"receiver_prompt_tokens": 221, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9483505644, "mlx_cache_bytes": 3705457436, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9483505644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e10175f79b9087f11b0eab41", "attempt_id": "0d262914bfa8", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:13.666265Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 213, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.01887497492135, "ttft_ms": 11.769833974540234, "decode_ms": 11.722625000402331}, "total_wall_ms": 124.24504198133945, "ttft_ms": 11.769833974540234, "input_usage": {"receiver_prompt_tokens": 213, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9475723232, "mlx_cache_bytes": 3705457436, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9475723232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be59a2e54222d59f5e59eb7e", "attempt_id": "5b129aa5cace", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:13.807885Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 213, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1296.9677079236135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.2586660431698, "ttft_ms": 12.08454102743417, "decode_ms": 11.731458944268525}, "total_wall_ms": 123.88358300086111, "ttft_ms": 12.08454102743417, "input_usage": {"receiver_prompt_tokens": 213, "sender_input_tokens": 2043, "sender_output_tokens": 133, "sender_prefill_ms": 344.9834999628365, "sender_ttft_ms": 7.269958034157753, "sender_decode_ms": 942.9129589116201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486644736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9475723232, "mlx_cache_bytes": 3705457436, "process_rss_bytes": 10486644736}, "peak_prefill_memory": null, "peak_decode_memory": 9475723232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b782ac11ad91ea065b1d7db53ea1358ca04d96dd609e2a9eae5cdccb01b89827", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "64461172866a711e4f3fce52", "attempt_id": "1ffc407adbd0", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:17.650271Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 303, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.91358295362443, "ttft_ms": 11.962124961428344, "decode_ms": 46.934791025705636}, "total_wall_ms": 187.66116595361382, "ttft_ms": 11.962124961428344, "input_usage": {"receiver_prompt_tokens": 303, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9460977972, "mlx_cache_bytes": 4641908780, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9460977972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Marisol Varga", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "f891febe6067d888031dd79f46fc05688cc6941a1de3aea8ec6b534853746ec6"} | ||||
| 402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c0de22deb7e34e5d26f96bab", "attempt_id": "0b2e1d401cff", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:17.856478Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 309, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.05116599984467, "ttft_ms": 11.872584000229836, "decode_ms": 11.828167014755309}, "total_wall_ms": 148.58566701877862, "ttft_ms": 11.872584000229836, "input_usage": {"receiver_prompt_tokens": 309, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9464058188, "mlx_cache_bytes": 4831309052, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9464058188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0917d22d6dfad39c62f8748d", "attempt_id": "7753a1d1c64d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:18.023310Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 308, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.00470808986574, "ttft_ms": 11.771999998018146, "decode_ms": 11.76562497857958}, "total_wall_ms": 147.2713330294937, "ttft_ms": 11.771999998018146, "input_usage": {"receiver_prompt_tokens": 308, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9464058188, "mlx_cache_bytes": 4831309052, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9464058188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b65c8551d73d67e22e0152df", "attempt_id": "2d92fbe703ac", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:18.188717Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 304, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.63287503831089, "ttft_ms": 11.69533294159919, "decode_ms": 93.9974170178175}, "total_wall_ms": 229.97504100203514, "ttft_ms": 11.69533294159919, "input_usage": {"receiver_prompt_tokens": 304, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9461403980, "mlx_cache_bytes": 4938263804, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9461403980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Dubrovnik", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "adc9a20b9adc1d63e08a6e4c1f5160bd8343c4e09ea9e1ab7296ec885a822f95"} | ||||
| 405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3cc718a698c62ec8b823c651", "attempt_id": "df81cd577abc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:18.435990Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 309, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.18174999766052, "ttft_ms": 11.716959066689014, "decode_ms": 11.793749989010394}, "total_wall_ms": 148.33979203831404, "ttft_ms": 11.716959066689014, "input_usage": {"receiver_prompt_tokens": 309, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9464058188, "mlx_cache_bytes": 4938263804, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9464058188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d8dcca54381bcf7d02b8d4e5", "attempt_id": "1256dc9bdfee", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:18.602403Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 312, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.02812507934868, "ttft_ms": 11.790667078457773, "decode_ms": 11.810583993792534}, "total_wall_ms": 148.31966697238386, "ttft_ms": 11.790667078457773, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465958744, "mlx_cache_bytes": 5119406552, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9465958744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6b7c2c63c760827d4262cc87", "attempt_id": "5e93e0f8828f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:18.768292Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 304, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.75266605522484, "ttft_ms": 11.785540962591767, "decode_ms": 11.609708075411618}, "total_wall_ms": 147.83512498252094, "ttft_ms": 11.785540962591767, "input_usage": {"receiver_prompt_tokens": 304, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9461403980, "mlx_cache_bytes": 5119406552, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9461403980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6a6ce3101809aa03402b3f6e", "attempt_id": "988695c75647", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:18.933730Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 304, "message_tokens": 213, "message_utf8_bytes": 596, "cache_tensor_bytes": null, "serialized_payload_bytes": 596, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3699.6441250666976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.84062504861504, "ttft_ms": 11.746375006623566, "decode_ms": 11.756125022657216}, "total_wall_ms": 147.98687491565943, "ttft_ms": 11.746375006623566, "input_usage": {"receiver_prompt_tokens": 304, "sender_input_tokens": 2071, "sender_output_tokens": 468, "sender_prefill_ms": 362.8196669742465, "sender_ttft_ms": 7.328792009502649, "sender_decode_ms": 3327.2122089983895}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486693888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9461403980, "mlx_cache_bytes": 5119406552, "process_rss_bytes": 10486693888}, "peak_prefill_memory": null, "peak_decode_memory": 9461403980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2a97e2969e6cf66de56d470c2f7e7b692063469e71d5fbbf710214ee16b64fee", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9f57f73586a2740a3bc04796", "attempt_id": "9a53394312fc", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:19.470997Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 36, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.9959169439971447, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.2889170050621, "ttft_ms": 47.2889170050621, "decode_ms": 579.028166946955}, "total_wall_ms": 630.0927499542013, "ttft_ms": 47.2889170050621, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9486126288, "mlx_cache_bytes": 5967460361, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9486126288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "..CNC3. havespecial1:192203-1:It is a. nowho: \"Torgo: \"I am sorry #1001. \"O\"statement 10", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "246a84bfcdcb7642506616a963964220b532a5ecc1420bc10b637c1083e67985"} | ||||
| 410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6b215c770ce93f14a49b4f5a", "attempt_id": "18ea37fc5714", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.120048Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.3395410496741533, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.581208964809775, "ttft_ms": 49.581208964809775, "decode_ms": 577.9424170032144}, "total_wall_ms": 630.7186250342056, "ttft_ms": 49.581208964809775, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9496644840, "mlx_cache_bytes": 6063847769, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9496644840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "i.0. 0:0.0.0.0.018255 mou900.1.0.4000.000000 苝字典表記.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "bd2b30c4eda681eeceee45fa7bff94902fdb513a8786e9ae8dd01defb2ad20e9"} | ||||
| 411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a4ae645631f37ec37b689a5d", "attempt_id": "800a9c6bbfff", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:20.769436Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 41, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.471041003242135, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.26533398590982, "ttft_ms": 48.26533398590982, "decode_ms": 579.4123340165243}, "total_wall_ms": 631.0070829931647, "ttft_ms": 48.26533398590982, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9495825640, "mlx_cache_bytes": 6100498777, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9495825640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "intest. \"Brockspannableernoneis not foundmotto, the one- -needpunctuation esxdmgetknew to be theltopsooc. ##\n\nThe Gartner, it is a time not", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "485ed9cff26bd50819c6832be2236744b6c7a1214c9603e79f35d469d248de55"} | ||||
| 412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f357efd3fc1373bcb6b64e78", "attempt_id": "4fe5da983df2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:21.419022Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.4000830706208944, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.42916696704924, "ttft_ms": 47.42916696704924, "decode_ms": 579.286374966614}, "total_wall_ms": 629.8777919728309, "ttft_ms": 47.42916696704924, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9490369768, "mlx_cache_bytes": 6153911986, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9490369768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".## )aIt is also a. The number of the reader's law in_it is still in%md1\n1, \"But the first wejoux the 2000 is a.1.1.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "8ed4edc10700f8589950c90b488653ec9c82e21a7f873a03335007e8afc19d95"} | ||||
| 413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "697d248b9fd60004c8395efc", "attempt_id": "3b236f7c82da", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.067205Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.4112500939518213, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.05820800922811, "ttft_ms": 49.05820800922811, "decode_ms": 579.6434170333669}, "total_wall_ms": 631.9007499841973, "ttft_ms": 49.05820800922811, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9496644840, "mlx_cache_bytes": 6153911986, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9496644840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "oso_Natural morfolks和发展型材體认不出眾会同國產体操化的特点是國王바바transferablebodies.在(eticosso:hp代表的beyond the wcmxategeneral p", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "c8b98a476c101ede851f3fe42012cde383ceb71034ec6509f2347605eedc7aeb"} | ||||
| 414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cb0d81724e35394fdc0cafc8", "attempt_id": "a3af3a2ebc9c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:22.717561Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.4077909290790558, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.58791600074619, "ttft_ms": 49.58791600074619, "decode_ms": 577.3675829404965}, "total_wall_ms": 630.1654999842867, "ttft_ms": 49.58791600074619, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9502149876, "mlx_cache_bytes": 6236356634, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9502149876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "###Resume#### $$fogamarepaísblowetosforsome ofmispelluidespecialjogmattersandobtowardstocourseweb of! importemaguardeletoptow", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "db358e9cd967570548b3316406a22dca812821116142152467e0b5744da96e3c"} | ||||
| 415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d32f2fb12baa75f54f0ae77d", "attempt_id": "e14d0e19698f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:23.367996Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.4101250562816858, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.30750003363937, "ttft_ms": 47.30750003363937, "decode_ms": 579.4518750626594}, "total_wall_ms": 629.9851250369102, "ttft_ms": 47.30750003363937, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9490369768, "mlx_cache_bytes": 6236356634, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9490369768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "will do? ??#aprince’s body?so-let the sávelutiesaucun-hangars forbesovery nogran:## 100:135-urile:10001", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "1ef4c30b036e7865c5954d2fdd835fa2505c0c186f3a158f87c0bb51d0d55a57"} | ||||
| 416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "19c4d32f709d9702db9b4c1f", "attempt_id": "b32cb6c5dbf5", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:24.017216Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490725, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 371.7162919929251, "doc_prefill_ms": 338.32216705195606, "compress_ms": 9.931833017617464, "serialize_ms": 19.991541979834437, "load_ms": 1.42475008033216, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.71945807058364, "ttft_ms": 46.71945807058364, "decode_ms": 581.6012079594657}, "total_wall_ms": 631.8052919814363, "ttft_ms": 46.71945807058364, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632314880, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9490369768, "mlx_cache_bytes": 6236356634, "process_rss_bytes": 10632314880}, "peak_prefill_memory": 9983962000, "peak_decode_memory": 9490369768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "## (h89(局部超新学生活化的接纳链之最美好er法与化學透眼光,如m700 100-1 (...)\nCure之�张先生與先生, 1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "19a014a92c53ac82d82e93b2e1ee5295e3f411c9cf8fea91d33c3d78502abfab", "output_hash": "a59c893a7fa02eb2a91241ac474527e39d9310fa7f9dc84fc3af662c8f989947"} | ||||
| 417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "046bc9c437b41a1b2a763a03", "attempt_id": "3649af0d0956", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:25.942366Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 36, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.5214579179883003, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.745708014816046, "ttft_ms": 59.745708014816046, "decode_ms": 12.629167060367763}, "total_wall_ms": 75.68920799531043, "ttft_ms": 59.745708014816046, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9485536464, "mlx_cache_bytes": 6242254874, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9485536464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4ef3809254cfafdcf59e40f5", "attempt_id": "cb5e4533b3e4", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.038264Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.411958015523851, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.670749994926155, "ttft_ms": 48.670749994926155, "decode_ms": 12.370374985039234}, "total_wall_ms": 64.19454095885158, "ttft_ms": 48.670749994926155, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9496251624, "mlx_cache_bytes": 6242254874, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9496251624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e41ac2f6629862907a022bf5", "attempt_id": "7e2e5598f18c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.121057Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 41, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.3742499286308885, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.13133308198303, "ttft_ms": 48.13133308198303, "decode_ms": 12.4387500109151}, "total_wall_ms": 63.73883399646729, "ttft_ms": 48.13133308198303, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9495432424, "mlx_cache_bytes": 6242254874, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9495432424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b4117e01990ecfe1264b3796", "attempt_id": "c20a2314e3ec", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.202754Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.3279169797897339, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.12295799981803, "ttft_ms": 47.12295799981803, "decode_ms": 12.4129579635337}, "total_wall_ms": 62.578874989412725, "ttft_ms": 47.12295799981803, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9489976552, "mlx_cache_bytes": 6242254874, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9489976552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ebefa776fba768099a109fc4", "attempt_id": "601f6aecc386", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.283030Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.3723330339416862, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.82041702512652, "ttft_ms": 48.82041702512652, "decode_ms": 12.375290971249342}, "total_wall_ms": 64.27904090378433, "ttft_ms": 48.82041702512652, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9496251624, "mlx_cache_bytes": 6242254874, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9496251624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b542d655ea2aaf776bd4e4fa", "attempt_id": "b27053394be7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.365217Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.3903329381719232, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.22308400273323, "ttft_ms": 49.22308400273323, "decode_ms": 12.365374946966767}, "total_wall_ms": 64.77012508548796, "ttft_ms": 49.22308400273323, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9501789428, "mlx_cache_bytes": 6244253722, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9501789428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "598e45dc04879295709bb705", "attempt_id": "21fdaf9ddf5f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.447591Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.4544168952852488, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.84166703373194, "ttft_ms": 46.84166703373194, "decode_ms": 12.317624990828335}, "total_wall_ms": 62.42270895745605, "ttft_ms": 46.84166703373194, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9489976552, "mlx_cache_bytes": 6244253722, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9489976552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f2f129e53104b20e99dedf7a", "attempt_id": "eefd54bb97e7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.528053Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 72474624, "serialized_payload_bytes": 72490826, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9371669227257, "doc_prefill_ms": 337.9960000747815, "compress_ms": 913.2517079124227, "serialize_ms": 20.418417057953775, "load_ms": 1.4407079434022307, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.05083300359547, "ttft_ms": 47.05083300359547, "decode_ms": 12.420917046256363}, "total_wall_ms": 62.63391696847975, "ttft_ms": 47.05083300359547, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604445696, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9489976552, "mlx_cache_bytes": 6244253722, "process_rss_bytes": 10604445696}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9489976552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12fc696466c7bd479be0acd07177fa4d86a66f2980ce4e3647852a28dd8e4d60", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2722724ea0c97fca1fac6a4c", "attempt_id": "c494f6cd4ccd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:26.608229Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 36, "compress_ms": 80.72324993554503}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 36, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1338.9708750182763, "doc_prefill_ms": 338.1549579789862, "compress_ms": 993.672417011112, "serialize_ms": 6.855958024971187, "load_ms": 1.3485840754583478, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.03466704953462, "ttft_ms": 36.03466704953462, "decode_ms": 11.884958017617464}, "total_wall_ms": 1391.6187080321833, "ttft_ms": 36.03466704953462, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10588160000, "backend_memory": {"mlx_active_bytes": 9298938888, "mlx_peak_bytes": 9366179024, "mlx_cache_bytes": 6433226258, "process_rss_bytes": 10588160000}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9366179024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aaccdf903f08af6a9ed9786d", "attempt_id": "a5823347ec12", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:28.017362Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 42, "compress_ms": 84.13795800879598}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1343.1966670323163, "doc_prefill_ms": 338.0277920514345, "compress_ms": 999.7655829647556, "serialize_ms": 5.114166997373104, "load_ms": 3.4518750617280602, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.40508405119181, "ttft_ms": 38.40508405119181, "decode_ms": 82.6051658950746}, "total_wall_ms": 1470.7469169516116, "ttft_ms": 38.40508405119181, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10599956480, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9376402664, "mlx_cache_bytes": 6464192018, "process_rss_bytes": 10599956480}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9376402664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 15, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "f486a810b45b60fbc068580cbf5cb8cafa6430b09938a4da5a7cde1ef642926c"} | ||||
| 427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8e9c45c08aef13cf6e3e62fe", "attempt_id": "8c84ec59a62f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:29.508249Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 41, "compress_ms": 82.68762496300042}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 41, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1330.026917043142, "doc_prefill_ms": 339.05474992934614, "compress_ms": 983.1932499073446, "serialize_ms": 7.486165966838598, "load_ms": 1.2203330406919122, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.095332983881235, "ttft_ms": 37.095332983881235, "decode_ms": 15.222583897411823}, "total_wall_ms": 1386.654332978651, "ttft_ms": 37.095332983881235, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10599972864, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9375583464, "mlx_cache_bytes": 6469352978, "process_rss_bytes": 10599972864}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9375583464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4ed5f75b9c557749467b808a", "attempt_id": "2801127240ae", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:30.914643Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 37, "compress_ms": 84.0038750320673}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153170, "side_information_bytes": 16082, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1345.2705829404294, "doc_prefill_ms": 338.1982919527218, "compress_ms": 1001.4605420874432, "serialize_ms": 5.284333019517362, "load_ms": 1.069541904143989, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.987500032410026, "ttft_ms": 36.987500032410026, "decode_ms": 11.907291016541421}, "total_wall_ms": 1398.6210420262069, "ttft_ms": 36.987500032410026, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10599972864, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9367751912, "mlx_cache_bytes": 6494748178, "process_rss_bytes": 10599972864}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9367751912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "425967e0c12afe0dd0b47aada1402a700a7e273d263fbcda8c02d78ca785adc0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1ab66b1eb9a7f997fa55f966", "attempt_id": "e2bb8575c0ce", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:32.333038Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 42, "compress_ms": 99.19312503188848}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1346.5715419733897, "doc_prefill_ms": 337.60624995920807, "compress_ms": 1003.4252910409123, "serialize_ms": 5.247458000667393, "load_ms": 1.1803749948740005, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.9986249608919, "ttft_ms": 37.9986249608919, "decode_ms": 11.911874986253679}, "total_wall_ms": 1400.914959027432, "ttft_ms": 37.9986249608919, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10600136704, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9376402664, "mlx_cache_bytes": 6494748178, "process_rss_bytes": 10600136704}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9376402664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be70685825890947e50d5197", "attempt_id": "4839bb147094", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:33.753706Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 45, "compress_ms": 83.15991598647088}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1333.8815829483792, "doc_prefill_ms": 338.5733750183135, "compress_ms": 990.2145829983056, "serialize_ms": 4.8075830563902855, "load_ms": 1.2302499962970614, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.09275000821799, "ttft_ms": 38.09275000821799, "decode_ms": 11.87391602434218}, "total_wall_ms": 1388.13483400736, "ttft_ms": 38.09275000821799, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10600136704, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9381940468, "mlx_cache_bytes": 6538657298, "process_rss_bytes": 10600136704}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9381940468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7678a0d3295491fdc52d5451", "attempt_id": "994cdaf2d218", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:35.161479Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 37, "compress_ms": 94.83804099727422}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1361.8782910052687, "doc_prefill_ms": 344.241917016916, "compress_ms": 1012.2919579735026, "serialize_ms": 5.037624971009791, "load_ms": 1.1146250180900097, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.903541021980345, "ttft_ms": 35.903541021980345, "decode_ms": 11.977209011092782}, "total_wall_ms": 1414.2879160353914, "ttft_ms": 35.903541021980345, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10600120320, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9367751912, "mlx_cache_bytes": 6538657298, "process_rss_bytes": 10600120320}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9367751912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "47d469a6286ff8a96e9c917f", "attempt_id": "41ae0cb83200", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:36.595982Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 37, "compress_ms": 77.29362498503178}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1337.1911250287667, "doc_prefill_ms": 338.1575419334695, "compress_ms": 993.852874962613, "serialize_ms": 4.882707959040999, "load_ms": 1.0767499916255474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.71287498623133, "ttft_ms": 38.71287498623133, "decode_ms": 11.942208046093583}, "total_wall_ms": 1392.0343340141699, "ttft_ms": 38.71287498623133, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10600120320, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9367751912, "mlx_cache_bytes": 6538657298, "process_rss_bytes": 10600120320}, "peak_prefill_memory": 9983814544, "peak_decode_memory": 9367751912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e3949894dad7edabe439aa05", "attempt_id": "a030bc215d2f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:38.039996Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5884, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2208.6348340380937, "ttft_ms": 12.643708963878453, "decode_ms": 136.86645799316466}, "total_wall_ms": 2369.046000065282, "ttft_ms": 12.643708963878453, "input_usage": {"receiver_prompt_tokens": 5884}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10451238912, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1911879096, "process_rss_bytes": 10451238912}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XK-22Q-9490", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "30ac087c01ec856cc5d95b422a0504ba4b29982ad42147a0fa27067152bef29e"} | ||||
| 434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b856933aa2cbd489aaf3fa57", "attempt_id": "509235fb5102", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:40.436223Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5890, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2221.1175409611315, "ttft_ms": 12.610833975486457, "decode_ms": 135.3275830624625}, "total_wall_ms": 2379.8637919826433, "ttft_ms": 12.610833975486457, "input_usage": {"receiver_prompt_tokens": 5890}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10451271680, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10078817344, "mlx_cache_bytes": 2481796536, "process_rss_bytes": 10451271680}, "peak_prefill_memory": null, "peak_decode_memory": 10078817344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 229-K, Témiscaming", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "478c2dc9ecddda982c5be668584c11d78d499ab2f12b9d176732310a778efe06"} | ||||
| 435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e979dd8fb7c1487fe5495f75", "attempt_id": "5fe58308e4b9", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:42.841517Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5889, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.8715420747176, "ttft_ms": 13.575874967500567, "decode_ms": 86.10487496480346}, "total_wall_ms": 2313.091624993831, "ttft_ms": 13.575874967500567, "input_usage": {"receiver_prompt_tokens": 5889}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451288064, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2797417912, "process_rss_bytes": 10451288064}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "65.3868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "2dcbcd6384301b1f03d2dd767a2ef0bcb62a10249d084be6e9738ce86fe4690f"} | ||||
| 436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da858b4dd21539c97ad303f6", "attempt_id": "7f40cc5dfb61", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:45.180680Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5885, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2203.8153749890625, "ttft_ms": 12.378833023831248, "decode_ms": 62.478417064994574}, "total_wall_ms": 2289.61362503469, "ttft_ms": 12.378833023831248, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10451320832, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3112383928, "process_rss_bytes": 10451320832}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oksana Varga", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "939426b14501ae244f8b8a79280739080f1b34148143c4f1dab25de69eebfda5"} | ||||
| 437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dd428557724860ec825f758d", "attempt_id": "1ca86b6cc0f5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:47.496530Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5894, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2220.406166044995, "ttft_ms": 12.587666977196932, "decode_ms": 86.70083398465067}, "total_wall_ms": 2330.6456659920514, "ttft_ms": 12.587666977196932, "input_usage": {"receiver_prompt_tokens": 5894}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451337216, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10079947840, "mlx_cache_bytes": 3642734008, "process_rss_bytes": 10451337216}, "peak_prefill_memory": null, "peak_decode_memory": 10079947840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9519700", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "faba5ef4f83e7fb5277d911a073e9e58b13a2602ac2a2a17da9c4966ab281491"} | ||||
| 438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1ac7a5e64b446fddc3485db5", "attempt_id": "5dd5689c82bc", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:49.853072Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5895, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2221.14475001581, "ttft_ms": 12.697250000201166, "decode_ms": 123.47016704734415}, "total_wall_ms": 2368.622458074242, "ttft_ms": 12.697250000201166, "input_usage": {"receiver_prompt_tokens": 5895}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10451369984, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10080209984, "mlx_cache_bytes": 3959535032, "process_rss_bytes": 10451369984}, "peak_prefill_memory": null, "peak_decode_memory": 10080209984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dea8b5dfca295e96a6b1a15e", "attempt_id": "261cd98ce5df", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:52.247995Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5885, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.6884170481935, "ttft_ms": 12.436791090294719, "decode_ms": 12.364333029836416}, "total_wall_ms": 2238.4882079204544, "ttft_ms": 12.436791090294719, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451402752, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3959535032, "process_rss_bytes": 10451402752}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "982e3fdc04c3d1844718a0de", "attempt_id": "38a203c55ca6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:54.513024Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5884, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.0288330493495, "ttft_ms": 12.573875021189451, "decode_ms": 12.355500017292798}, "total_wall_ms": 2237.0962500572205, "ttft_ms": 12.573875021189451, "input_usage": {"receiver_prompt_tokens": 5884}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451435520, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3959535032, "process_rss_bytes": 10451435520}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a9a031c65fc0bf7692433781", "attempt_id": "61f7faaa6af6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:59.697340Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 321, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.9776250012219, "ttft_ms": 11.895583011209965, "decode_ms": 11.691208928823471}, "total_wall_ms": 152.55899995099753, "ttft_ms": 11.895583011209965, "input_usage": {"receiver_prompt_tokens": 321, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470628220, "mlx_cache_bytes": 5615016632, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9470628220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6c8fcbe3280581a10e31c5cd", "attempt_id": "6a1bb989082a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:26:59.876107Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 327, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.22325007338077, "ttft_ms": 11.81766705121845, "decode_ms": 11.740082991309464}, "total_wall_ms": 165.64324998762459, "ttft_ms": 11.81766705121845, "input_usage": {"receiver_prompt_tokens": 327, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9476673940, "mlx_cache_bytes": 5821751248, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9476673940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "52b450e061e0e40b79cd1256", "attempt_id": "411ae2cf6319", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:00.067007Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 326, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.37325005140156, "ttft_ms": 11.744165909476578, "decode_ms": 11.765875038690865}, "total_wall_ms": 165.70020804647356, "ttft_ms": 11.744165909476578, "input_usage": {"receiver_prompt_tokens": 326, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9476182420, "mlx_cache_bytes": 5936308176, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9476182420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fda9030eeadb2cc95ebad054", "attempt_id": "b0f0f70f4a82", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:00.258274Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 322, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.01866697799414, "ttft_ms": 11.991000035777688, "decode_ms": 58.75620793085545}, "total_wall_ms": 211.69304102659225, "ttft_ms": 11.991000035777688, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9488191892, "mlx_cache_bytes": 6065479632, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9488191892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oksana Varga", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "939426b14501ae244f8b8a79280739080f1b34148143c4f1dab25de69eebfda5"} | ||||
| 445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "02040891f3b9582a22dc7d1c", "attempt_id": "4df08145c543", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:00.495328Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 331, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.5466670403257, "ttft_ms": 11.994833941571414, "decode_ms": 11.85774989426136}, "total_wall_ms": 165.37883400451392, "ttft_ms": 11.994833941571414, "input_usage": {"receiver_prompt_tokens": 331, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9479098788, "mlx_cache_bytes": 6270395640, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9479098788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bb2672bab404b6199d7e915a", "attempt_id": "5d8dd98c82e6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:00.686679Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 332, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.97075001336634, "ttft_ms": 11.754874954931438, "decode_ms": 11.799167026765645}, "total_wall_ms": 165.39850004483014, "ttft_ms": 11.754874954931438, "input_usage": {"receiver_prompt_tokens": 332, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9479344552, "mlx_cache_bytes": 6387051044, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9479344552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "89e72b244407f685005cc06b", "attempt_id": "cbf4326ebe4f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:00.878097Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 322, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.04700002260506, "ttft_ms": 12.025792035274208, "decode_ms": 11.850791983306408}, "total_wall_ms": 164.84316706191748, "ttft_ms": 12.025792035274208, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9489830316, "mlx_cache_bytes": 6387051044, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9489830316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5aa91b5eb21d8dd45b42e767", "attempt_id": "5c5c06c4a520", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:01.068822Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 321, "message_tokens": 243, "message_utf8_bytes": 1113, "cache_tensor_bytes": null, "serialized_payload_bytes": 1113, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2921.144000021741, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.83633404877037, "ttft_ms": 11.737750028260052, "decode_ms": 11.71875}, "total_wall_ms": 147.15054200496525, "ttft_ms": 11.737750028260052, "input_usage": {"receiver_prompt_tokens": 321, "sender_input_tokens": 5926, "sender_output_tokens": 243, "sender_prefill_ms": 1119.2550000268966, "sender_ttft_ms": 19.758209004066885, "sender_decode_ms": 1776.6759580699727}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470628220, "mlx_cache_bytes": 6387051044, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9470628220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfc4783a90f8b312e5e9187187cf79f1d99ac44fc0336629240de9cbdff11acf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6309ea2ab48e21ba0530a93e", "attempt_id": "6f717bab1fa9", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.146698Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 409, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 167.20675001852214, "ttft_ms": 12.072999961674213, "decode_ms": 128.72429203707725}, "total_wall_ms": 308.9218749664724, "ttft_ms": 12.072999961674213, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10451517440, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9525794940, "mlx_cache_bytes": 7498328612, "process_rss_bytes": 10451517440}, "peak_prefill_memory": null, "peak_decode_memory": 9525794940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XK-22Q-9490", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "30ac087c01ec856cc5d95b422a0504ba4b29982ad42147a0fa27067152bef29e"} | ||||
| 450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "65d8f43e4cfe9bf8f4e355ec", "attempt_id": "11bf965b97cc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.481831Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 415, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.67629205342382, "ttft_ms": 11.788374977186322, "decode_ms": 11.731249978765845}, "total_wall_ms": 188.05174995213747, "ttft_ms": 11.788374977186322, "input_usage": {"receiver_prompt_tokens": 415, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451533824, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9529890940, "mlx_cache_bytes": 7755098660, "process_rss_bytes": 10451533824}, "peak_prefill_memory": null, "peak_decode_memory": 9529890940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "df13d50b206d602746aef3f7", "attempt_id": "0129221742f4", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.695870Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 414, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.4157079970464, "ttft_ms": 11.816082987934351, "decode_ms": 11.73300005029887}, "total_wall_ms": 187.76166695170105, "ttft_ms": 11.816082987934351, "input_usage": {"receiver_prompt_tokens": 414, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451533824, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9529399420, "mlx_cache_bytes": 7900588580, "process_rss_bytes": 10451533824}, "peak_prefill_memory": null, "peak_decode_memory": 9529399420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6bfb83f547dbbcd76365c495", "attempt_id": "c12d894ec4ed", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:06.909482Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 410, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.56837507151067, "ttft_ms": 11.932292021811008, "decode_ms": 11.81020902004093}, "total_wall_ms": 186.1997089581564, "ttft_ms": 11.932292021811008, "input_usage": {"receiver_prompt_tokens": 410, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451550208, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9546700924, "mlx_cache_bytes": 8066705956, "process_rss_bytes": 10451550208}, "peak_prefill_memory": null, "peak_decode_memory": 9546700924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3b0e235fabda49c1ad4cd182", "attempt_id": "44baea2b2040", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:07.120808Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 419, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.66533292643726, "ttft_ms": 11.826124973595142, "decode_ms": 117.07179201766849}, "total_wall_ms": 295.4666670411825, "ttft_ms": 11.826124973595142, "input_usage": {"receiver_prompt_tokens": 419, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10451566592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9532708988, "mlx_cache_bytes": 8331487780, "process_rss_bytes": 10451566592}, "peak_prefill_memory": null, "peak_decode_memory": 9532708988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,056,740 CAD", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "5ac3b2eb1c8098bee02b29b2b9545e728e03b4a092a020d1250e025310feb3a0"} | ||||
| 454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "97758a9ed8dcbeab3ae11f57", "attempt_id": "7401818ac33b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:07.442332Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 420, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.00745904725045, "ttft_ms": 11.746708070859313, "decode_ms": 11.817874968983233}, "total_wall_ms": 190.35295804496855, "ttft_ms": 11.746708070859313, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451566592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9533200508, "mlx_cache_bytes": 8479336996, "process_rss_bytes": 10451566592}, "peak_prefill_memory": null, "peak_decode_memory": 9533200508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "94fb39e905ec2fc5a1b7f768", "attempt_id": "140bbc1ae77b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:07.658274Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 410, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 162.16208401601762, "ttft_ms": 11.72850001603365, "decode_ms": 11.778749991208315}, "total_wall_ms": 186.4359169267118, "ttft_ms": 11.72850001603365, "input_usage": {"receiver_prompt_tokens": 410, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451566592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9548404860, "mlx_cache_bytes": 8479336996, "process_rss_bytes": 10451566592}, "peak_prefill_memory": null, "peak_decode_memory": 9548404860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "207e5d241e817cda98878b60", "attempt_id": "5fa5594bd6cd", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:07.870305Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 409, "message_tokens": 319, "message_utf8_bytes": 727, "cache_tensor_bytes": null, "serialized_payload_bytes": 727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4903.4517500549555, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.73645795788616, "ttft_ms": 11.943832971155643, "decode_ms": 11.810958967544138}, "total_wall_ms": 186.39254104346037, "ttft_ms": 11.943832971155643, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 1131.8287079920992, "sender_ttft_ms": 7.368249935097992, "sender_decode_ms": 3758.142541977577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451582976, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9525794940, "mlx_cache_bytes": 8479336996, "process_rss_bytes": 10451582976}, "peak_prefill_memory": null, "peak_decode_memory": 9525794940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "18282f285e0f76188ad5ce1f5897135bc665cc6d580afe296b981cc7a8d85d4d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4278fba5de65850ba8df8c8c", "attempt_id": "74006a2e47bf", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:09.261287Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 1.7957501113414764, "receiver_prefill_ms": 0.0, "query_prefill_ms": 81.98741695377976, "ttft_ms": 81.98741695377976, "decode_ms": 633.859834051691}, "total_wall_ms": 724.0521250059828, "ttft_ms": 81.98741695377976, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9797782732, "mlx_cache_bytes": 9584159549, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9797782732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "与会话型：,如,也罢,能夫：,备三来压: 1:0: 35001.0)\n好:能等比学:1:0:0: ", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "ca74c8423e0fb9fec435013e2c764dcf83a76161cf0998a303ed879d0e76fda0"} | ||||
| 458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0ea1292b77de1ff908c5c874", "attempt_id": "2d59736af8eb", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:10.014117Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 41, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 1.7525000730529428, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.26141698285937, "ttft_ms": 73.26141698285937, "decode_ms": 631.5193340415135}, "total_wall_ms": 712.1405419893563, "ttft_ms": 73.26141698285937, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9808661732, "mlx_cache_bytes": 9629396101, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9808661732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "， prêmier equation (a)ab_2,\n如德黑道别.pdf)uom\nPronz(=rounders)(C:QG1)##,A) :a)##1)令人", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "9b3cb031851bb48bc280bd1b7e5743f06bfaba000e8ca9d63aa7e3d71484b9f7"} | ||||
| 459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "85229810831e07b9f998286e", "attempt_id": "509bc9ac49cf", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:10.752486Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 40, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 2.7329580625519156, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.00645899865776, "ttft_ms": 72.00645899865776, "decode_ms": 630.2660839864984}, "total_wall_ms": 710.6467080302536, "ttft_ms": 72.00645899865776, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9806777572, "mlx_cache_bytes": 9671371909, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9806777572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "_Q1.\n与字串分之导,上好上交相對恵可加花:\"接,拉规尺交集采面-5.0:).\n\"###uulx:()【一?R", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "373bf1c251959623bff00b96ebc0bbee5ecaae6d94c08c8296803aaa847fad30"} | ||||
| 460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d16a3a9b232f6d1e22ba9e8f", "attempt_id": "1f8902e54f95", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:11.489472Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 1.7477090004831553, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.25675000902265, "ttft_ms": 73.25675000902265, "decode_ms": 633.6819999851286}, "total_wall_ms": 714.0671249944717, "ttft_ms": 73.25675000902265, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9798274276, "mlx_cache_bytes": 9723473029, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9798274276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#### </>polineng></olley in 19, 1)is(1:2L:chess siri, follow in:goetting-ner, \"A»get up and Gibt52)A", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "7e4c86ed64f2efb7457b0c711fd9b464050b018d051a188cbda31a311ab47765"} | ||||
| 461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2292d5d530d4ba3c53323fe3", "attempt_id": "a35355bfc404", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:12.230337Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 45, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 1.770041068084538, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.77704198472202, "ttft_ms": 78.77704198472202, "decode_ms": 630.1893749041483}, "total_wall_ms": 716.1175000946969, "ttft_ms": 78.77704198472202, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9817083124, "mlx_cache_bytes": 9796562413, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9817083124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rozonesprint(i):\na)A.important:能流:别子化身为王家准测览, 30000英法线上追空霸一拉规: 一定之能登档", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "2300311c98db755a78c61ef08a4466bad4dfbc309c9a4d5e56cf2c2a8274eb28"} | ||||
| 462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d7976672962f8ecc4688f09b", "attempt_id": "6d609310100c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:12.973436Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 46, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 1.7854170873761177, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.97637493442744, "ttft_ms": 78.97637493442744, "decode_ms": 632.2507499717176}, "total_wall_ms": 718.7135420972481, "ttft_ms": 78.97637493442744, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9818197240, "mlx_cache_bytes": 9838866269, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9818197240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "B <=> so im-1:s(15-Coach Practitioner) In anaroq(1:1).The R, we can (x:1),\n的,金复写英译德比之秋烧3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "b52582128f3a67e7fd40e504dda5f4a086c8093b618cf5280d82316942a66e59"} | ||||
| 463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "83f39ebf9fb8c40e0062302e", "attempt_id": "b84fc300ed6a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:13.718142Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 1.8025420140475035, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.51424994319677, "ttft_ms": 72.51424994319677, "decode_ms": 631.7592919804156}, "total_wall_ms": 712.0232080342248, "ttft_ms": 72.51424994319677, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9798274276, "mlx_cache_bytes": 9838866269, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9798274276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "@.c1.\n\n## [奎市价如来\n### \"$(A,|R-3)is\n###gannettusman)##\nBom) 3)#P:B),\r\n###\r\n####", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "e7bb1b956895716bbd337ccc3eaac6b8522b9dff612d8471df7d83e9ef8c9a36"} | ||||
| 464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c456be3bf62f43ad2c50fae1", "attempt_id": "8cab0692fdd8", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:14.458300Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633726, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.8631250383332, "doc_prefill_ms": 1105.1827920600772, "compress_ms": 12.570500024594367, "serialize_ms": 50.05283304490149, "load_ms": 1.768374931998551, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.13774993922561, "ttft_ms": 71.13774993922561, "decode_ms": 632.0770840393379}, "total_wall_ms": 710.2530830306932, "ttft_ms": 71.13774993922561, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883104768, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9797618892, "mlx_cache_bytes": 9838866269, "process_rss_bytes": 10883104768}, "peak_prefill_memory": 10056436824, "peak_decode_memory": 9797618892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "### teller (get (1.):\n\n.#### (b)\n#1.0)1.0:1 -1).\n\n## (b1:1)的首爾外挂話霸usman...m1(", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e27c707747cf74cc78bf6a739022eb0a223b5d9fa9ff34ce828ebe1b88fe58", "output_hash": "1245d6f13367f7c6ba5f5f57b708fbf24d2a26916633a20eb6b60848bddf04a3"} | ||||
| 465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7573f51e7772232aaee25060", "attempt_id": "9e679d9e5ec1", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.428778Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.8675830215215683, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.52887501940131, "ttft_ms": 78.52887501940131, "decode_ms": 13.644375023432076}, "total_wall_ms": 99.6546660317108, "ttft_ms": 78.52887501940131, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797356748, "mlx_cache_bytes": 9922146141, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9797356748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd8625c2b4a7a3d237a3b969", "attempt_id": "5c90f78d06c7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.556112Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 41, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.7834590980783105, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.33274995815009, "ttft_ms": 72.33274995815009, "decode_ms": 13.62737501040101}, "total_wall_ms": 93.19870895706117, "ttft_ms": 72.33274995815009, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9808399588, "mlx_cache_bytes": 9920966493, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9808399588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ac2f0d861a44fe962413727c", "attempt_id": "1e613dbb47b7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.675964Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 40, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.800833037123084, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.15929096471518, "ttft_ms": 71.15929096471518, "decode_ms": 13.673708075657487}, "total_wall_ms": 92.35995798371732, "ttft_ms": 71.15929096471518, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9806515428, "mlx_cache_bytes": 9920966493, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9806515428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d92ac9610bf5732af992569", "attempt_id": "0fd6cb204854", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.795999Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.7456250498071313, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.32283398136497, "ttft_ms": 73.32283398136497, "decode_ms": 13.525458052754402}, "total_wall_ms": 94.34708300977945, "ttft_ms": 73.32283398136497, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9798012132, "mlx_cache_bytes": 9922146141, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9798012132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "999113425cc86dc1dd1181a6", "attempt_id": "415f84cf63f9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:18.916459Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 45, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.6567920101806521, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.0244170455262, "ttft_ms": 78.0244170455262, "decode_ms": 13.422084040939808}, "total_wall_ms": 98.6744579859078, "ttft_ms": 78.0244170455262, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9816607988, "mlx_cache_bytes": 9920966493, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9816607988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eb25e952a8f77ddc6fc8f12c", "attempt_id": "afca8b4de5f9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.040607Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 46, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.7654170515015721, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.42791599594057, "ttft_ms": 77.42791599594057, "decode_ms": 13.668040977790952}, "total_wall_ms": 98.42645796015859, "ttft_ms": 77.42791599594057, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9817935096, "mlx_cache_bytes": 9920966493, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9817935096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e39489ad4183516982b55a9c", "attempt_id": "a500ed928f3e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.166311Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.7436250345781446, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.40479201916605, "ttft_ms": 71.40479201916605, "decode_ms": 13.532415963709354}, "total_wall_ms": 92.48574997764081, "ttft_ms": 71.40479201916605, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9798012132, "mlx_cache_bytes": 9922146141, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9798012132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a0fa11f2d9339d54ae2d05f1", "attempt_id": "1640b387be4f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.285868Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 215617536, "serialized_payload_bytes": 215633827, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3228.2990000676364, "doc_prefill_ms": 1102.8534590732306, "compress_ms": 2064.2632499802858, "serialize_ms": 60.858000069856644, "load_ms": 1.6952500445768237, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.32441697083414, "ttft_ms": 70.32441697083414, "decode_ms": 13.514875085093081}, "total_wall_ms": 91.20825002901256, "ttft_ms": 70.32441697083414, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073945600, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797356748, "mlx_cache_bytes": 9922146141, "process_rss_bytes": 11073945600}, "peak_prefill_memory": 10056338520, "peak_decode_memory": 9797356748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "001df03bcff5b9d083d9a9434d185727c08e3e8d258c9b6570c23116614fed80", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6ebae677a5a83388676e4531", "attempt_id": "8aaa4d2d228f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:19.403728Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 35, "compress_ms": 117.21712502185255}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911525, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3360.908875009045, "doc_prefill_ms": 1103.5537919960916, "compress_ms": 2238.3562499890104, "serialize_ms": 18.646917073056102, "load_ms": 1.7918330850079656, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.60579205583781, "ttft_ms": 42.60579205583781, "decode_ms": 12.307083932682872}, "total_wall_ms": 3428.2268329989165, "ttft_ms": 42.60579205583781, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10985521152, "backend_memory": {"mlx_active_bytes": 9369324552, "mlx_peak_bytes": 9442299084, "mlx_cache_bytes": 10436152133, "process_rss_bytes": 10985521152}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9442299084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "284c60197db4c28962b39bb02e8b157c89dbaf483edc012831a3b3d8991dcfac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "62f3232be9fdaf1107b2421e", "attempt_id": "bea84501a9e8", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:22.858479Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 41, "compress_ms": 129.76045801769942}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 41, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911525, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3391.9812079984695, "doc_prefill_ms": 1103.1644589966163, "compress_ms": 2274.964459007606, "serialize_ms": 13.489332981407642, "load_ms": 1.3128750724717975, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.67483302485198, "ttft_ms": 43.67483302485198, "decode_ms": 12.321999995037913}, "total_wall_ms": 3457.2287920163944, "ttft_ms": 43.67483302485198, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039817728, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9452588260, "mlx_cache_bytes": 10472459077, "process_rss_bytes": 11039817728}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9452588260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "284c60197db4c28962b39bb02e8b157c89dbaf483edc012831a3b3d8991dcfac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4988f839f7e23dbad9cf43b8", "attempt_id": "ad2d9731e961", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:26.343358Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 40, "compress_ms": 119.60962496232241}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 40, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911525, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3379.7046669060364, "doc_prefill_ms": 1104.3497920036316, "compress_ms": 2262.1120830299333, "serialize_ms": 12.88545795250684, "load_ms": 1.2742090038955212, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.128417037427425, "ttft_ms": 44.128417037427425, "decode_ms": 12.310874997638166}, "total_wall_ms": 3445.24741708301, "ttft_ms": 44.128417037427425, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039850496, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9450720484, "mlx_cache_bytes": 10491530053, "process_rss_bytes": 11039850496}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9450720484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "284c60197db4c28962b39bb02e8b157c89dbaf483edc012831a3b3d8991dcfac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b924b2d091feb9a3b513a352", "attempt_id": "e08dfceaa920", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:29.815890Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 36, "compress_ms": 123.3815000159666}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911524, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3359.7909169038758, "doc_prefill_ms": 1104.3142500566319, "compress_ms": 2240.1879590470344, "serialize_ms": 14.930750010535121, "load_ms": 1.3318329583853483, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.78041701763868, "ttft_ms": 42.78041701763868, "decode_ms": 12.356374994851649}, "total_wall_ms": 3424.313583993353, "ttft_ms": 42.78041701763868, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039850496, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9443118308, "mlx_cache_bytes": 10526083909, "process_rss_bytes": 11039850496}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9443118308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e21e3c6bf64e554f3f8e44187bd8ca16049a1f31bf66cc6997253cd805278785", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e22bf28aa2dcf13279ca9203", "attempt_id": "c0deef213ed6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:33.268623Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 45, "compress_ms": 125.38208405021578}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 45, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911525, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3396.2460829643533, "doc_prefill_ms": 1104.2607919080183, "compress_ms": 2278.1640829052776, "serialize_ms": 13.45804100856185, "load_ms": 1.342084025964141, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.808875070884824, "ttft_ms": 44.808875070884824, "decode_ms": 12.293541920371354}, "total_wall_ms": 3462.8759160405025, "ttft_ms": 44.808875070884824, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039883264, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9461124340, "mlx_cache_bytes": 10602597189, "process_rss_bytes": 11039883264}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9461124340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "284c60197db4c28962b39bb02e8b157c89dbaf483edc012831a3b3d8991dcfac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bc69e32869df8d4e8d6fdde7", "attempt_id": "adc82beef28a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:36.759266Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 46, "compress_ms": 125.65845809876919}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 46, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911525, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3364.342459011823, "doc_prefill_ms": 1104.3017919873819, "compress_ms": 2247.0174999907613, "serialize_ms": 12.67204200848937, "load_ms": 1.310708001255989, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.98129093553871, "ttft_ms": 44.98129093553871, "decode_ms": 12.288541998714209}, "total_wall_ms": 3430.7832919294015, "ttft_ms": 44.98129093553871, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039916032, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9462156536, "mlx_cache_bytes": 10621848389, "process_rss_bytes": 11039916032}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9462156536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "284c60197db4c28962b39bb02e8b157c89dbaf483edc012831a3b3d8991dcfac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61c7351f6a6b5df67121a273", "attempt_id": "56a45fc03a24", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:40.218224Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 36, "compress_ms": 122.90225003380328}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911525, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3417.53295797389, "doc_prefill_ms": 1103.8512089289725, "compress_ms": 2298.4382919967175, "serialize_ms": 14.888458070345223, "load_ms": 1.3068330008536577, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.01929101347923, "ttft_ms": 43.01929101347923, "decode_ms": 12.216416071169078}, "total_wall_ms": 3482.648167060688, "ttft_ms": 43.01929101347923, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039916032, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9443118308, "mlx_cache_bytes": 10623028037, "process_rss_bytes": 11039916032}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9443118308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "284c60197db4c28962b39bb02e8b157c89dbaf483edc012831a3b3d8991dcfac", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6e9dd5c1a4b8eb3c6ef6b530", "attempt_id": "a11c2fdd1214", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:43.728184Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 35, "compress_ms": 119.88695792388171}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911525, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3420.2400830108672, "doc_prefill_ms": 1102.2964579751715, "compress_ms": 2302.6336249895394, "serialize_ms": 14.950709068216383, "load_ms": 1.319709001109004, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.76245797518641, "ttft_ms": 42.76245797518641, "decode_ms": 12.232500012032688}, "total_wall_ms": 3484.823958016932, "ttft_ms": 42.76245797518641, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039916032, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9441807564, "mlx_cache_bytes": 10623028037, "process_rss_bytes": 11039916032}, "peak_prefill_memory": 10056305752, "peak_decode_memory": 9441807564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "284c60197db4c28962b39bb02e8b157c89dbaf483edc012831a3b3d8991dcfac", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4bf37ca6613404560d6f8b89", "attempt_id": "dbc967bb21c0", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:47.285555Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1997, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.3248329702765, "ttft_ms": 12.4389169504866, "decode_ms": 132.55575008224696}, "total_wall_ms": 844.9111660011113, "ttft_ms": 12.4389169504866, "input_usage": {"receiver_prompt_tokens": 1997}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10487021568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9966627696, "mlx_cache_bytes": 715724008, "process_rss_bytes": 10487021568}, "peak_prefill_memory": null, "peak_decode_memory": 9966627696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GK-89M-5278", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "4e341227263a52b9d9acb67622f40b4070f4066768b00cd60b5a08c6be006b0a"} | ||||
| 482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aab1907d61183041b3af20a2", "attempt_id": "64a78980508f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:48.150428Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2002, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 692.7678750362247, "ttft_ms": 12.201334000565112, "decode_ms": 120.2214160002768}, "total_wall_ms": 828.7231670692563, "ttft_ms": 12.201334000565112, "input_usage": {"receiver_prompt_tokens": 2002}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487037952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968495680, "mlx_cache_bytes": 1339118824, "process_rss_bytes": 10487037952}, "peak_prefill_memory": null, "peak_decode_memory": 9968495680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 660-H, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "9a7648510c9743a8126239d7e19fd7d94f460c7b55140f10a05845c7aca9cd3c"} | ||||
| 483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "687f115ac212d1a1e73278ca", "attempt_id": "8804d69f9b21", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:48.998655Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2001, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.4235420515761, "ttft_ms": 12.409999966621399, "decode_ms": 84.78962501976639}, "total_wall_ms": 791.122708003968, "ttft_ms": 12.409999966621399, "input_usage": {"receiver_prompt_tokens": 2001}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487037952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968364608, "mlx_cache_bytes": 1339118824, "process_rss_bytes": 10487037952}, "peak_prefill_memory": null, "peak_decode_memory": 9968364608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "89.3122", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "2138888e6519b2f4b1b54142e6f9c541102d7f9ee5bcf8e4184c81a382601757"} | ||||
| 484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b6e0b387148377470d2783f3", "attempt_id": "4ea2363c4195", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:49.808474Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1997, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.4790409607813, "ttft_ms": 12.33745797071606, "decode_ms": 72.5537920370698}, "total_wall_ms": 778.9481249637902, "ttft_ms": 12.33745797071606, "input_usage": {"receiver_prompt_tokens": 1997}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10487037952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9966627696, "mlx_cache_bytes": 1339118824, "process_rss_bytes": 10487037952}, "peak_prefill_memory": null, "peak_decode_memory": 9966627696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "f42f05ebfc96f7258cbfbbb37cd65e114d3d15f869e68e6c95b71fc288c30a32"} | ||||
| 485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b101c4d0d0c61c8341bdeab0", "attempt_id": "2e10cac61873", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:50.608061Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2006, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 692.3881249967963, "ttft_ms": 12.368333991616964, "decode_ms": 83.96420802455395}, "total_wall_ms": 792.2789589501917, "ttft_ms": 12.368333991616964, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487070720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9969757248, "mlx_cache_bytes": 1930876136, "process_rss_bytes": 10487070720}, "peak_prefill_memory": null, "peak_decode_memory": 9969757248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8421725", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "e4949aba3b0b77de05a87edaab854329fa75df7bf68b29a3def71e985a06e5b5"} | ||||
| 486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8fccf21a5d1c1c621a5d31d1", "attempt_id": "4771d1ffc54a", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:51.419541Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2006, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.2459579762071, "ttft_ms": 12.087292037904263, "decode_ms": 119.87554200459272}, "total_wall_ms": 826.3516249135137, "ttft_ms": 12.087292037904263, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487037952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9969757248, "mlx_cache_bytes": 1930876136, "process_rss_bytes": 10487037952}, "peak_prefill_memory": null, "peak_decode_memory": 9969757248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c83905256663f85087d43523", "attempt_id": "6db5e223f3f0", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:52.263869Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1998, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.3796250009909, "ttft_ms": 12.206917046569288, "decode_ms": 12.064834008924663}, "total_wall_ms": 719.0209160326049, "ttft_ms": 12.206917046569288, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487070720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10008636480, "mlx_cache_bytes": 2340017384, "process_rss_bytes": 10487070720}, "peak_prefill_memory": null, "peak_decode_memory": 10008636480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1fe2215ea69171c119f869ea", "attempt_id": "5eba59d80663", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:53.000745Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1998, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.0741660976782, "ttft_ms": 12.009833008050919, "decode_ms": 12.080042040906847}, "total_wall_ms": 718.3822499355301, "ttft_ms": 12.009833008050919, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487070720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10016844864, "mlx_cache_bytes": 2340017384, "process_rss_bytes": 10487070720}, "peak_prefill_memory": null, "peak_decode_memory": 10016844864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c0f11bbe19f8ee37ba977bc6", "attempt_id": "18b5d26aed5f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:57.723083Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 232.35512501560152, "ttft_ms": 12.105582980439067, "decode_ms": 130.27116691228002}, "total_wall_ms": 376.02533295284957, "ttft_ms": 12.105582980439067, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10487103488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 3498918120, "process_rss_bytes": 10487103488}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GK-89M-5278", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "4e341227263a52b9d9acb67622f40b4070f4066768b00cd60b5a08c6be006b0a"} | ||||
| 490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "85e403406c4ec73c65bb3e56", "attempt_id": "d68ee9d75e37", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:58.118632Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.984457927756, "ttft_ms": 12.210207991302013, "decode_ms": 94.7247090516612}, "total_wall_ms": 335.09675005916506, "ttft_ms": 12.210207991302013, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10487119872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 3773677800, "process_rss_bytes": 10487119872}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2797, Matagami", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "db7314f5b0ee0db03ad333bd63ee50d583ac3c0dbc62e6e093b988c06e475b9f"} | ||||
| 491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9b45631bd1b0cd37b8b9d60", "attempt_id": "60537c419eec", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:58.472107Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.83387494180351, "ttft_ms": 12.109708040952682, "decode_ms": 82.91904209181666}, "total_wall_ms": 322.91333307512105, "ttft_ms": 12.109708040952682, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487136256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 3773677800, "process_rss_bytes": 10487136256}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "89.3122", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "2138888e6519b2f4b1b54142e6f9c541102d7f9ee5bcf8e4184c81a382601757"} | ||||
| 492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d3062fd2ed5b71143b87ddf8", "attempt_id": "6f05490d2f30", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:58.813468Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.68012499343604, "ttft_ms": 11.865749955177307, "decode_ms": 11.894416995346546}, "total_wall_ms": 251.42654101364315, "ttft_ms": 11.865749955177307, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487152640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 3773677800, "process_rss_bytes": 10487152640}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ce04caef44f9c5db481487d5", "attempt_id": "637cdcbf7158", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:59.082810Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.11866698227823, "ttft_ms": 12.094166013412178, "decode_ms": 82.92079193051904}, "total_wall_ms": 323.3075001044199, "ttft_ms": 12.094166013412178, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487169024, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9569065048, "mlx_cache_bytes": 4035559656, "process_rss_bytes": 10487169024}, "peak_prefill_memory": null, "peak_decode_memory": 9569065048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7028925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "e966a398855c104a86bce07742c3ce8108a432926bc704940ecfd07e44596774"} | ||||
| 494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "04fae2eae087d3a4e05a4ef6", "attempt_id": "e4ab5485d859", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:59.423791Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.34308301005512, "ttft_ms": 11.89987501129508, "decode_ms": 118.26333298813552}, "total_wall_ms": 358.689249958843, "ttft_ms": 11.89987501129508, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487185408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9569065048, "mlx_cache_bytes": 4035559656, "process_rss_bytes": 10487185408}, "peak_prefill_memory": null, "peak_decode_memory": 9569065048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "792e0c8b1910286ed41e489f", "attempt_id": "f228adcbce97", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:27:59.801311Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.8440000480041, "ttft_ms": 12.001541093923151, "decode_ms": 12.138916994445026}, "total_wall_ms": 252.1657079923898, "ttft_ms": 12.001541093923151, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487185408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 4192059624, "process_rss_bytes": 10487185408}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8b0d5a0fd92404b1bee9789a", "attempt_id": "2f7267344a8d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:00.073416Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1223, "cache_tensor_bytes": null, "serialized_payload_bytes": 1223, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.457749920897, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.25425003934652, "ttft_ms": 12.27487507276237, "decode_ms": 11.94741704966873}, "total_wall_ms": 251.69649999588728, "ttft_ms": 12.27487507276237, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 346.69720800593495, "sender_ttft_ms": 7.5711250538006425, "sender_decode_ms": 3629.3739159591496}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487185408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 4192059624, "process_rss_bytes": 10487185408}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c1ffd289620e34620ab40b1d02ca34734d05af59c5a711a56677cb91767b7f3", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cc8c42eca5a0565724c4bd4e", "attempt_id": "33e7d074d9ab", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.348536Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 395, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.10587493050843, "ttft_ms": 11.919832904823124, "decode_ms": 11.785124894231558}, "total_wall_ms": 190.71229198016226, "ttft_ms": 11.919832904823124, "input_usage": {"receiver_prompt_tokens": 395, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487201792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9518520444, "mlx_cache_bytes": 5169050924, "process_rss_bytes": 10487201792}, "peak_prefill_memory": null, "peak_decode_memory": 9518520444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "11757fd0f1d664f6b4b73865", "attempt_id": "ca889eb110a3", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.558192Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 400, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.66379197966307, "ttft_ms": 11.804541922174394, "decode_ms": 128.62495810259134}, "total_wall_ms": 302.99712496344, "ttft_ms": 11.804541922174394, "input_usage": {"receiver_prompt_tokens": 400, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10487201792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9521109116, "mlx_cache_bytes": 5403211052, "process_rss_bytes": 10487201792}, "peak_prefill_memory": null, "peak_decode_memory": 9521109116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 511-N in Sept-Îles", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "732a65fcf4f26f0d8d94ac953d61fc35f90b83d258c50f82c2ad41121fcdedff"} | ||||
| 499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "328e03a75af09de277a5b9a0", "attempt_id": "e09678425a3a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:04.879342Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 399, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.13283403683454, "ttft_ms": 12.188583030365407, "decode_ms": 11.861874954774976}, "total_wall_ms": 186.12291605677456, "ttft_ms": 12.188583030365407, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487201792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9520617596, "mlx_cache_bytes": 5543458092, "process_rss_bytes": 10487201792}, "peak_prefill_memory": null, "peak_decode_memory": 9520617596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e4bc260d6edd7aee2ff977f7", "attempt_id": "0304d8b41723", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:05.083058Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 395, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.8905829489231, "ttft_ms": 12.187000014819205, "decode_ms": 11.877833981998265}, "total_wall_ms": 185.9338328940794, "ttft_ms": 12.187000014819205, "input_usage": {"receiver_prompt_tokens": 395, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487201792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9518454908, "mlx_cache_bytes": 5543458092, "process_rss_bytes": 10487201792}, "peak_prefill_memory": null, "peak_decode_memory": 9518454908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "097f5f97d12b5cbdb8d665d6", "attempt_id": "c25ad340425e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:05.288385Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 404, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.61854204256088, "ttft_ms": 11.948665953241289, "decode_ms": 117.05524998251349}, "total_wall_ms": 291.59445804543793, "ttft_ms": 11.948665953241289, "input_usage": {"receiver_prompt_tokens": 404, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487201792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9528727676, "mlx_cache_bytes": 5775029548, "process_rss_bytes": 10487201792}, "peak_prefill_memory": null, "peak_decode_memory": 9528727676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,421,725 EUR", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "7f48f8bc6e550fbdded31e35b8d8ea29de8ad11d88b43b3b1a42912d8a15e60e"} | ||||
| 502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cf791fed91a5726bc44d526e", "attempt_id": "32d11a3fdcc7", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:05.599759Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 404, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.61579207982868, "ttft_ms": 11.80249999742955, "decode_ms": 11.873624986037612}, "total_wall_ms": 186.08995899558067, "ttft_ms": 11.80249999742955, "input_usage": {"receiver_prompt_tokens": 404, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487201792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9528711292, "mlx_cache_bytes": 5776684332, "process_rss_bytes": 10487201792}, "peak_prefill_memory": null, "peak_decode_memory": 9528711292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e4dbf1e48bcc58420413537f", "attempt_id": "f41faf75253f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:05.804594Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 396, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.1789589514956, "ttft_ms": 12.05283310264349, "decode_ms": 11.91562507301569}, "total_wall_ms": 186.08374998439103, "ttft_ms": 12.05283310264349, "input_usage": {"receiver_prompt_tokens": 396, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487218176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9518700668, "mlx_cache_bytes": 5915882796, "process_rss_bytes": 10487218176}, "peak_prefill_memory": null, "peak_decode_memory": 9518700668, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "660f237c2f53feab2d595b33", "attempt_id": "403217c39894", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:06.008918Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 396, "message_tokens": 305, "message_utf8_bytes": 725, "cache_tensor_bytes": null, "serialized_payload_bytes": 725, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4004.6149590052664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.4513749955222, "ttft_ms": 11.83879200834781, "decode_ms": 11.769999982789159}, "total_wall_ms": 186.00716697983444, "ttft_ms": 11.83879200834781, "input_usage": {"receiver_prompt_tokens": 396, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 366.54341605026275, "sender_ttft_ms": 7.142791990190744, "sender_decode_ms": 3628.7803340237588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487234560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9518700668, "mlx_cache_bytes": 5915882796, "process_rss_bytes": 10487234560}, "peak_prefill_memory": null, "peak_decode_memory": 9518700668, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d59ec7b547816dd6954e19fa848f31e39489dba2816664c179454207d21d894e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "162b7ad2e9692de1a31a1978", "attempt_id": "f913a96c7801", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:06.583757Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 1.9633750198408961, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.402249998413026, "ttft_ms": 47.402249998413026, "decode_ms": 576.5245000366122}, "total_wall_ms": 627.6465409900993, "ttft_ms": 47.402249998413026, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9486306512, "mlx_cache_bytes": 6668532573, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9486306512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "defin the 'Ofibus driver for the 'a:O们应当的，省会长寿阳，切勿华光头-2021: \"Proiequaterly，我-6-1.5.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "89fb8b046b658af549fe8c3f5fade883c6e9b19bc89475d606387734283dcfc5"} | ||||
| 506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c32d19b4e358a1ac499fcf80", "attempt_id": "2c7762bbf72f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:07.230519Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 41, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 1.3210000470280647, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.31233399454504, "ttft_ms": 48.31233399454504, "decode_ms": 578.0774999875575}, "total_wall_ms": 629.5269998954609, "ttft_ms": 48.31233399454504, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9495121124, "mlx_cache_bytes": 6826081445, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9495121124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\\（: aslum:.：等白=吸=20[AB]。\n.00: 1: \"Sput of:古en-mus:“: \"0.001-'s", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "527d812f28bfcd37f6de909da73466ae9dfb14327facf0a1fa1f952e87b1afdc"} | ||||
| 507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b80df33f0e03bf13f99b553a", "attempt_id": "6f1edcc2b2ab", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:07.878622Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 40, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 1.2957080034539104, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.2578749069944, "ttft_ms": 48.2578749069944, "decode_ms": 576.7115409253165}, "total_wall_ms": 628.1991250580177, "ttft_ms": 48.2578749069944, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9493744868, "mlx_cache_bytes": 6878936229, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9493744868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ch.fce3puzziborn_your_y()to do P这个词在地名詞未接骨稀有()nbuse()()：文凭舱未联合作方式中子路易大题为粉小角", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "46e65e3f5dc4577ea9208e983223bf1322de396a6c54906994e9167c9d44ea7d"} | ||||
| 508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "571c4caabb460589dc28aa1a", "attempt_id": "857258a79748", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:08.526658Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 1.4179169666022062, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.88983398955315, "ttft_ms": 46.88983398955315, "decode_ms": 578.0955420341343}, "total_wall_ms": 628.1713329954073, "ttft_ms": 46.88983398955315, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9486077136, "mlx_cache_bytes": 6878936229, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9486077136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes, lederivations stands out of to the same number of.\nIn the \"vibyarenavemotet. zixix3,iPSCGAOBLAST (马拉vinylsaooscarow()", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "68473671b53af5e7b01007187e533f5163a354d0f0a7c9a1adeaccb2e4e0e3ab"} | ||||
| 509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c52977b2b8a518899e9d8fd0", "attempt_id": "32f7553463e4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:09.173885Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 0.9464999893680215, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.32783404365182, "ttft_ms": 49.32783404365182, "decode_ms": 576.1515409685671}, "total_wall_ms": 628.2756669679657, "ttft_ms": 49.32783404365182, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9503050996, "mlx_cache_bytes": 6973832717, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9503050996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "## what is the bouncity, color is the language and counting the serenade conclave除外，namingday - \"1：中文-1 2780-15% ofm折 -1.00", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "7cfb06191174c0efbbf13c52b8cee4acd3a9a8ef155fc6faa20736a919b70f8a"} | ||||
| 510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "396a093393744c49c50c8d01", "attempt_id": "5972fd08951b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:09.821269Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 1.4979999978095293, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.47979196347296, "ttft_ms": 48.47979196347296, "decode_ms": 576.0765409795567}, "total_wall_ms": 627.800332964398, "ttft_ms": 48.47979196347296, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9503378676, "mlx_cache_bytes": 6973832717, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9503378676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#'nuber_wollog500对lineb50用G6-armenouro: 000-1.01-1.001文摘机长空气长空气的明信", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "145164c3af8faa7a1c96714efe3951658a4113831b6cb1ef422bf30dc0ae9a21"} | ||||
| 511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f5e1914782e2db5aafa3ff35", "attempt_id": "c2d7b2fe7b33", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:10.467548Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 1.4364169910550117, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.4501249846071, "ttft_ms": 47.4501249846071, "decode_ms": 577.4306250968948}, "total_wall_ms": 628.0813328921795, "ttft_ms": 47.4501249846071, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9490615524, "mlx_cache_bytes": 6999032678, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9490615524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "defin Kno.hauogs60'.na_noceloan hemof the prenso.\n) that he master thatsoon- \"Scheibeepstukwichtofootsit is a fewfors", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "5c7daf075dba4971bf4f2ef23fd152df8b33d6eacc27f66c5fe87bd7913591da"} | ||||
| 512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9f9bd98746fe59ff98e29421", "attempt_id": "ec54964c3910", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:11.114028Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306405, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 369.37966698314995, "doc_prefill_ms": 338.58195797074586, "compress_ms": 9.966707904823124, "serialize_ms": 17.239416018128395, "load_ms": 1.439542043954134, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.203625086694956, "ttft_ms": 47.203625086694956, "decode_ms": 576.3452920364216}, "total_wall_ms": 626.8500419100747, "ttft_ms": 47.203625086694956, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632691712, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9490500836, "mlx_cache_bytes": 6999032678, "process_rss_bytes": 10632691712}, "peak_prefill_memory": 9982159740, "peak_decode_memory": 9490500836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "defacno. abrunit_one_shot_no. instru: 12 pontos-1.001-derogaerogm.toch: 1h24133万能：.001", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c98af18d1d77a644ec20d75cf24644e771975c330eee3d10fcb7cce4f4d50c42", "output_hash": "159ecb8b0b22889ccbec8e83671f2ba374c0f3c5e361b267b23ac9ee8cfbec23"} | ||||
| 513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aff71b6da018d9e48b184fec", "attempt_id": "6fb79d320fd1", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.033657Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.504874904640019, "receiver_prefill_ms": 0.0, "query_prefill_ms": 65.1215419638902, "ttft_ms": 65.1215419638902, "decode_ms": 12.508457992225885}, "total_wall_ms": 80.91154193971306, "ttft_ms": 65.1215419638902, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9485683920, "mlx_cache_bytes": 7003718502, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9485683920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "54c601c558614a8e3fa56979", "attempt_id": "1fa159c0b618", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.135128Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 41, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.3738329289481044, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.93495801277459, "ttft_ms": 47.93495801277459, "decode_ms": 12.350667035207152}, "total_wall_ms": 63.368833041749895, "ttft_ms": 47.93495801277459, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9494727908, "mlx_cache_bytes": 7003718502, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9494727908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1a092f7aaddb6ae94b55203f", "attempt_id": "46b9905d699a", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.217229Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 40, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.3970410218462348, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.085125046782196, "ttft_ms": 48.085125046782196, "decode_ms": 12.386708054691553}, "total_wall_ms": 63.64670803304762, "ttft_ms": 48.085125046782196, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9493171428, "mlx_cache_bytes": 7003718502, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9493171428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8e30df5f80894820d1ac6ea6", "attempt_id": "acf3c64976b7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.298960Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.3847500085830688, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.40250001102686, "ttft_ms": 46.40250001102686, "decode_ms": 12.428457965143025}, "total_wall_ms": 61.88208295498043, "ttft_ms": 46.40250001102686, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9485683920, "mlx_cache_bytes": 7003718502, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9485683920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2f1bee10dc4e6d304467bc74", "attempt_id": "5ddb1a35eabb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.378851Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.413125079125166, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.778707976453006, "ttft_ms": 48.778707976453006, "decode_ms": 12.353291036561131}, "total_wall_ms": 64.22845798078924, "ttft_ms": 48.778707976453006, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9502952692, "mlx_cache_bytes": 7005717350, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9502952692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eeadd6343e2d7a52301c04fe", "attempt_id": "4fefcc09f416", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.460767Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.3854589778929949, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.59324998687953, "ttft_ms": 48.59324998687953, "decode_ms": 12.33766705263406}, "total_wall_ms": 64.00745909195393, "ttft_ms": 48.59324998687953, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9502952692, "mlx_cache_bytes": 7005717350, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9502952692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9c0fc2f4c167d5f9696cad6f", "attempt_id": "1af1d15a0082", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.542593Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.3544999528676271, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.0622080611065, "ttft_ms": 47.0622080611065, "decode_ms": 12.381832930259407}, "total_wall_ms": 62.47524998616427, "ttft_ms": 47.0622080611065, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9490107620, "mlx_cache_bytes": 7005717350, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9490107620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2cd242161e425bdf94397d69", "attempt_id": "f19778f0cab7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.622444Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 72290304, "serialized_payload_bytes": 72306506, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.9527499284595, "doc_prefill_ms": 337.37508300691843, "compress_ms": 913.9131250558421, "serialize_ms": 20.3959580976516, "load_ms": 1.424916903488338, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.14891605544835, "ttft_ms": 47.14891605544835, "decode_ms": 12.38824997562915}, "total_wall_ms": 62.74079193826765, "ttft_ms": 47.14891605544835, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606608384, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9490107620, "mlx_cache_bytes": 7005717350, "process_rss_bytes": 10606608384}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9490107620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8306dedb731736c0ca3eba3c1b11534179da62f0f5e58b948b9a6a9e3a9a73f1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "851360380554d3085fcd41dc", "attempt_id": "9d9f3f3057a2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:13.703120Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 36, "compress_ms": 78.04258307442069}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1353.501458070241, "doc_prefill_ms": 338.55720795691013, "compress_ms": 1007.5405000243336, "serialize_ms": 7.095749955624342, "load_ms": 1.3932499568909407, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.64216697122902, "ttft_ms": 35.64216697122902, "decode_ms": 11.910874978639185}, "total_wall_ms": 1405.9197090100497, "ttft_ms": 35.64216697122902, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10590420992, "backend_memory": {"mlx_active_bytes": 9298693128, "mlx_peak_bytes": 9366293712, "mlx_cache_bytes": 7189823798, "process_rss_bytes": 10590420992}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9366293712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03250d2d32fdc132b6d01c46", "attempt_id": "7ecb8dac197e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:15.126631Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 41, "compress_ms": 96.53408301528543}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 41, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1341.8216669233516, "doc_prefill_ms": 337.96591602731496, "compress_ms": 998.2899170136079, "serialize_ms": 5.262250080704689, "load_ms": 1.0906249517574906, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.98966691829264, "ttft_ms": 37.98966691829264, "decode_ms": 117.77433298993856}, "total_wall_ms": 1501.8042079173028, "ttft_ms": 37.98966691829264, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 41}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10601988096, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9374862564, "mlx_cache_bytes": 7223705910, "process_rss_bytes": 10601988096}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9374862564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 666-H, Sept-ville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "fb38105d46c8ad1079a9ae43e8a4f3ff8ab3ce539c3ed1efee7427891dea67a2"} | ||||
| 523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7827bba2c2c9f422c69d919f", "attempt_id": "cd0693317183", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:16.649902Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 40, "compress_ms": 100.31637502834201}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 40, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079444, "side_information_bytes": 16084, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1329.5593339717016, "doc_prefill_ms": 338.26295903418213, "compress_ms": 985.8954580267891, "serialize_ms": 5.080459057353437, "load_ms": 1.098915934562683, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.7774999467656, "ttft_ms": 36.7774999467656, "decode_ms": 11.981458985246718}, "total_wall_ms": 1382.687499979511, "ttft_ms": 36.7774999467656, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601971712, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9373060324, "mlx_cache_bytes": 7232340278, "process_rss_bytes": 10601971712}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9373060324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fbc1d25b585d055fe03420a9e0e2d36404c0b503a65a4f1e7efd9a6d712c42f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5d84e2a2ff5a83c317f31f46", "attempt_id": "fb1538aea5c1", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:18.054099Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 36, "compress_ms": 81.21758396737278}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1336.7434170795605, "doc_prefill_ms": 338.37766689248383, "compress_ms": 993.074250058271, "serialize_ms": 4.985500010661781, "load_ms": 1.060166978277266, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.81504190899432, "ttft_ms": 36.81504190899432, "decode_ms": 11.869666050188243}, "total_wall_ms": 1389.5549590233713, "ttft_ms": 36.81504190899432, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601971712, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9365834960, "mlx_cache_bytes": 7232340278, "process_rss_bytes": 10601971712}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9365834960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "df81672960a72d5e7b23c32a", "attempt_id": "1b3cbd8becfb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:19.464939Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 45, "compress_ms": 94.07108300365508}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1365.1629589730874, "doc_prefill_ms": 350.08499992545694, "compress_ms": 1009.9119590595365, "serialize_ms": 4.863958922214806, "load_ms": 1.1274170828983188, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.51929197460413, "ttft_ms": 37.51929197460413, "decode_ms": 12.077208957634866}, "total_wall_ms": 1418.976749991998, "ttft_ms": 37.51929197460413, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601971712, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9381940468, "mlx_cache_bytes": 7275643190, "process_rss_bytes": 10601971712}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9381940468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a3da7863079267de69d8abdf", "attempt_id": "79aa58beb356", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:20.903751Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 45, "compress_ms": 96.20191599242389}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1367.6619170000777, "doc_prefill_ms": 337.5625410117209, "compress_ms": 1024.893083027564, "serialize_ms": 4.894834011793137, "load_ms": 1.1598339769989252, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.01725001540035, "ttft_ms": 38.01725001540035, "decode_ms": 11.829541996121407}, "total_wall_ms": 1421.7800000915304, "ttft_ms": 38.01725001540035, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601988096, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9381940468, "mlx_cache_bytes": 7275643190, "process_rss_bytes": 10601988096}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9381940468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "611486acf9d6fa0f642cebbc", "attempt_id": "51438caab0f5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:22.345782Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 37, "compress_ms": 79.77291604038328}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1335.8796660322696, "doc_prefill_ms": 338.7387919938192, "compress_ms": 991.8389159720391, "serialize_ms": 5.006166989915073, "load_ms": 1.1213329853489995, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.13683406729251, "ttft_ms": 36.13683406729251, "decode_ms": 12.059041997417808}, "total_wall_ms": 1388.6091249296442, "ttft_ms": 36.13683406729251, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601988096, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9369160932, "mlx_cache_bytes": 7299629366, "process_rss_bytes": 10601988096}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9369160932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "971292a3ffdd8d058f6fcdbc", "attempt_id": "71dbb4ec7a40", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:23.754388Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 37, "compress_ms": 89.19858408626169}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1373.4939170535654, "doc_prefill_ms": 352.8824159875512, "compress_ms": 1015.4077499173582, "serialize_ms": 4.914792021736503, "load_ms": 0.9947080397978425, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.140750045888126, "ttft_ms": 36.140750045888126, "decode_ms": 11.940583004616201}, "total_wall_ms": 1425.6517079193145, "ttft_ms": 36.140750045888126, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10601988096, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9369160932, "mlx_cache_bytes": 7299629366, "process_rss_bytes": 10601988096}, "peak_prefill_memory": 9982012284, "peak_decode_memory": 9369160932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3fd86df58718c5b9b491abed", "attempt_id": "2b45b471c008", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:25.229669Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2208.9953750837594, "ttft_ms": 12.642291956581175, "decode_ms": 123.71004198212177}, "total_wall_ms": 2356.719166971743, "ttft_ms": 12.642291956581175, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10451206144, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1680897464, "process_rss_bytes": 10451206144}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HH-14X-6634", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "0eb607bf9106acd2f27f0f2844c00047450ceed7799bbe1b2879672c3700b119"} | ||||
| 530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "08badf8b5604174262890bca", "attempt_id": "fa012476af28", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:27.614157Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5882, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2203.1584579963237, "ttft_ms": 12.522667064331472, "decode_ms": 150.7744580740109}, "total_wall_ms": 2377.8415420092642, "ttft_ms": 12.522667064331472, "input_usage": {"receiver_prompt_tokens": 5882}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10451238912, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2465674680, "process_rss_bytes": 10451238912}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 786-F, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "e9d8c9bcfcab971769d338246861d54b40408bbfdb6b29c68f7f7d803a7d78ed"} | ||||
| 531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "266b05bc4bce9ffb14a44ec7", "attempt_id": "b9fdf0a9f683", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:30.018022Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5881, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.8798330100253, "ttft_ms": 12.94054207392037, "decode_ms": 86.55279199592769}, "total_wall_ms": 2312.2322499984875, "ttft_ms": 12.94054207392037, "input_usage": {"receiver_prompt_tokens": 5881}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451255296, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2465674680, "process_rss_bytes": 10451255296}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "63.0928", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "5f1f985100540afc499942a9f0f4c0a96430054fe87cf8278d84202eadf815c1"} | ||||
| 532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "79abb14fa98d7ec84a2ee67c", "attempt_id": "6f6c1ffae5f7", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:32.356322Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5879, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.797250007279, "ttft_ms": 12.460666941478848, "decode_ms": 98.91279099974781}, "total_wall_ms": 2324.747834005393, "ttft_ms": 12.460666941478848, "input_usage": {"receiver_prompt_tokens": 5879}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10451288064, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10101722176, "mlx_cache_bytes": 2830742968, "process_rss_bytes": 10451288064}, "peak_prefill_memory": null, "peak_decode_memory": 10101722176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ragnvald Haldorsen", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "252259dc833200b039ed2c5085cf0dc6847ffefa99f4a653bdf8673481902f6c"} | ||||
| 533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c5231363006e121abe5ff7e", "attempt_id": "023644c21d6c", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:34.706935Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5885, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.968749916181, "ttft_ms": 12.5654999865219, "decode_ms": 87.45645801536739}, "total_wall_ms": 2314.4562920788303, "ttft_ms": 12.5654999865219, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451320832, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3145708984, "process_rss_bytes": 10451320832}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7755450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "a30221bc7c855d26c2bda21a0a21fda10c953a05d985cec4e1dfa5a6a372d5d3"} | ||||
| 534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f2104667872fdc78ab8be7c0", "attempt_id": "970d6a36545e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:37.046621Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5887, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.1308330111206, "ttft_ms": 12.706207926385105, "decode_ms": 124.41120797302574}, "total_wall_ms": 2349.6088749961928, "ttft_ms": 12.706207926385105, "input_usage": {"receiver_prompt_tokens": 5887}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10451337216, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3673929144, "process_rss_bytes": 10451337216}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0e23486400566d90ee3c3b6b", "attempt_id": "a0e95e2594da", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:39.421952Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2203.19762500003, "ttft_ms": 12.50816707033664, "decode_ms": 12.27812492288649}, "total_wall_ms": 2238.3687499677762, "ttft_ms": 12.50816707033664, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451369984, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3673929144, "process_rss_bytes": 10451369984}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9e44a5fa434b3314c79f7a61", "attempt_id": "98fc8621747e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:41.685940Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016707926988601685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.922665979713, "ttft_ms": 12.587708071805537, "decode_ms": 12.37741601653397}, "total_wall_ms": 2238.999417051673, "ttft_ms": 12.587708071805537, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451402752, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3673929144, "process_rss_bytes": 10451402752}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 537 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3781e2f364b1f71ff4ec9111", "attempt_id": "7b59ed78377a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:45.917658Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 193, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.03491701837629, "ttft_ms": 11.831542011350393, "decode_ms": 11.93008292466402}, "total_wall_ms": 112.6187089830637, "ttft_ms": 11.831542011350393, "input_usage": {"receiver_prompt_tokens": 193, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9458438000, "mlx_cache_bytes": 5044967608, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9458438000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 538 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "93b87b33a36512d2eb713525", "attempt_id": "a24682e5f1d3", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.056967Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 198, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.60349991545081, "ttft_ms": 11.746417032554746, "decode_ms": 11.762458947487175}, "total_wall_ms": 124.84091706573963, "ttft_ms": 11.746417032554746, "input_usage": {"receiver_prompt_tokens": 198, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9464745860, "mlx_cache_bytes": 5244050380, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9464745860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 539 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1d5392a178311a90362e9b5b", "attempt_id": "1fdacfd98a5b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.207308Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 197, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.56662501301616, "ttft_ms": 11.839958955533803, "decode_ms": 11.744624935090542}, "total_wall_ms": 124.77566604502499, "ttft_ms": 11.839958955533803, "input_usage": {"receiver_prompt_tokens": 197, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9464729476, "mlx_cache_bytes": 5244050380, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9464729476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 540 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03506824d357aede4c9f3e4d", "attempt_id": "09144cc25388", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.357784Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 195, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.32375000789762, "ttft_ms": 11.659583076834679, "decode_ms": 11.94416603539139}, "total_wall_ms": 123.58625000342727, "ttft_ms": 11.659583076834679, "input_usage": {"receiver_prompt_tokens": 195, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9471152052, "mlx_cache_bytes": 5395209164, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9471152052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 541 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "db84888feb287327844eb795", "attempt_id": "838ca018fccb", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.506917Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 201, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.39579204749316, "ttft_ms": 11.768166907131672, "decode_ms": 11.699041933752596}, "total_wall_ms": 124.55962505191565, "ttft_ms": 11.768166907131672, "input_usage": {"receiver_prompt_tokens": 201, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9466908560, "mlx_cache_bytes": 5541093100, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9466908560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 542 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "535b360afac2d99bdd3c3453", "attempt_id": "9585a978882e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.656621Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 203, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.5378330592066, "ttft_ms": 11.733207968063653, "decode_ms": 11.670875013805926}, "total_wall_ms": 124.62912499904633, "ttft_ms": 11.733207968063653, "input_usage": {"receiver_prompt_tokens": 203, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9469579160, "mlx_cache_bytes": 5742125588, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9469579160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 543 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "674059d3bca32bc9bc706eda", "attempt_id": "391d06e843c2", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.806277Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 193, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.30120802950114, "ttft_ms": 11.580290971323848, "decode_ms": 11.681957985274494}, "total_wall_ms": 108.19066606927663, "ttft_ms": 11.580290971323848, "input_usage": {"receiver_prompt_tokens": 193, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9458438000, "mlx_cache_bytes": 5742125588, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9458438000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 544 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ee907bd7c5b2a08124e42930", "attempt_id": "a57831e75e73", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:46.939829Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 193, "message_tokens": 114, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1965.025250101462, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.12212505936623, "ttft_ms": 11.692667030729353, "decode_ms": 11.825000052340329}, "total_wall_ms": 108.25300007127225, "ttft_ms": 11.692667030729353, "input_usage": {"receiver_prompt_tokens": 193, "sender_input_tokens": 5918, "sender_output_tokens": 114, "sender_prefill_ms": 1117.101832991466, "sender_ttft_ms": 7.645457983016968, "sender_decode_ms": 834.9211669992656}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451451904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9458438000, "mlx_cache_bytes": 5742125588, "process_rss_bytes": 10451451904}, "peak_prefill_memory": null, "peak_decode_memory": 9458438000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a333e229ad4ed42f473e3db43332c307e3be763bba95e65901da3d40bd395ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 545 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "10289d2e37a6e1d71dd6f7c1", "attempt_id": "ca69eae2e5a4", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:51.989624Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 371, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.8557080263272, "ttft_ms": 11.942834011279047, "decode_ms": 70.46299998182803}, "total_wall_ms": 231.20695794932544, "ttft_ms": 11.942834011279047, "input_usage": {"receiver_prompt_tokens": 371, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503674948, "mlx_cache_bytes": 6941403100, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9503674948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Casimir Abubakar", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "5e6dfdff6ad3ccc0091ed162e6222b7de1eb7d36d3db5810290d59dbac2ac3e5"} | ||||
| 546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b694734f3b72739b51d1dffd", "attempt_id": "07ecad11a8db", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:52.246773Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 376, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.53395893704146, "ttft_ms": 12.019583024084568, "decode_ms": 11.891750036738813}, "total_wall_ms": 168.48370805382729, "ttft_ms": 12.019583024084568, "input_usage": {"receiver_prompt_tokens": 376, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506083416, "mlx_cache_bytes": 7161310648, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9506083416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e0dd4b1373c26d8d766c9c99", "attempt_id": "82a33d523b59", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:52.442462Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 375, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.4705409919843, "ttft_ms": 11.983665986917913, "decode_ms": 70.74833393562585}, "total_wall_ms": 227.01295802835375, "ttft_ms": 11.983665986917913, "input_usage": {"receiver_prompt_tokens": 375, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506083416, "mlx_cache_bytes": 7161310648, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9506083416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Dubrovnik", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "120542713e9cc99d9150b43b41a4c26c288bcb3ce6b34c6ec39f04d44927c19e"} | ||||
| 548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "269ce83299181fa6ef02fc18", "attempt_id": "a22880a859ea", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:52.695772Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 373, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.1638749781996, "ttft_ms": 11.797041050158441, "decode_ms": 94.00904201902449}, "total_wall_ms": 249.71266696229577, "ttft_ms": 11.797041050158441, "input_usage": {"receiver_prompt_tokens": 373, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10451484672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9504166488, "mlx_cache_bytes": 7292382648, "process_rss_bytes": 10451484672}, "peak_prefill_memory": null, "peak_decode_memory": 9504166488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ragnvald Haldorsen", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "252259dc833200b039ed2c5085cf0dc6847ffefa99f4a653bdf8673481902f6c"} | ||||
| 549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1ff96e6b56fddc11db83967e", "attempt_id": "c4439999dc49", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:52.971296Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 379, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.96641701366752, "ttft_ms": 12.014875072054565, "decode_ms": 11.877249926328659}, "total_wall_ms": 167.85208298824728, "ttft_ms": 12.014875072054565, "input_usage": {"receiver_prompt_tokens": 379, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451501056, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9508000356, "mlx_cache_bytes": 7514272672, "process_rss_bytes": 10451501056}, "peak_prefill_memory": null, "peak_decode_memory": 9508000356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cc20fc6a0a634c28c90015fb", "attempt_id": "56e075b30b94", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:53.165710Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 381, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.54745803959668, "ttft_ms": 11.886500054970384, "decode_ms": 11.801167041994631}, "total_wall_ms": 169.07737497240305, "ttft_ms": 11.886500054970384, "input_usage": {"receiver_prompt_tokens": 381, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451501056, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9508983404, "mlx_cache_bytes": 7514274192, "process_rss_bytes": 10451501056}, "peak_prefill_memory": null, "peak_decode_memory": 9508983404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "412ff5d7f37651ede8586a24", "attempt_id": "371752a98933", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:53.361438Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 371, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.62754190713167, "ttft_ms": 11.959208990447223, "decode_ms": 11.998917092569172}, "total_wall_ms": 167.4369580578059, "ttft_ms": 11.959208990447223, "input_usage": {"receiver_prompt_tokens": 371, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451501056, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503674948, "mlx_cache_bytes": 7514274192, "process_rss_bytes": 10451501056}, "peak_prefill_memory": null, "peak_decode_memory": 9503674948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a8dd4d282f3b996d647cec9f", "attempt_id": "2841c1184bf4", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:53.554881Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 371, "message_tokens": 280, "message_utf8_bytes": 649, "cache_tensor_bytes": null, "serialized_payload_bytes": 649, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4915.9564999863505, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.05029099341482, "ttft_ms": 11.896457988768816, "decode_ms": 11.822000029496849}, "total_wall_ms": 167.60691709350795, "ttft_ms": 11.896457988768816, "input_usage": {"receiver_prompt_tokens": 371, "sender_input_tokens": 5946, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6762079382315, "sender_ttft_ms": 7.471750024706125, "sender_decode_ms": 3781.8091249791905}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451501056, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503674948, "mlx_cache_bytes": 7514274192, "process_rss_bytes": 10451501056}, "peak_prefill_memory": null, "peak_decode_memory": 9503674948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fbc9d78453a38195e104dfa10289226884cf93f22a3b733ca4572a04c326e3", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9700683ff2cbc098b6a8b0e6", "attempt_id": "ed05f9025320", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:54.932391Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.6712920041754842, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.19333304744214, "ttft_ms": 79.19333304744214, "decode_ms": 634.7025840077549}, "total_wall_ms": 720.775083056651, "ttft_ms": 79.19333304744214, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9798044880, "mlx_cache_bytes": 8608348849, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9798044880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "@.ese:1)##_(i).com:20\n* @theoremoresade Sports Medicine11) : 1 -hierarch1:0:)\n\npomade:1) :abcdefghijklmnopqrstuvwxyz(", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "1bef2e98b23d17ed854fc73af3f7e329bec4d74db1014d74ff0f4e151f312bd3"} | ||||
| 554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "824b9c35d29e2c1f09fda975", "attempt_id": "efd5c25ca949", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:55.680100Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 41, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.7705829814076424, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.50512496568263, "ttft_ms": 77.50512496568263, "decode_ms": 633.9094170834869}, "total_wall_ms": 718.7982499599457, "ttft_ms": 77.50512496568263, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9808760036, "mlx_cache_bytes": 8665234425, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9808760036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".1rossoette/epin1.0 alfan2.%Alexacteineinenquentiongener2while (chomatesh sw21:1:0:)\n\n## ai:1:1.0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "c8627a535166412efb78d7adaf2b1e707bdfdb4dffb58845e936a9df70bb59d5"} | ||||
| 555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e750bc50fdbc6d30e4e51eac", "attempt_id": "ac74a223a943", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:56.425781Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 40, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.7705420032143593, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.59862497914582, "ttft_ms": 77.59862497914582, "decode_ms": 633.5180000169203}, "total_wall_ms": 718.14583404921, "ttft_ms": 77.59862497914582, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9805958372, "mlx_cache_bytes": 8710323193, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9805958372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "au0 parafoam-1:Lyodon1-1(대iquart, 1-que-1, letamazing mathematics:1:2, the human back-toi-001:0:0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "986ae6ea131bad6695c32975109e63b5f7e6ed23049bb340c9a3fc89ce7af74e"} | ||||
| 556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d8610f7e26a64f3df033bfb9", "attempt_id": "958548d92a10", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.170834Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 38, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.9138338975608349, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.94595902971923, "ttft_ms": 74.94595902971923, "decode_ms": 634.2400830471888}, "total_wall_ms": 717.0958330389112, "ttft_ms": 74.94595902971923, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9803386084, "mlx_cache_bytes": 8771369977, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9803386084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".what esxi的, 10\n Message帽์快打usable, 忘学,在10/1 -1,体,在15/1 - 至iexx:0:0:1:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "b7094bce3ec22c9d1f4028b5c7c0b02c2b9e689c6186c8885cdadf1fc44a23f5"} | ||||
| 557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d9697bedc10e141de33dc374", "attempt_id": "df3438d06171", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:57.914485Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 44, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.7542080022394657, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.26170904748142, "ttft_ms": 75.26170904748142, "decode_ms": 637.794291949831}, "total_wall_ms": 720.6293749623001, "ttft_ms": 75.26170904748142, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9812233456, "mlx_cache_bytes": 8840854873, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9812233456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "from Guided (.)\nIn BLOC? of1: 1: Auty:O para: yap: 1: A+2:Innovation Management) : Always: 2.0:Autodesk: Exact SCA", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "f1082a76295bc20962632b52918ad895cfad43381bac663024add8d7b289c81a"} | ||||
| 558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "13a1078f8e961fdb1504a258", "attempt_id": "725d8c629329", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:58.661958Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 46, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.5032499795779586, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.85704098083079, "ttft_ms": 71.85704098083079, "decode_ms": 633.8254580041394}, "total_wall_ms": 712.6040830044076, "ttft_ms": 71.85704098083079, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9815919864, "mlx_cache_bytes": 8889056969, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9815919864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A. \n网络之说， 欣赏-高阶点：1: 1:0。请型:走动版:1:en:0: 1:1:在1:适应性:R:1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "772c36c1ece11db2c309215a4ae02dcbe4c2f103c7f6e7750780b5090f5e8373"} | ||||
| 559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61276ca7fae033e561e191d8", "attempt_id": "7b43a45fb9ca", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:28:59.401518Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.771167037077248, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.03695904556662, "ttft_ms": 73.03695904556662, "decode_ms": 632.8617909457535}, "total_wall_ms": 713.2843330036849, "ttft_ms": 73.03695904556662, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9798044880, "mlx_cache_bytes": 8889056969, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9798044880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1 1 :**(1):\n...)(A-2, to explainaton(olmumathimaging(割图示)(的,他们之间，这道，1-1,必读上大强度体，", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "5ac82b15f7e102ec4a9e7034b77ebc976eacd9cb8f9f8399352814a7864cdfea"} | ||||
| 560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6e1d9ad6fec1fc4ef613e3f7", "attempt_id": "f6ab605918fd", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:00.140782Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338814, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1183.3179589593783, "doc_prefill_ms": 1104.3592499336228, "compress_ms": 12.535791960544884, "serialize_ms": 55.04779191687703, "load_ms": 1.8052919767796993, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.99129199236631, "ttft_ms": 72.99129199236631, "decode_ms": 631.2926249811426}, "total_wall_ms": 711.7922499310225, "ttft_ms": 72.99129199236631, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10882760704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9798044880, "mlx_cache_bytes": 8889056969, "process_rss_bytes": 10882760704}, "peak_prefill_memory": 10054110296, "peak_decode_memory": 9798044880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "/ a/urx:1: 0, dare master (in everyon? (1) :okt, 1 - 1: rapidio-1,elucidian scientist:1.0:### Please use", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1aeef5f8db8055cbf5843298b33aba0a4d2d1f740273c1b610759014a0f955ef", "output_hash": "1e711fb956da5c1358cf910a8da72d03c6dc2602ee5e077b319e817d11e86df9"} | ||||
| 561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "81cc97e040842bf3f16f9e8f", "attempt_id": "392e66175ca9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:04.227935Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.8650420242920518, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.46541604865342, "ttft_ms": 77.46541604865342, "decode_ms": 13.708207989111543}, "total_wall_ms": 98.5199169954285, "ttft_ms": 77.46541604865342, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797782736, "mlx_cache_bytes": 8972336841, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9797782736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "70fce6d9495f41d52ec412cf", "attempt_id": "76c38377be74", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:04.354332Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 41, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.805042033083737, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.67274994309992, "ttft_ms": 76.67274994309992, "decode_ms": 13.723207986913621}, "total_wall_ms": 97.66141697764397, "ttft_ms": 76.67274994309992, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9808301284, "mlx_cache_bytes": 8972336841, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9808301284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8891d9f0eaa16a52ad19d64a", "attempt_id": "d6b0c812d8bf", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:04.479681Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 40, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.7853339668363333, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.17862499319017, "ttft_ms": 76.17862499319017, "decode_ms": 93.99695799220353}, "total_wall_ms": 177.668625023216, "ttft_ms": 76.17862499319017, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9805499620, "mlx_cache_bytes": 8972336841, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9805499620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "63.0928", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "5f1f985100540afc499942a9f0f4c0a96430054fe87cf8278d84202eadf815c1"} | ||||
| 564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2f6d2bd8e2d759afb1831111", "attempt_id": "7776fef24d60", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:04.684230Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 38, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.373249921016395, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.9792919959873, "ttft_ms": 74.9792919959873, "decode_ms": 13.437042012810707}, "total_wall_ms": 95.29775008559227, "ttft_ms": 74.9792919959873, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9803123940, "mlx_cache_bytes": 8972336841, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9803123940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1bc878dffbac51f076de80ee", "attempt_id": "2f69bed252bb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:04.805457Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 44, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.6542499652132392, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.29962505213916, "ttft_ms": 75.29962505213916, "decode_ms": 13.440542039461434}, "total_wall_ms": 95.83958401344717, "ttft_ms": 75.29962505213916, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9811971312, "mlx_cache_bytes": 8972336841, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9811971312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c8710f7b7ccadeb4d4f878bc", "attempt_id": "52ea5209588c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:04.926929Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 46, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.7297499580308795, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.05908403173089, "ttft_ms": 71.05908403173089, "decode_ms": 13.500832952558994}, "total_wall_ms": 91.89254208467901, "ttft_ms": 71.05908403173089, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9815641336, "mlx_cache_bytes": 8972533449, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9815641336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2849e55c2f8ddc6e5cdcbb00", "attempt_id": "853833d539f3", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:05.044497Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.090249978005886, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.73975003045052, "ttft_ms": 72.73975003045052, "decode_ms": 13.426583958789706}, "total_wall_ms": 92.47499995399266, "ttft_ms": 72.73975003045052, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797782736, "mlx_cache_bytes": 8972533449, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9797782736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ff87e59503f7cee85d1a7258", "attempt_id": "84d13dae1788", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:05.162429Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 215322624, "serialized_payload_bytes": 215338915, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.522042014636, "doc_prefill_ms": 1103.17891696468, "compress_ms": 2164.110583020374, "serialize_ms": 77.91808398906142, "load_ms": 1.2544159544631839, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.4979160586372, "ttft_ms": 72.4979160586372, "decode_ms": 13.766792020760477}, "total_wall_ms": 93.44945801422, "ttft_ms": 72.4979160586372, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073699840, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797782736, "mlx_cache_bytes": 8972533449, "process_rss_bytes": 11073699840}, "peak_prefill_memory": 10054011992, "peak_decode_memory": 9797782736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c06a03eabd74f2193d6bbd6327603eedcf42ab53eaa299211e3e99628f5c55c4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d19639af32044c9db20963a", "attempt_id": "c538be3e07cc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:05.284252Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 36, "compress_ms": 120.81091699656099}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837797, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3386.631542001851, "doc_prefill_ms": 1102.9358750674874, "compress_ms": 2267.8201670059934, "serialize_ms": 15.488916891627014, "load_ms": 1.7578749684616923, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.53816697746515, "ttft_ms": 42.53816697746515, "decode_ms": 12.338125030510128}, "total_wall_ms": 3452.96175009571, "ttft_ms": 42.53816697746515, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10985472000, "backend_memory": {"mlx_active_bytes": 9369897992, "mlx_peak_bytes": 9444117712, "mlx_cache_bytes": 9459522193, "process_rss_bytes": 10985472000}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9444117712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2abaf2c39aa91d877b2e22d706777512382657f5cc6d4b9b523cf4d9a795ba61", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1ff74f4b4084e9a5fdb1cc9e", "attempt_id": "c667ece07cd1", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:08.765393Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 41, "compress_ms": 128.24716698378325}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 41, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837797, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3364.1902919625863, "doc_prefill_ms": 1104.120625066571, "compress_ms": 2246.54650001321, "serialize_ms": 13.130125007592142, "load_ms": 1.2590419501066208, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.68425002414733, "ttft_ms": 44.68425002414733, "decode_ms": 12.302333023399115}, "total_wall_ms": 3430.545667069964, "ttft_ms": 44.68425002414733, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039768576, "backend_memory": {"mlx_active_bytes": 9369635848, "mlx_peak_bytes": 9453210852, "mlx_cache_bytes": 9506658961, "process_rss_bytes": 11039768576}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9453210852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2abaf2c39aa91d877b2e22d706777512382657f5cc6d4b9b523cf4d9a795ba61", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "867a43180d2c7fafc911b088", "attempt_id": "b0c63fe7d9d7", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:12.225733Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 40, "compress_ms": 126.13208300899714}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 40, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837797, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3363.8664160389453, "doc_prefill_ms": 1105.3253330755979, "compress_ms": 2246.3714169571176, "serialize_ms": 11.814041994512081, "load_ms": 1.267540967091918, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.77758298162371, "ttft_ms": 44.77758298162371, "decode_ms": 85.11295809876174}, "total_wall_ms": 3502.784708980471, "ttft_ms": 44.77758298162371, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 11039801344, "backend_memory": {"mlx_active_bytes": 9370389512, "mlx_peak_bytes": 9451228388, "mlx_cache_bytes": 9544882833, "process_rss_bytes": 11039801344}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9451228388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "63.0455", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2abaf2c39aa91d877b2e22d706777512382657f5cc6d4b9b523cf4d9a795ba61", "output_hash": "d521d86d4b290ef73f44a2139198901a06d1d4f82aa66f8f1ec71e37101f5629"} | ||||
| 572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "388d8841c190048f62e1962f", "attempt_id": "40f91deed0bb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:15.756898Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 38, "compress_ms": 123.89612500555813}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 38, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837797, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3353.1367090763524, "doc_prefill_ms": 1102.8159590205178, "compress_ms": 2238.18174994085, "serialize_ms": 11.782750021666288, "load_ms": 1.3015420408919454, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.439292116090655, "ttft_ms": 43.439292116090655, "decode_ms": 12.329416000284255}, "total_wall_ms": 3418.442750000395, "ttft_ms": 43.439292116090655, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039801344, "backend_memory": {"mlx_active_bytes": 9369635848, "mlx_peak_bytes": 9447918820, "mlx_cache_bytes": 9583090321, "process_rss_bytes": 11039801344}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9447918820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2abaf2c39aa91d877b2e22d706777512382657f5cc6d4b9b523cf4d9a795ba61", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "536d4a6313cd0442331ddef0", "attempt_id": "31f0e738d565", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:19.203095Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 44, "compress_ms": 123.19437495898455}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 44, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837797, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3353.965917020105, "doc_prefill_ms": 1103.9776669349521, "compress_ms": 2237.652541953139, "serialize_ms": 11.97762496303767, "load_ms": 1.3028329703956842, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.782000033184886, "ttft_ms": 42.782000033184886, "decode_ms": 12.215834110975266}, "total_wall_ms": 3418.3784580091015, "ttft_ms": 42.782000033184886, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039801344, "backend_memory": {"mlx_active_bytes": 9370389512, "mlx_peak_bytes": 9457667312, "mlx_cache_bytes": 9625262737, "process_rss_bytes": 11039801344}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9457667312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2abaf2c39aa91d877b2e22d706777512382657f5cc6d4b9b523cf4d9a795ba61", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "35dc2985f4ae792429e00bdb", "attempt_id": "364765189ddd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:22.649355Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 46, "compress_ms": 123.45245794858783}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 46, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837797, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3372.3310839850456, "doc_prefill_ms": 1103.084374917671, "compress_ms": 2257.0992920082062, "serialize_ms": 11.79183297790587, "load_ms": 1.3211669865995646, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.89220806863159, "ttft_ms": 44.89220806863159, "decode_ms": 12.292875093407929}, "total_wall_ms": 3438.5272500803694, "ttft_ms": 44.89220806863159, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039801344, "backend_memory": {"mlx_active_bytes": 9370389512, "mlx_peak_bytes": 9462140152, "mlx_cache_bytes": 9661373073, "process_rss_bytes": 11039801344}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9462140152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2abaf2c39aa91d877b2e22d706777512382657f5cc6d4b9b523cf4d9a795ba61", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "395338df8523df3f3f5d17ec", "attempt_id": "70f683ea1b06", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:26.115196Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 36, "compress_ms": 120.052499929443}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837795, "side_information_bytes": 16355, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3395.182417007163, "doc_prefill_ms": 1105.286541976966, "compress_ms": 2277.4912079330534, "serialize_ms": 12.05000001937151, "load_ms": 1.081832917407155, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.662041960284114, "ttft_ms": 42.662041960284114, "decode_ms": 12.138542020693421}, "total_wall_ms": 3458.7993330787867, "ttft_ms": 42.662041960284114, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039834112, "backend_memory": {"mlx_active_bytes": 9369635848, "mlx_peak_bytes": 9443822800, "mlx_cache_bytes": 9662126737, "process_rss_bytes": 11039834112}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9443822800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ed7607cc2f6a71f6b92a45b10882af210877cddbd527e78d9ce3de9a5f5fb89d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8dd29ec2891dba805e256a2f", "attempt_id": "d201ed9f5e61", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:29.601874Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 36, "compress_ms": 125.46445906627923}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837797, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3324.4552919641137, "doc_prefill_ms": 1102.5864169932902, "compress_ms": 2209.420416969806, "serialize_ms": 12.0269589824602, "load_ms": 1.2874590465798974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.75229200720787, "ttft_ms": 42.75229200720787, "decode_ms": 12.165000080130994}, "total_wall_ms": 3388.5613339953125, "ttft_ms": 42.75229200720787, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11039834112, "backend_memory": {"mlx_active_bytes": 9369635848, "mlx_peak_bytes": 9443822800, "mlx_cache_bytes": 9662126737, "process_rss_bytes": 11039834112}, "peak_prefill_memory": 10053979224, "peak_decode_memory": 9443822800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2abaf2c39aa91d877b2e22d706777512382657f5cc6d4b9b523cf4d9a795ba61", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "35bf546d21ef96b2cb3c1966", "attempt_id": "74bdee7ccab1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:33.060495Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2057, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 721.6026249807328, "ttft_ms": 12.19025009777397, "decode_ms": 120.38133305031806}, "total_wall_ms": 857.768916990608, "ttft_ms": 12.19025009777397, "input_usage": {"receiver_prompt_tokens": 2057}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10486939648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443084, "mlx_cache_bytes": 816285864, "process_rss_bytes": 10486939648}, "peak_prefill_memory": null, "peak_decode_memory": 9974443084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HQ-33P-3231", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "e5861e159e2f089d84f9a5111a99678f644225a54b9dd9a42d5652ebd91bb1db"} | ||||
| 578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "479d27649502c810cbf59cd5", "attempt_id": "c55bc7636505", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:33.938324Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2063, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 718.7429160112515, "ttft_ms": 12.168874964118004, "decode_ms": 144.085209001787}, "total_wall_ms": 878.7694169441238, "ttft_ms": 12.168874964118004, "input_usage": {"receiver_prompt_tokens": 2063}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10486972416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443108, "mlx_cache_bytes": 825468128, "process_rss_bytes": 10486972416}, "peak_prefill_memory": null, "peak_decode_memory": 9974443108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 376-E in Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "75b8728724c2624ab378b3826a59a73652392a9bbbb0a852e55d91f6e148ed8b"} | ||||
| 579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "72762af79e074ae73c9fa696", "attempt_id": "cfb6728974f5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:34.836247Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2062, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 719.4484160281718, "ttft_ms": 12.22674991004169, "decode_ms": 84.15154204703867}, "total_wall_ms": 819.4442909443751, "ttft_ms": 12.22674991004169, "input_usage": {"receiver_prompt_tokens": 2062}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10486972416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443108, "mlx_cache_bytes": 825468128, "process_rss_bytes": 10486972416}, "peak_prefill_memory": null, "peak_decode_memory": 9974443108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "77.6813", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "f46ae019c46016565ffc65d1a0d3d6edb83df7b3bebd11718e16031b63b695ef"} | ||||
| 580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c405daf33f0ecb1caa4892e7", "attempt_id": "a15c6dc3d481", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:35.674524Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2060, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 716.3104580249637, "ttft_ms": 12.187040993012488, "decode_ms": 108.10549999587238}, "total_wall_ms": 840.3803750406951, "ttft_ms": 12.187040993012488, "input_usage": {"receiver_prompt_tokens": 2060}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10486972416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443108, "mlx_cache_bytes": 830579936, "process_rss_bytes": 10486972416}, "peak_prefill_memory": null, "peak_decode_memory": 9974443108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "64a43cf5bc3c49c6c259d61e", "attempt_id": "496ed50a6c32", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:36.534723Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2066, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 727.3091250099242, "ttft_ms": 12.187832966446877, "decode_ms": 108.32129197660834}, "total_wall_ms": 851.5190000180155, "ttft_ms": 12.187832966446877, "input_usage": {"receiver_prompt_tokens": 2066}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10486988800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443120, "mlx_cache_bytes": 872487716, "process_rss_bytes": 10486988800}, "peak_prefill_memory": null, "peak_decode_memory": 9974443120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,296,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "8b531ccf7fd3b97bf2ef32627da2617b8353e5c2dd09a274017a5a5a868bdcdb"} | ||||
| 582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "56ba6be0ebb3bb62a0f2e652", "attempt_id": "33eaa1fba4af", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:37.405015Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2066, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 727.5027079740539, "ttft_ms": 12.283749994821846, "decode_ms": 122.0412920229137}, "total_wall_ms": 865.6151249306276, "ttft_ms": 12.283749994821846, "input_usage": {"receiver_prompt_tokens": 2066}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10486972416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443120, "mlx_cache_bytes": 872487716, "process_rss_bytes": 10486972416}, "peak_prefill_memory": null, "peak_decode_memory": 9974443120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-38K-5533", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "18acd9807857243bbded3bceae55398316a3958b81d70364441bdb6748eaf878"} | ||||
| 583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "deaf183196cfe6953ba881c2", "attempt_id": "557e46f7fa04", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:38.289470Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2058, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 716.4749999064952, "ttft_ms": 12.342125060968101, "decode_ms": 11.993624968454242}, "total_wall_ms": 744.4186669308692, "ttft_ms": 12.342125060968101, "input_usage": {"receiver_prompt_tokens": 2058}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10486972416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443108, "mlx_cache_bytes": 876321572, "process_rss_bytes": 10486972416}, "peak_prefill_memory": null, "peak_decode_memory": 9974443108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "555b9905a627e96d95480d1e", "attempt_id": "c23896b2381e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:39.052249Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2057, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009041978046298027, "decode_payload_ms": 0.0, "receiver_prefill_ms": 715.7364160520956, "ttft_ms": 12.14229199104011, "decode_ms": 12.27412500884384}, "total_wall_ms": 743.6687500448897, "ttft_ms": 12.14229199104011, "input_usage": {"receiver_prompt_tokens": 2057}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487005184, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443084, "mlx_cache_bytes": 876321572, "process_rss_bytes": 10487005184}, "peak_prefill_memory": null, "peak_decode_memory": 9974443084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cfb3352b97b7e4fe67221126", "attempt_id": "61fc30e2b3fa", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:41.143926Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 212, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 104.18754199054092, "ttft_ms": 11.912334011867642, "decode_ms": 11.736417072825134}, "total_wall_ms": 128.6488340701908, "ttft_ms": 11.912334011867642, "input_usage": {"receiver_prompt_tokens": 212, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487037952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9480769480, "mlx_cache_bytes": 1765729904, "process_rss_bytes": 10487037952}, "peak_prefill_memory": null, "peak_decode_memory": 9480769480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5ebba1fe10f8c9b159da0a73", "attempt_id": "f0fb532239db", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:41.291758Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 218, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.48845899291337, "ttft_ms": 11.627624975517392, "decode_ms": 11.750167002901435}, "total_wall_ms": 124.55375003628433, "ttft_ms": 11.627624975517392, "input_usage": {"receiver_prompt_tokens": 218, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487054336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9481392096, "mlx_cache_bytes": 1981852116, "process_rss_bytes": 10487054336}, "peak_prefill_memory": null, "peak_decode_memory": 9481392096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "445e3103f08479664af656ed", "attempt_id": "30b19b1bab9e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:41.434838Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 217, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.45333299785852, "ttft_ms": 11.76775002386421, "decode_ms": 11.744958930648863}, "total_wall_ms": 124.5832919375971, "ttft_ms": 11.76775002386421, "input_usage": {"receiver_prompt_tokens": 217, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487054336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9480720352, "mlx_cache_bytes": 1981852116, "process_rss_bytes": 10487054336}, "peak_prefill_memory": null, "peak_decode_memory": 9480720352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "06670d30ca7fe4502ab91bdb", "attempt_id": "e0ecd57e0179", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:41.577733Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 215, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.41654191445559, "ttft_ms": 11.670874897390604, "decode_ms": 11.674291919916868}, "total_wall_ms": 124.37908293213695, "ttft_ms": 11.670874897390604, "input_usage": {"receiver_prompt_tokens": 215, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487054336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9485815776, "mlx_cache_bytes": 2137991636, "process_rss_bytes": 10487054336}, "peak_prefill_memory": null, "peak_decode_memory": 9485815776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "43fe6281bc0365d744d65e5d", "attempt_id": "3e8e5946a096", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:41.719757Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 221, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.16562498640269, "ttft_ms": 11.610207962803543, "decode_ms": 11.586999986320734}, "total_wall_ms": 124.00241696741432, "ttft_ms": 11.610207962803543, "input_usage": {"receiver_prompt_tokens": 221, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487054336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9483505644, "mlx_cache_bytes": 2298490180, "process_rss_bytes": 10487054336}, "peak_prefill_memory": null, "peak_decode_memory": 9483505644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5cca2c647a8c155e1cb11875", "attempt_id": "ca74a08a47b4", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:41.861485Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 221, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.84675007965416, "ttft_ms": 11.679540970362723, "decode_ms": 11.733541963621974}, "total_wall_ms": 124.8659580014646, "ttft_ms": 11.679540970362723, "input_usage": {"receiver_prompt_tokens": 221, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487054336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9483505644, "mlx_cache_bytes": 2298490180, "process_rss_bytes": 10487054336}, "peak_prefill_memory": null, "peak_decode_memory": 9483505644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a346557af385b457ae7a7bac", "attempt_id": "cf0ceca310d2", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:42.004737Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 213, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.56270805560052, "ttft_ms": 11.85395906213671, "decode_ms": 11.736584012396634}, "total_wall_ms": 123.85179195553064, "ttft_ms": 11.85395906213671, "input_usage": {"receiver_prompt_tokens": 213, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487054336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9476067296, "mlx_cache_bytes": 2453089604, "process_rss_bytes": 10487054336}, "peak_prefill_memory": null, "peak_decode_memory": 9476067296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6dc197ff262bd623e52a76d3", "attempt_id": "57567270761e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:42.146117Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 212, "message_tokens": 133, "message_utf8_bytes": 606, "cache_tensor_bytes": null, "serialized_payload_bytes": 606, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.5832499386743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.48100003041327, "ttft_ms": 11.727834003977478, "decode_ms": 11.741833994165063}, "total_wall_ms": 124.5608750032261, "ttft_ms": 11.727834003977478, "input_usage": {"receiver_prompt_tokens": 212, "sender_input_tokens": 2098, "sender_output_tokens": 133, "sender_prefill_ms": 368.8642499037087, "sender_ttft_ms": 7.221292005851865, "sender_decode_ms": 950.6103330058977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487054336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9480753096, "mlx_cache_bytes": 2453089604, "process_rss_bytes": 10487054336}, "peak_prefill_memory": null, "peak_decode_memory": 9480753096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2931f2df1ebf72b2ceced81723d88edb7ad16079f9cb4946b07726092d847573", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "acfacfa69a7f7a0bda7f8bd7", "attempt_id": "e8c3c1bc03b0", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.325930Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 399, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.35116701945662, "ttft_ms": 11.910625034943223, "decode_ms": 11.873084004037082}, "total_wall_ms": 191.04420894291252, "ttft_ms": 11.910625034943223, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487103488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9520797820, "mlx_cache_bytes": 2961452356, "process_rss_bytes": 10487103488}, "peak_prefill_memory": null, "peak_decode_memory": 9520797820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b353c013f1717396d5df8a09", "attempt_id": "b062e3161da5", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.536218Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 405, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.65716596879065, "ttft_ms": 11.959416908212006, "decode_ms": 11.91558304708451}, "total_wall_ms": 186.46120803896338, "ttft_ms": 11.959416908212006, "input_usage": {"receiver_prompt_tokens": 405, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487103488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9523894396, "mlx_cache_bytes": 3211488580, "process_rss_bytes": 10487103488}, "peak_prefill_memory": null, "peak_decode_memory": 9523894396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "954d27c49d2678b698d7c7d0", "attempt_id": "6b83321a726c", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.741386Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 404, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.58133291173726, "ttft_ms": 11.920167016796768, "decode_ms": 11.84491696767509}, "total_wall_ms": 186.30987498909235, "ttft_ms": 11.920167016796768, "input_usage": {"receiver_prompt_tokens": 404, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487103488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9523894396, "mlx_cache_bytes": 3211488580, "process_rss_bytes": 10487103488}, "peak_prefill_memory": null, "peak_decode_memory": 9523894396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "809945d2a8d4bc199cf7e763", "attempt_id": "e9abcd44fac9", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:46.947787Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 402, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.46287496667355, "ttft_ms": 11.7264169966802, "decode_ms": 11.757874977774918}, "total_wall_ms": 185.8869579154998, "ttft_ms": 11.7264169966802, "input_usage": {"receiver_prompt_tokens": 402, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487119872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9522911356, "mlx_cache_bytes": 3352784196, "process_rss_bytes": 10487119872}, "peak_prefill_memory": null, "peak_decode_memory": 9522911356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8b22538ecda5927498bdd2ff", "attempt_id": "694d54f612b9", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.152478Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 408, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 162.21025004051626, "ttft_ms": 12.007166049443185, "decode_ms": 11.803208035416901}, "total_wall_ms": 186.9677919894457, "ttft_ms": 12.007166049443185, "input_usage": {"receiver_prompt_tokens": 408, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487119872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9525811324, "mlx_cache_bytes": 3591433540, "process_rss_bytes": 10487119872}, "peak_prefill_memory": null, "peak_decode_memory": 9525811324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7c311ff0b7a2c7cf7aaa1bb0", "attempt_id": "994f74365283", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.358360Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 408, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.8895409628749, "ttft_ms": 11.817125021480024, "decode_ms": 117.84058308694512}, "total_wall_ms": 292.37329098396003, "ttft_ms": 11.817125021480024, "input_usage": {"receiver_prompt_tokens": 408, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487119872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9525811324, "mlx_cache_bytes": 3591433540, "process_rss_bytes": 10487119872}, "peak_prefill_memory": null, "peak_decode_memory": 9525811324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-38K-5533", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "18acd9807857243bbded3bceae55398316a3958b81d70364441bdb6748eaf878"} | ||||
| 599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7b84d2ed6ed90c3a3446a3e6", "attempt_id": "b6fd2e3b116a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.669200Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 400, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.696832976304, "ttft_ms": 11.781292036175728, "decode_ms": 11.812624987214804}, "total_wall_ms": 186.0954590374604, "ttft_ms": 11.781292036175728, "input_usage": {"receiver_prompt_tokens": 400, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487119872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9521223804, "mlx_cache_bytes": 3732204868, "process_rss_bytes": 10487119872}, "peak_prefill_memory": null, "peak_decode_memory": 9521223804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8b9c60f010cdaefcb6b2b8b9", "attempt_id": "9d1862f6bd0e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:47.873478Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 399, "message_tokens": 308, "message_utf8_bytes": 742, "cache_tensor_bytes": null, "serialized_payload_bytes": 742, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4036.3854579627514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.37683298438787, "ttft_ms": 11.766624986194074, "decode_ms": 11.837875004857779}, "total_wall_ms": 185.7348330086097, "ttft_ms": 11.766624986194074, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 2126, "sender_output_tokens": 512, "sender_prefill_ms": 372.81787500251085, "sender_ttft_ms": 7.312707952223718, "sender_decode_ms": 3654.2738339630887}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487136256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9520732284, "mlx_cache_bytes": 3732204868, "process_rss_bytes": 10487136256}, "peak_prefill_memory": null, "peak_decode_memory": 9520732284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2ae1891e46ffe4cf7642e2139a40ccdfca806f63d9694ec81eaf7a4f9762530c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 601 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1d952704d1eb246a8e059728", "attempt_id": "c9513eb237c9", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:48.456254Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.365999924018979, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.205957933329046, "ttft_ms": 47.205957933329046, "decode_ms": 580.0214579794556}, "total_wall_ms": 630.3782500326633, "ttft_ms": 47.205957933329046, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9491188944, "mlx_cache_bytes": 4578816885, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9491188944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".\nTherefore, i have been with a-aided exercicesolution.com o.Ohio-upp\nWhayofen-no. .thuswasitoujavanupglossarytitlemay\nthus iegyan,\nA", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "30579909120f2eac26e2bf45df5008389beef5720cbf3222d7076a8ddea0c4e9"} | ||||
| 602 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "16c8a20a59aef7a2fe8efabb", "attempt_id": "889a63b11e6a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:49.106170Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 42, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.458957907743752, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.92383306287229, "ttft_ms": 48.92383306287229, "decode_ms": 580.2930000936612}, "total_wall_ms": 632.4984999373555, "ttft_ms": 48.92383306287229, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9500773608, "mlx_cache_bytes": 4642174149, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9500773608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\n:_:It's not always justinclusion\nTo putum,complemastery-is-lyophilicmechanist.com\n1、学士為人:“我為數值不等� glBeginốc0：", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "985897b0f1ef3e1fb06b4e8037e115eb26a14b5bbe324359f12d2f6f358b0528"} | ||||
| 603 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "09831e3c8e28e33ad7eb165e", "attempt_id": "e86e30299eb1", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:49.757658Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 41, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.4426249545067549, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.12279197014868, "ttft_ms": 49.12279197014868, "decode_ms": 580.2408750168979}, "total_wall_ms": 632.6795839704573, "ttft_ms": 49.12279197014868, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9499430120, "mlx_cache_bytes": 4695340229, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9499430120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "avenger_just_soap_everdosex10111111111.EXCCEAest20039wasnotjustan\n为什麽論及特為數学成数学术", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "61759d42c0dce581e4d4f88c281133ae86f90fc1c7cc0590231af2f07573deb3"} | ||||
| 604 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cd39354cff78b44b98727f7c", "attempt_id": "e42c8ce56763", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:50.410187Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 39, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.4852919848635793, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.65350003819913, "ttft_ms": 48.65350003819913, "decode_ms": 579.0306250564754}, "total_wall_ms": 630.9717909898609, "ttft_ms": 48.65350003819913, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9495186664, "mlx_cache_bytes": 4741069494, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9495186664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "=:=a:1:1.00001: 1.0.0:is:1.0.0:1. therefore, iuseless:1.4-Connectathon Year:gonebareg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "56060e308d8d7a016bc9b114911f834267d326a330dc6532c6d9b6dc2c511481"} | ||||
| 605 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a69dcc253340e4bc8f6fa252", "attempt_id": "52ee28f7a571", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:51.060564Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.476750010624528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.64691703207791, "ttft_ms": 49.64691703207791, "decode_ms": 580.6524580111727}, "total_wall_ms": 633.7396659655496, "ttft_ms": 49.64691703207791, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9506835700, "mlx_cache_bytes": 4898126878, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9506835700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "helicarecherchefeeling:\n####线性绎三环智包装车用語文不代表我該 Art andl' s problemcomplaketheforn of:Youarententitled:您应当为我愿意,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "0de6a94f1870c9c271953f61324ad7fb305d0eaf935171e8d906d454be5baac6"} | ||||
| 606 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2abf229b2572bc86f1effff1", "attempt_id": "75cc97ff5ace", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:51.714707Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.4799999771639705, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.67774997930974, "ttft_ms": 49.67774997930974, "decode_ms": 579.6750000445172}, "total_wall_ms": 632.6476250542328, "ttft_ms": 49.67774997930974, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9507163380, "mlx_cache_bytes": 4898126878, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9507163380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "helichestertop - 1 = what iwillcompte1 -magentpersononionidadeextrateroie.e1 - Boyd:1 - )1 -\nLook for theorieist2 -: I -Pin", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "7f06399aee893f4d497583bbd8dc6a404d3a8ffa833d33a33a8edbbfedae1a17"} | ||||
| 607 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3fd97c19164465a19db2545a", "attempt_id": "f0a1747940fc", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:52.366418Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 37, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.4678749721497297, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.721332986839116, "ttft_ms": 47.721332986839116, "decode_ms": 580.2374170161784}, "total_wall_ms": 631.2993329484016, "ttft_ms": 47.721332986839116, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9492090088, "mlx_cache_bytes": 4932385822, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9492090088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I: I dont't-1000rsesstorieower-1001-mageminnovationeBooks:0192-1multimetre).\nI'm Eugene Miller'snotationso, Icant't", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "7d4dc2efe4a111b60ba72219dccb97e9f2a2bec64bae9c6528af117cdfb5d4e6"} | ||||
| 608 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c18d3fd138d59e904998e4f", "attempt_id": "794235eb405f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:53.016594Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518245, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 379.08329197671264, "doc_prefill_ms": 345.43533297255635, "compress_ms": 9.711457998491824, "serialize_ms": 20.46045905444771, "load_ms": 1.503917039372027, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.51683305948973, "ttft_ms": 47.51683305948973, "decode_ms": 579.2786249658093}, "total_wall_ms": 630.1746249664575, "ttft_ms": 47.51683305948973, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637180928, "backend_memory": {"mlx_active_bytes": 9412660232, "mlx_peak_bytes": 9491221712, "mlx_cache_bytes": 4932385822, "process_rss_bytes": 10637180928}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9491221712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ",\nWe are you_should stream -o-made-geographic\nExtratobgove\netetelebovart of (so-tytoner\nнoigo: 1.致,学不等.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c18a6df22742c3759352d624c441afe563f2304dab337c94d2129823ee45e080", "output_hash": "564a5af0c8f261365f5b607689a67caf135f3d921969e2f28da164f7c09799e1"} | ||||
| 609 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "861e4ea9c5192854f3251de3", "attempt_id": "ceffc60cdaad", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:54.976342Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.456208061426878, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.032625005580485, "ttft_ms": 58.032625005580485, "decode_ms": 12.589666992425919}, "total_wall_ms": 73.93333408981562, "ttft_ms": 58.032625005580485, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9491221712, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9491221712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 610 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8807906ac12d178906af1e6c", "attempt_id": "a5ab123ea647", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.071406Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 42, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.3977499911561608, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.78525000438094, "ttft_ms": 47.78525000438094, "decode_ms": 12.729833950288594}, "total_wall_ms": 64.01779199950397, "ttft_ms": 47.78525000438094, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9500773608, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9500773608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 611 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "28da346fdcc50a7a3dda97d7", "attempt_id": "7836cbd74823", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.155516Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 41, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.431541983038187, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.1171249197796, "ttft_ms": 50.1171249197796, "decode_ms": 12.403625063598156}, "total_wall_ms": 65.79720799345523, "ttft_ms": 50.1171249197796, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9499430120, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9499430120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 612 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fec3ea7eaf78c3b20ae1fc49", "attempt_id": "bcd5ec37f867", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.240547Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 39, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.4491670299321413, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.05633402429521, "ttft_ms": 48.05633402429521, "decode_ms": 12.391624972224236}, "total_wall_ms": 63.635417027398944, "ttft_ms": 48.05633402429521, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9495186664, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9495186664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 613 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "23e6092d44783324064cb82d", "attempt_id": "b9b1efa93755", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.322644Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.423124922439456, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.73870899993926, "ttft_ms": 49.73870899993926, "decode_ms": 12.368708034045994}, "total_wall_ms": 65.36029209382832, "ttft_ms": 49.73870899993926, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9507163380, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9507163380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 614 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6d47db925148cd73652bc140", "attempt_id": "a3402d12459a", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.405395Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.4237090945243835, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.655582988634706, "ttft_ms": 49.655582988634706, "decode_ms": 12.313792016357183}, "total_wall_ms": 65.11500000488013, "ttft_ms": 49.655582988634706, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9507163380, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9507163380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 615 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "97bb841c604885b4f684a996", "attempt_id": "4d3ce2d7a78e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.488069Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 37, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.4321249909698963, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.559209051541984, "ttft_ms": 47.559209051541984, "decode_ms": 12.384000001475215}, "total_wall_ms": 63.104999950155616, "ttft_ms": 47.559209051541984, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9492090088, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9492090088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 616 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5aed26ff6e6c9683ef5cbd08", "attempt_id": "6e79f9f7c4d0", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.568825Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334803464}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 74502144, "serialized_payload_bytes": 74518346, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.0775419948623, "doc_prefill_ms": 344.86983402166516, "compress_ms": 940.8996659331024, "serialize_ms": 22.030166001059115, "load_ms": 1.3982080854475498, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.67925008106977, "ttft_ms": 46.67925008106977, "decode_ms": 12.390708085149527}, "total_wall_ms": 62.312333029694855, "ttft_ms": 46.67925008106977, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10635984896, "backend_memory": {"mlx_active_bytes": 9411480584, "mlx_peak_bytes": 9491221712, "mlx_cache_bytes": 4937727006, "process_rss_bytes": 10635984896}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9491221712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "119f633be235cfa25ef3ec47d2b8fc5dd90828ea104a2b39c298fd7f72da2e24", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 617 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "67229bb54381b8067f482da4", "attempt_id": "0b8e65b22972", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:55.649118Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 36, "compress_ms": 87.50062494073063}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1373.2469170354307, "doc_prefill_ms": 345.93162511009723, "compress_ms": 1019.7556670755148, "serialize_ms": 7.258208002895117, "load_ms": 1.1512920027598739, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.48016694933176, "ttft_ms": 36.48016694933176, "decode_ms": 11.904250015504658}, "total_wall_ms": 1426.3794580474496, "ttft_ms": 36.48016694933176, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10618191872, "backend_memory": {"mlx_active_bytes": 9298807816, "mlx_peak_bytes": 9366408400, "mlx_cache_bytes": 5116328910, "process_rss_bytes": 10618191872}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9366408400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 618 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b9a39f9aeec5e56e29c27dde", "attempt_id": "0c17f046dac6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:57.093236Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 42, "compress_ms": 90.82645899616182}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 42, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1361.890250002034, "doc_prefill_ms": 344.80650001205504, "compress_ms": 1011.3424169830978, "serialize_ms": 5.4250420071184635, "load_ms": 1.18245801422745, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.63745806645602, "ttft_ms": 37.63745806645602, "decode_ms": 12.03712506685406}, "total_wall_ms": 1416.2277919240296, "ttft_ms": 37.63745806645602, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10628186112, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9377909992, "mlx_cache_bytes": 5170494414, "process_rss_bytes": 10628186112}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9377909992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 619 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1cf622e19200833fa4f6f9e3", "attempt_id": "6adf37443936", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:58.530623Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 41, "compress_ms": 85.03095805644989}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 41, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1356.6318330122158, "doc_prefill_ms": 345.685416017659, "compress_ms": 1005.8819999685511, "serialize_ms": 4.756332957185805, "load_ms": 1.1224999325349927, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.966208019293845, "ttft_ms": 36.966208019293845, "decode_ms": 11.779541033320129}, "total_wall_ms": 1409.6699160290882, "ttft_ms": 36.966208019293845, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10628186112, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9376271592, "mlx_cache_bytes": 5175802830, "process_rss_bytes": 10628186112}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9376271592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 620 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "79c75dcac7de49ef3aa5160d", "attempt_id": "56c421faf5ed", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:29:59.961537Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 39, "compress_ms": 85.84950002841651}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 39, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1359.6423340495676, "doc_prefill_ms": 345.5708749825135, "compress_ms": 1008.2589170197025, "serialize_ms": 5.490166018716991, "load_ms": 1.203165971674025, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.36445803567767, "ttft_ms": 36.36445803567767, "decode_ms": 12.065332964994013}, "total_wall_ms": 1412.7997501054779, "ttft_ms": 36.36445803567767, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10628202496, "backend_memory": {"mlx_active_bytes": 9299414024, "mlx_peak_bytes": 9370881256, "mlx_cache_bytes": 5200313294, "process_rss_bytes": 10628202496}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9370881256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 621 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e958d74ab657c241c3fb9fac", "attempt_id": "9adcea5e1f34", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:01.396037Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 45, "compress_ms": 91.80366690270603}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1382.0843329885975, "doc_prefill_ms": 344.93595792446285, "compress_ms": 1031.6769999917597, "serialize_ms": 5.149791017174721, "load_ms": 1.105167088098824, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.97983408346772, "ttft_ms": 36.97983408346772, "decode_ms": 12.04845798201859}, "total_wall_ms": 1435.6373749906197, "ttft_ms": 36.97983408346772, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10628202496, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9382890740, "mlx_cache_bytes": 5243698126, "process_rss_bytes": 10628202496}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9382890740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 622 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c6ed964a172931840fcb6f7", "attempt_id": "7cb8d5057c27", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:02.852269Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 45, "compress_ms": 86.57062496058643}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1351.7321250401437, "doc_prefill_ms": 345.1831249985844, "compress_ms": 1001.0204589925706, "serialize_ms": 5.210916977375746, "load_ms": 1.083084032870829, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.834250018931925, "ttft_ms": 37.834250018931925, "decode_ms": 11.84175000526011}, "total_wall_ms": 1405.892499955371, "ttft_ms": 37.834250018931925, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10628202496, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9382890740, "mlx_cache_bytes": 5243698126, "process_rss_bytes": 10628202496}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9382890740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 623 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6641c5eb2248d56084a6d919", "attempt_id": "64a87df5eb7d", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:04.279416Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 37, "compress_ms": 81.32391702383757}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 37, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1356.5201250603423, "doc_prefill_ms": 345.2345409896225, "compress_ms": 1005.9171670582145, "serialize_ms": 5.0536670023575425, "load_ms": 1.0740410070866346, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.766166052781045, "ttft_ms": 35.766166052781045, "decode_ms": 12.022416922263801}, "total_wall_ms": 1408.649874967523, "ttft_ms": 35.766166052781045, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10628202496, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9367784680, "mlx_cache_bytes": 5262703566, "process_rss_bytes": 10628202496}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9367784680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 624 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0998c11ee5f41fba71ee399b", "attempt_id": "f6e05527704a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:05.708915Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2021, "keep": 505, "window_tokens": 36, "compress_ms": 96.91341605503112}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 18616320, "serialized_payload_bytes": 18632405, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1363.4905830258504, "doc_prefill_ms": 344.4408749928698, "compress_ms": 1013.8222080422565, "serialize_ms": 4.908041097223759, "load_ms": 1.1354159796610475, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.773291951045394, "ttft_ms": 35.773291951045394, "decode_ms": 12.196541065350175}, "total_wall_ms": 1415.9309170208871, "ttft_ms": 35.773291951045394, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10628202496, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9365605584, "mlx_cache_bytes": 5262703566, "process_rss_bytes": 10628202496}, "peak_prefill_memory": 10002328652, "peak_decode_memory": 9365605584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5a4074c15cfa0064bd810e174e63cd7f10310282643b9f47e101b3be13026dbf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 625 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ae9d9fcdeec38eb285bcacea", "attempt_id": "7b4fda7234ac", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:07.176708Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5865, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.763290980831, "ttft_ms": 12.569916085340083, "decode_ms": 123.32100002095103}, "total_wall_ms": 2348.278457997367, "ttft_ms": 12.569916085340083, "input_usage": {"receiver_prompt_tokens": 5865}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10452336640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1677112760, "process_rss_bytes": 10452336640}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XT-58M-1436", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "88a42ad8cf9f73f734996854479d027d426515d2bbd638fc89c418555a6c0484"} | ||||
| 626 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8371718048a27ca682e96a77", "attempt_id": "73187c7d7ad5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:09.554536Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5869, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.0253750011325, "ttft_ms": 12.570540886372328, "decode_ms": 110.59520801063627}, "total_wall_ms": 2334.4529590103775, "ttft_ms": 12.570540886372328, "input_usage": {"receiver_prompt_tokens": 5869}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10452369408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2228909496, "process_rss_bytes": 10452369408}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 69-B, La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "3fa524abb2f344eee793f1d2e0661c3856e21ccde70f1aa4fd07f4a796141a4a"} | ||||
| 627 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fafc697545c4151cd62286b5", "attempt_id": "03c8cd5845e5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:11.916797Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5870, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.591999968514, "ttft_ms": 12.487916043028235, "decode_ms": 86.22033300343901}, "total_wall_ms": 2311.454000067897, "ttft_ms": 12.487916043028235, "input_usage": {"receiver_prompt_tokens": 5870}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10452369408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2752214456, "process_rss_bytes": 10452369408}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "64.4363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "e893d3cc84006f45f29fed9ad95a4a4d27a56c544413f192e25efb93ff18e0c9"} | ||||
| 628 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "226a0a10717ac9d47c67f115", "attempt_id": "65dc254b1d40", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:14.254531Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5865, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2199.5572920423, "ttft_ms": 12.5909160124138, "decode_ms": 61.51062506251037}, "total_wall_ms": 2285.3026669472456, "ttft_ms": 12.5909160124138, "input_usage": {"receiver_prompt_tokens": 5865}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10452402176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2752214456, "process_rss_bytes": 10452402176}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Varga", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "f6d5cac4a4e0857d4a2d59edc807a8bc5b4453aa9de6472025ff948ea6d9e901"} | ||||
| 629 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2b85a2bef36161b1328ad546", "attempt_id": "3d5195a5b6be", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:16.566381Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5871, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.199707993306, "ttft_ms": 12.607624987140298, "decode_ms": 86.10466599930078}, "total_wall_ms": 2309.96345798485, "ttft_ms": 12.607624987140298, "input_usage": {"receiver_prompt_tokens": 5871}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10452434944, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3064690104, "process_rss_bytes": 10452434944}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8544550", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "7ea69da7ca13297bce5fac6a79b7f74d78548d728dc85a91c943d1c2c8172768"} | ||||
| 630 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8398f1d997ed2ec17ecffd11", "attempt_id": "0ed6fbc61f4c", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:18.902404Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5873, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.108500059694, "ttft_ms": 12.632083031348884, "decode_ms": 136.16420805919915}, "total_wall_ms": 2362.0350839337334, "ttft_ms": 12.632083031348884, "input_usage": {"receiver_prompt_tokens": 5873}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10452484096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3377558968, "process_rss_bytes": 10452484096}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 631 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6ee1d841a7902a5b0522390c", "attempt_id": "832974584279", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:21.290991Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5866, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.061750016175, "ttft_ms": 12.592833023518324, "decode_ms": 12.404624954797328}, "total_wall_ms": 2236.280707991682, "ttft_ms": 12.592833023518324, "input_usage": {"receiver_prompt_tokens": 5866}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452516864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3689248184, "process_rss_bytes": 10452516864}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 632 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8cb38dfe3026adf21a012b9a", "attempt_id": "6528666d90f4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:23.553230Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5864, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017125043086707592, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2198.930957936682, "ttft_ms": 12.647708063013852, "decode_ms": 12.420207960531116}, "total_wall_ms": 2235.585332964547, "ttft_ms": 12.647708063013852, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452549632, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3689248184, "process_rss_bytes": 10452549632}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 633 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8558aca4a63d82d5e50c3de6", "attempt_id": "2012dff4104d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:27.962088Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 218, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 104.73783395718783, "ttft_ms": 12.042374932207167, "decode_ms": 11.803708039224148}, "total_wall_ms": 129.59654198493809, "ttft_ms": 12.042374932207167, "input_usage": {"receiver_prompt_tokens": 218, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9485307872, "mlx_cache_bytes": 5325117724, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9485307872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 634 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1ec73024a24b19189b419d1e", "attempt_id": "dac53927e67e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:28.121388Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 222, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.23416702076793, "ttft_ms": 11.852458002977073, "decode_ms": 11.813834076747298}, "total_wall_ms": 123.89570800587535, "ttft_ms": 11.852458002977073, "input_usage": {"receiver_prompt_tokens": 222, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9488207856, "mlx_cache_bytes": 5448506512, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9488207856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 635 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9936ba832ed9b24d6502cee", "attempt_id": "9beaad57c674", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:28.274260Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 223, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.39879097510129, "ttft_ms": 11.826667003333569, "decode_ms": 11.683208053000271}, "total_wall_ms": 123.8600000506267, "ttft_ms": 11.826667003333569, "input_usage": {"receiver_prompt_tokens": 223, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9489879028, "mlx_cache_bytes": 5581447176, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9489879028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 636 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8de0c9324560f7850d447f2d", "attempt_id": "803dff1321f0", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:28.427415Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 218, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 98.89945795293897, "ttft_ms": 11.818958912044764, "decode_ms": 11.711166007444263}, "total_wall_ms": 123.3007499249652, "ttft_ms": 11.818958912044764, "input_usage": {"receiver_prompt_tokens": 218, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9485307872, "mlx_cache_bytes": 5581447176, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9485307872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 637 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9d91ceb156b87e193100492f", "attempt_id": "496edb35479a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:28.579876Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 224, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.6410408988595, "ttft_ms": 11.879374971613288, "decode_ms": 11.818124912679195}, "total_wall_ms": 124.23025001771748, "ttft_ms": 11.879374971613288, "input_usage": {"receiver_prompt_tokens": 224, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9490501624, "mlx_cache_bytes": 5744124804, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9490501624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 638 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c3ca128435ded2e633a5cbcb", "attempt_id": "663f96a94079", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:28.732853Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 226, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 102.42154099978507, "ttft_ms": 11.947583057917655, "decode_ms": 11.76024996675551}, "total_wall_ms": 127.06812506075948, "ttft_ms": 11.947583057917655, "input_usage": {"receiver_prompt_tokens": 226, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9490042880, "mlx_cache_bytes": 5954578184, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9490042880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 639 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "65d49c59f0cc041959fde972", "attempt_id": "44da62cae382", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:28.887344Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 219, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.56204204354435, "ttft_ms": 11.925874976441264, "decode_ms": 11.74749992787838}, "total_wall_ms": 124.1018750006333, "ttft_ms": 11.925874976441264, "input_usage": {"receiver_prompt_tokens": 219, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9485930480, "mlx_cache_bytes": 6113535752, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9485930480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 640 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c3b20f8ca84bcb9a036dec54", "attempt_id": "048fb0206bb9", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:29.038553Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 217, "message_tokens": 139, "message_utf8_bytes": 678, "cache_tensor_bytes": null, "serialized_payload_bytes": 678, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2143.34195794072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.52345897909254, "ttft_ms": 11.849457980133593, "decode_ms": 11.7534170858562}, "total_wall_ms": 123.97562502883375, "ttft_ms": 11.849457980133593, "input_usage": {"receiver_prompt_tokens": 217, "sender_input_tokens": 5906, "sender_output_tokens": 139, "sender_prefill_ms": 1116.944833076559, "sender_ttft_ms": 7.413625018671155, "sender_decode_ms": 1013.332083937712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9481146336, "mlx_cache_bytes": 6126806792, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9481146336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9cdcab3248f42641d2147dc85933d3182a787210663d3cf820a2fb4947ce435b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 641 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "60ad6867c32c65d9bc987357", "attempt_id": "9cfcd774b75e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.273134Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 383, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 149.8402499128133, "ttft_ms": 12.068541022017598, "decode_ms": 58.89774998649955}, "total_wall_ms": 221.88037494197488, "ttft_ms": 12.068541022017598, "input_usage": {"receiver_prompt_tokens": 383, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10452631552, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9510408820, "mlx_cache_bytes": 7226223872, "process_rss_bytes": 10452631552}, "peak_prefill_memory": null, "peak_decode_memory": 9510408820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixbanruk-3", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "1cc74509d5485de66115e1f6b591a4a84f89826fbba3b26cfbf7cfcfdc216bf5"} | ||||
| 642 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f8264c3f44db14442b148693", "attempt_id": "0019c6e8f1f5", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.522648Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 387, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.79741599969566, "ttft_ms": 11.989332968369126, "decode_ms": 105.98466696683317}, "total_wall_ms": 279.6942919958383, "ttft_ms": 11.989332968369126, "input_usage": {"receiver_prompt_tokens": 387, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10452647936, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9513228412, "mlx_cache_bytes": 7470820608, "process_rss_bytes": 10452647936}, "peak_prefill_memory": null, "peak_decode_memory": 9513228412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 69-B in La Tuque", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "46dbb037a10c29cd2d75c897c0da8271c651c20496aa7d5d1a6bdaac04b5c868"} | ||||
| 643 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d8dda2945bf9df555f5616c", "attempt_id": "44396598f86e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:33.828900Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 388, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.73270898777992, "ttft_ms": 11.831708019599319, "decode_ms": 11.846916051581502}, "total_wall_ms": 185.2337500313297, "ttft_ms": 11.831708019599319, "input_usage": {"receiver_prompt_tokens": 388, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452680704, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9513719932, "mlx_cache_bytes": 7607397632, "process_rss_bytes": 10452680704}, "peak_prefill_memory": null, "peak_decode_memory": 9513719932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 644 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7960e3e18c7db8487099feeb", "attempt_id": "7f23290f9350", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.040529Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 383, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.43258300889283, "ttft_ms": 12.186500011011958, "decode_ms": 11.863624909892678}, "total_wall_ms": 169.4104999769479, "ttft_ms": 12.186500011011958, "input_usage": {"receiver_prompt_tokens": 383, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452680704, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9510408820, "mlx_cache_bytes": 7607397632, "process_rss_bytes": 10452680704}, "peak_prefill_memory": null, "peak_decode_memory": 9510408820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 645 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3bc19111f3eb0a521ee06c9d", "attempt_id": "81c3c7e55b0b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.235194Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 389, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.64487502444535, "ttft_ms": 12.042375048622489, "decode_ms": 11.900499928742647}, "total_wall_ms": 185.5744579806924, "ttft_ms": 12.042375048622489, "input_usage": {"receiver_prompt_tokens": 389, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452697088, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9513965692, "mlx_cache_bytes": 7744236800, "process_rss_bytes": 10452697088}, "peak_prefill_memory": null, "peak_decode_memory": 9513965692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 646 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1d6de7420fc27eb1a174af05", "attempt_id": "2ec373672344", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.447288Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 391, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.01999999955297, "ttft_ms": 12.017042026855052, "decode_ms": 58.91775002237409}, "total_wall_ms": 232.90850000921637, "ttft_ms": 12.017042026855052, "input_usage": {"receiver_prompt_tokens": 391, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10452713472, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9515636860, "mlx_cache_bytes": 7973383424, "process_rss_bytes": 10452713472}, "peak_prefill_memory": null, "peak_decode_memory": 9515636860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ostfel-3", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "4bc5c1dd62fc0e8c2543f6876a524074bfea1546245312d2606e10b8c0ee170b"} | ||||
| 647 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e16ab783613cbdd77c07dfd4", "attempt_id": "7d482f597e6e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.706393Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 384, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.71395907457918, "ttft_ms": 11.852625058963895, "decode_ms": 11.759292101487517}, "total_wall_ms": 169.21512503176928, "ttft_ms": 11.852625058963895, "input_usage": {"receiver_prompt_tokens": 384, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452713472, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9510654584, "mlx_cache_bytes": 8108389116, "process_rss_bytes": 10452713472}, "peak_prefill_memory": null, "peak_decode_memory": 9510654584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 648 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e433ef8fa0ee41a40b68b5e3", "attempt_id": "7df485bd77be", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:34.902198Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 382, "message_tokens": 292, "message_utf8_bytes": 648, "cache_tensor_bytes": null, "serialized_payload_bytes": 648, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4083.356667077169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.37583403196186, "ttft_ms": 12.069042073562741, "decode_ms": 11.872042086906731}, "total_wall_ms": 169.25933305174112, "ttft_ms": 12.069042073562741, "input_usage": {"receiver_prompt_tokens": 382, "sender_input_tokens": 5934, "sender_output_tokens": 399, "sender_prefill_ms": 1115.937374997884, "sender_ttft_ms": 7.5890409061685205, "sender_decode_ms": 2953.6670830566436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452713472, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9509917300, "mlx_cache_bytes": 8108389116, "process_rss_bytes": 10452713472}, "peak_prefill_memory": null, "peak_decode_memory": 9509917300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2c8e4c67a16e8b9e9ddcdbfa302751c67bf871edff445dada41bcedf8f454e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 649 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8d8cafa42b138eccd58054b5", "attempt_id": "57dad2558e18", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:36.276337Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.7435419140383601, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.86316594481468, "ttft_ms": 76.86316594481468, "decode_ms": 634.8357920069247}, "total_wall_ms": 719.7057500015944, "ttft_ms": 76.86316594481468, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883497984, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9797979344, "mlx_cache_bytes": 8918873117, "process_rss_bytes": 10883497984}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9797979344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "-What is酮方面大都认为的制片,对下腔疑似的下,太：走, /外省略云,指的是,断的,“b\n,即美中,甲光:1.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "c2c37f3fd416c92ec9e55f594e5cc3a867cceeca859ae2096c9072ce96f4b29a"} | ||||
| 650 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c8125e3aee914e95acb1b36", "attempt_id": "a06fa048df6a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:37.022896Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 40, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.8042090814560652, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.39262499287724, "ttft_ms": 76.39262499287724, "decode_ms": 633.8632080005482}, "total_wall_ms": 717.7187500055879, "ttft_ms": 76.39262499287724, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883497984, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9804844256, "mlx_cache_bytes": 8976905565, "process_rss_bytes": 10883497984}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9804844256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "是项哪个“0 勃� mooie,尤其是,尤其是中国色,对角,尤其是中国手,尤其是,尤其是文表決� quelqueer,尤其是,即战表,在项下发,尤其是项,在", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "bd06a47f00ba70ec3bdb02c41656b2074477b5edf2903509069e05568c6ea439"} | ||||
| 651 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4ad7aade5fa1965aaf70bf86", "attempt_id": "3d56aa9708bb", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:37.768487Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 41, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.8124160123988986, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.07962503284216, "ttft_ms": 78.07962503284216, "decode_ms": 632.556917029433}, "total_wall_ms": 718.133833957836, "ttft_ms": 78.07962503284216, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883497984, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9808760036, "mlx_cache_bytes": 9033791141, "process_rss_bytes": 10883497984}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9808760036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "规则, in the 19-2nd-meronyms, especially in-person-1 R:1, \"I\", surely, \"#### Excellon, nothing that is equivalent to explainable, fit for the fastm, judge", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "7f7b4ca04420099643978559776bfa28210515b5deeb9d43ea9e2ccf7fc647e0"} | ||||
| 652 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f7f8057a4c6f410b14a231bb", "attempt_id": "4a904cb47781", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:38.513747Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.8073340179398656, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.17237499915063, "ttft_ms": 71.17237499915063, "decode_ms": 634.8001660080627}, "total_wall_ms": 713.7055830098689, "ttft_ms": 71.17237499915063, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883481600, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9797979344, "mlx_cache_bytes": 9033791141, "process_rss_bytes": 10883481600}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9797979344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The Most Important \"C5 for\nThe Five-Toi (1,佯 Narrative, sangun-Set (ie): \"Hie: 1, with the Daily:3, 1, in which is followed, and (", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "2480a8685690bf67bbb04c0457d0856bc8ba47b6d094d5b08b9dced0b111d8c7"} | ||||
| 653 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "50201bc1e758246b138cb3a2", "attempt_id": "0d55a8071795", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:39.255112Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 42, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.804040977731347, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.56683297641575, "ttft_ms": 74.56683297641575, "decode_ms": 634.0299580479041}, "total_wall_ms": 715.992790996097, "ttft_ms": 74.56683297641575, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883481600, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9809874152, "mlx_cache_bytes": 9079584757, "process_rss_bytes": 10883481600}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9809874152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "气态硬性白,当年代:之切信位解 Gord é,即非金中之密,是石原词典:1对:23:先发,当年acy之通関系例程", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "5be3e6c9516f788994de069d8177f922e6bd037ab8b7981545c3c76801dbdc8e"} | ||||
| 654 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1a8f76a1977840cf69b6b112", "attempt_id": "697c14c62bc9", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:39.999095Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 44, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.7524580471217632, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.54591598454863, "ttft_ms": 75.54591598454863, "decode_ms": 635.516417096369}, "total_wall_ms": 718.5899169417098, "ttft_ms": 75.54591598454863, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883481600, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9812233456, "mlx_cache_bytes": 9149069653, "process_rss_bytes": 10883481600}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9812233456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "King推短平庸云和abel:G1. (hht:)\n\n从iH:1, iti - / ! ##(dare-excellent performance -gayes:1,3to3:1 e-", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "73b277b0b9c2e3b2388ec4388caa29e24dd5a1fa8cfd56990a40658a88a9edd4"} | ||||
| 655 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "78cc51b6da689d1349f060ea", "attempt_id": "1dadbbc3bcbf", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:40.744629Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 37, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.7267500516027212, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.54450004640967, "ttft_ms": 73.54450004640967, "decode_ms": 634.4503751024604}, "total_wall_ms": 715.0827920995653, "ttft_ms": 73.54450004640967, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883481600, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9800535264, "mlx_cache_bytes": 9202989397, "process_rss_bytes": 10883481600}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9800535264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LX)的超越王水準化的，(1:iens)1:1(广外链的,别忘了以30,104的括熱成立方程,小能下述真分数线上下", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "9a8bcfab49b83edb1edd200488536b64a6cd4cd1a85eebed548da9d6a073d6cb"} | ||||
| 656 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6172321a0ef27857a7fd5a5c", "attempt_id": "69e6148ab5fb", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:41.486397Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 35, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896446, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.1543330289423, "doc_prefill_ms": 1104.045041021891, "compress_ms": 12.905333074741066, "serialize_ms": 49.90212502889335, "load_ms": 1.8300830852240324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.31866703275591, "ttft_ms": 71.31866703275591, "decode_ms": 632.497958955355}, "total_wall_ms": 710.9507500426844, "ttft_ms": 71.31866703275591, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10883481600, "backend_memory": {"mlx_active_bytes": 9693678600, "mlx_peak_bytes": 9796898000, "mlx_cache_bytes": 9231989077, "process_rss_bytes": 10883481600}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9796898000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1.追 Precogeseer,edhairsterio(으론, 뒤ogue of (uma: -1,至上的iog,如是方程,小升, 1.0(1).", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f6a163420f529099cda42467a56f12720f02bcf4a4a5eff4481d3570e1350374", "output_hash": "cb91b3820cd11a40e1b98f8c5e4fcf585d121c9ce6d5dd00650e73198ce3a39d"} | ||||
| 657 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61a80025b594d0afd01e70aa", "attempt_id": "b95aef8f321b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.519455Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.801416976377368, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.39599998947233, "ttft_ms": 76.39599998947233, "decode_ms": 13.720417045988142}, "total_wall_ms": 97.93425002135336, "ttft_ms": 76.39599998947233, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797717200, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9797717200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 658 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "00c4b302a9470d894cbb69e1", "attempt_id": "166f2a3a5298", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.646643Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 40, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.739791943691671, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.22491696383804, "ttft_ms": 76.22491696383804, "decode_ms": 40.57087504770607}, "total_wall_ms": 124.32395794894546, "ttft_ms": 76.22491696383804, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 40}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9804582112, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9804582112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "3386b54405a27d7cf286c77001dc75897883844ad2c6646c319a104e812b3830"} | ||||
| 659 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "24d5d05888ee9839cb12eaba", "attempt_id": "dbe584052f93", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.797303Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 41, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.722124987281859, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.35912501811981, "ttft_ms": 77.35912501811981, "decode_ms": 13.527958071790636}, "total_wall_ms": 97.8129169670865, "ttft_ms": 77.35912501811981, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9808301284, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9808301284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 660 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f60a758a2cf220bfc12b2a3d", "attempt_id": "625cc373bf28", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:45.920874Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.7641250742599368, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.17708295118064, "ttft_ms": 71.17708295118064, "decode_ms": 13.409374980255961}, "total_wall_ms": 91.4994589984417, "ttft_ms": 71.17708295118064, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797717200, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9797717200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 661 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "866520d1ec97d61892d29dc5", "attempt_id": "7b3d9b07e66b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.037507Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 42, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.7507090233266354, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.14591603446752, "ttft_ms": 74.14591603446752, "decode_ms": 13.64387501962483}, "total_wall_ms": 95.25949996896088, "ttft_ms": 74.14591603446752, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9809612008, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9809612008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 662 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03b9959f84a8d70dca51b8eb", "attempt_id": "424a8dd64301", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.158822Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 44, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.7715420108288527, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.14120801351964, "ttft_ms": 75.14120801351964, "decode_ms": 13.700708979740739}, "total_wall_ms": 96.05629194993526, "ttft_ms": 75.14120801351964, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9811971312, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9811971312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 663 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "94f6b446cdf115f788b36766", "attempt_id": "624db27ce3f7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.282444Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 37, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.7827500123530626, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.92158401105553, "ttft_ms": 72.92158401105553, "decode_ms": 13.669500011019409}, "total_wall_ms": 93.86666608043015, "ttft_ms": 72.92158401105553, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9800273120, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9800273120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 664 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a13fdb278495ed0bcb2e1710", "attempt_id": "29ed42f0bbbd", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.402247Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 35, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 214880256, "serialized_payload_bytes": 214896547, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3289.4894999917597, "doc_prefill_ms": 1102.1469590486959, "compress_ms": 2125.7486660033464, "serialize_ms": 61.27487507183105, "load_ms": 1.656334032304585, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.53112494759262, "ttft_ms": 70.53112494759262, "decode_ms": 13.508500065654516}, "total_wall_ms": 90.89629200752825, "ttft_ms": 70.53112494759262, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11073830912, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9796635856, "mlx_cache_bytes": 9311353173, "process_rss_bytes": 11073830912}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9796635856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "499b0fd20c7f4ff6cc2e92d05ca39520a59097779e8730d9bcec69f39f5299e7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 665 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "337d9f383754ec146b277a00", "attempt_id": "115fa3d8f0b9", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:46.519390Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 36, "compress_ms": 119.74704102613032}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3363.1845420459285, "doc_prefill_ms": 1103.565416065976, "compress_ms": 2241.6616670088843, "serialize_ms": 17.58637500461191, "load_ms": 1.8552499823272228, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.85254201386124, "ttft_ms": 42.85254201386124, "decode_ms": 12.347750016488135}, "total_wall_ms": 3429.2278749635443, "ttft_ms": 42.85254201386124, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10985947136, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9443380432, "mlx_cache_bytes": 9829127405, "process_rss_bytes": 10985947136}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9443380432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 666 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6d87336c8d54568be1eba41a", "attempt_id": "1d3c2cc622fc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:49.974978Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 40, "compress_ms": 124.38850000035018}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 40, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3348.998334025964, "doc_prefill_ms": 1102.727000019513, "compress_ms": 2232.6547499978915, "serialize_ms": 13.266499969176948, "load_ms": 1.2745000422000885, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.5174170890823, "ttft_ms": 44.5174170890823, "decode_ms": 36.577041959390044}, "total_wall_ms": 3439.0667090192437, "ttft_ms": 44.5174170890823, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 40}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 11040243712, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9449966816, "mlx_cache_bytes": 9862567149, "process_rss_bytes": 11040243712}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9449966816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "3386b54405a27d7cf286c77001dc75897883844ad2c6646c319a104e812b3830"} | ||||
| 667 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d8fc4083fb26d59e2330649a", "attempt_id": "dadd7f2c88c3", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:53.441871Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 41, "compress_ms": 128.17783292848617}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 41, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3379.7488750424236, "doc_prefill_ms": 1103.0408339574933, "compress_ms": 2264.287207974121, "serialize_ms": 12.065542046912014, "load_ms": 1.3162919785827398, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.498082948848605, "ttft_ms": 44.498082948848605, "decode_ms": 12.293666019104421}, "total_wall_ms": 3445.741125033237, "ttft_ms": 44.498082948848605, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11040243712, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9452588260, "mlx_cache_bytes": 9903346925, "process_rss_bytes": 11040243712}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9452588260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 668 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "72e9ede8fca15286d5495ede", "attempt_id": "3d3bfd3bf2a6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:30:56.915187Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 36, "compress_ms": 118.77420800738037}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3362.093709059991, "doc_prefill_ms": 1102.3351670010015, "compress_ms": 2247.792417067103, "serialize_ms": 11.611917056143284, "load_ms": 1.4555000234395266, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.732291971333325, "ttft_ms": 42.732291971333325, "decode_ms": 12.250666972249746}, "total_wall_ms": 3426.54058302287, "ttft_ms": 42.732291971333325, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11040243712, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9443118288, "mlx_cache_bytes": 9903346925, "process_rss_bytes": 11040243712}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9443118288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 669 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8e7c5a50355b2fce4f988b35", "attempt_id": "04b5a89fa3d6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:00.369874Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 42, "compress_ms": 122.07120901439339}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 42, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3344.706124975346, "doc_prefill_ms": 1103.724458022043, "compress_ms": 2228.732166928239, "serialize_ms": 11.892333975993097, "load_ms": 1.2207080144435167, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.286124990321696, "ttft_ms": 44.286124990321696, "decode_ms": 12.252541957423091}, "total_wall_ms": 3410.6605839915574, "ttft_ms": 44.286124990321696, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11040243712, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9453898984, "mlx_cache_bytes": 9941734637, "process_rss_bytes": 11040243712}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9453898984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 670 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c1f2586e9d083ec292ca9fff", "attempt_id": "45d243ca7745", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:03.808089Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 44, "compress_ms": 128.03958298172802}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 44, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3377.671374939382, "doc_prefill_ms": 1104.0457499912009, "compress_ms": 2261.3968750229105, "serialize_ms": 11.870917049236596, "load_ms": 1.6088749980553985, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.348124996759, "ttft_ms": 44.348124996759, "decode_ms": 12.237375020049512}, "total_wall_ms": 3443.6767500592396, "ttft_ms": 44.348124996759, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11040243712, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9457028336, "mlx_cache_bytes": 9984709869, "process_rss_bytes": 11040243712}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9457028336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 671 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a34f32be5e7e210ff0eb7cfe", "attempt_id": "9a7b5157b5be", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:07.279980Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 37, "compress_ms": 119.93558297399431}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 37, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3319.6492079878226, "doc_prefill_ms": 1102.8485420392826, "compress_ms": 2203.6391249857843, "serialize_ms": 12.79858301859349, "load_ms": 1.322624972090125, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.92666702531278, "ttft_ms": 42.92666702531278, "decode_ms": 12.277750065550208}, "total_wall_ms": 3384.3196249799803, "ttft_ms": 42.92666702531278, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11040276480, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9445674208, "mlx_cache_bytes": 10020164845, "process_rss_bytes": 11040276480}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9445674208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 672 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "efd8a9cf1e59948fd9652c1f", "attempt_id": "8c00ebda9dbc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:10.692015Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5829, "keep": 1457, "window_tokens": 35, "compress_ms": 118.85608301963657}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 35, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727205, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3357.403332949616, "doc_prefill_ms": 1102.7237079106271, "compress_ms": 2242.3087910283357, "serialize_ms": 12.011250015348196, "load_ms": 1.2650000862777233, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.61574998963624, "ttft_ms": 42.61574998963624, "decode_ms": 12.323707924224436}, "total_wall_ms": 3421.6058750171214, "ttft_ms": 42.61574998963624, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11040276480, "backend_memory": {"mlx_active_bytes": 9369275400, "mlx_peak_bytes": 9441823952, "mlx_cache_bytes": 10044691693, "process_rss_bytes": 11040276480}, "peak_prefill_memory": 10049391704, "peak_decode_memory": 9441823952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "968fc1f036169f0d10188d2d8697aa5db92d87a39d4fce44556d92af9b231c1f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 673 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "08f1b10d477bd9f6513a5d00", "attempt_id": "bec867683a16", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:14.183951Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1987, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 693.3382919523865, "ttft_ms": 12.398791965097189, "decode_ms": 120.68429193459451}, "total_wall_ms": 829.9214580329135, "ttft_ms": 12.398791965097189, "input_usage": {"receiver_prompt_tokens": 1987}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487414784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9963711304, "mlx_cache_bytes": 712807616, "process_rss_bytes": 10487414784}, "peak_prefill_memory": null, "peak_decode_memory": 9963711304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YY-49S-8868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "4cc3c5053f830db44f19e6ebbdb99b898d31569e68baec422a9c78a7af174fec"} | ||||
| 674 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0dc0c9b9467faa2d49286e06", "attempt_id": "77a2c6315e26", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:15.034183Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1993, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.9234159393236, "ttft_ms": 12.12037494406104, "decode_ms": 131.80725008714944}, "total_wall_ms": 838.567209080793, "ttft_ms": 12.12037494406104, "input_usage": {"receiver_prompt_tokens": 1993}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10487447552, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9965235264, "mlx_cache_bytes": 1300305088, "process_rss_bytes": 10487447552}, "peak_prefill_memory": null, "peak_decode_memory": 9965235264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 675 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8304f51dba7d3f7c87ce60d9", "attempt_id": "759d29c85be8", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:15.891613Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1993, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 688.6097500100732, "ttft_ms": 12.23820901941508, "decode_ms": 84.41533299628645}, "total_wall_ms": 788.7461250647902, "ttft_ms": 12.23820901941508, "input_usage": {"receiver_prompt_tokens": 1993}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487447552, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9965235264, "mlx_cache_bytes": 1300305088, "process_rss_bytes": 10487447552}, "peak_prefill_memory": null, "peak_decode_memory": 9965235264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 676 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d34e5b533f2460156034ab8e", "attempt_id": "0c5f3d13c3bd", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:16.700135Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1990, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 689.4947499968112, "ttft_ms": 12.24941702093929, "decode_ms": 48.29700000118464}, "total_wall_ms": 753.5230829380453, "ttft_ms": 12.24941702093929, "input_usage": {"receiver_prompt_tokens": 1990}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 10487480320, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9964710976, "mlx_cache_bytes": 1650660544, "process_rss_bytes": 10487480320}, "peak_prefill_memory": null, "peak_decode_memory": 9964710976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 677 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b323fe4b68df9fb9f5866903", "attempt_id": "2a8413a39541", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:17.472065Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1997, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 692.0094579691067, "ttft_ms": 12.120416038669646, "decode_ms": 84.41429096274078}, "total_wall_ms": 791.9297080952674, "ttft_ms": 12.120416038669646, "input_usage": {"receiver_prompt_tokens": 1997}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487480320, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9966627904, "mlx_cache_bytes": 2272187584, "process_rss_bytes": 10487480320}, "peak_prefill_memory": null, "peak_decode_memory": 9966627904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1505050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "1db39f1ff343ec77d0d361cc7fba61c718cf3d6710f9f1a136e92bb82fce515d"} | ||||
| 678 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "567c758d75f87e85cdfcd722", "attempt_id": "ad0fc5076491", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:18.282459Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1998, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.3805419569835, "ttft_ms": 12.28104205802083, "decode_ms": 132.81366601586342}, "total_wall_ms": 838.9592909952626, "ttft_ms": 12.28104205802083, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10487496704, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9967234112, "mlx_cache_bytes": 2861552832, "process_rss_bytes": 10487496704}, "peak_prefill_memory": null, "peak_decode_memory": 9967234112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 679 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9948757fcfa678b0ea52b7a1", "attempt_id": "6ac01a09c28a", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:19.139515Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1988, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.7361670164391, "ttft_ms": 12.291750055737793, "decode_ms": 12.307667057029903}, "total_wall_ms": 719.2268749931827, "ttft_ms": 12.291750055737793, "input_usage": {"receiver_prompt_tokens": 1988}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487496704, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9963973696, "mlx_cache_bytes": 3211646144, "process_rss_bytes": 10487496704}, "peak_prefill_memory": null, "peak_decode_memory": 9963973696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 680 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8d0aa27fcb1ac11715938c32", "attempt_id": "d2347797ea08", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:19.877692Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1989, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.4155000811443, "ttft_ms": 12.200042023323476, "decode_ms": 12.029208010062575}, "total_wall_ms": 718.2905829977244, "ttft_ms": 12.200042023323476, "input_usage": {"receiver_prompt_tokens": 1989}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487513088, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9964235840, "mlx_cache_bytes": 3211646144, "process_rss_bytes": 10487513088}, "peak_prefill_memory": null, "peak_decode_memory": 9964235840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 681 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3d1f1c3b60207caa23ac5cba", "attempt_id": "591386944c71", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:21.838964Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 199, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 104.12445804104209, "ttft_ms": 11.835417011752725, "decode_ms": 11.720750015228987}, "total_wall_ms": 128.49004194140434, "ttft_ms": 11.835417011752725, "input_usage": {"receiver_prompt_tokens": 199, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465433992, "mlx_cache_bytes": 4199941080, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9465433992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 682 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c90e937e19b86dd3af4427b8", "attempt_id": "3f33c174a348", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:21.986592Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 205, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.33716598991305, "ttft_ms": 11.693625012412667, "decode_ms": 11.886666994541883}, "total_wall_ms": 124.61275001987815, "ttft_ms": 11.693625012412667, "input_usage": {"receiver_prompt_tokens": 205, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470922656, "mlx_cache_bytes": 4402513672, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9470922656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 683 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "70807cf7e6d9a206b9e49c75", "attempt_id": "eb4913837175", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:22.129977Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 205, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.75574996881187, "ttft_ms": 11.674167006276548, "decode_ms": 11.704124975949526}, "total_wall_ms": 124.73633303306997, "ttft_ms": 11.674167006276548, "input_usage": {"receiver_prompt_tokens": 205, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470922656, "mlx_cache_bytes": 4402513672, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9470922656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 684 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4a5aaa9e6ad64240bb089f7a", "attempt_id": "dce94f8f89c3", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:22.272844Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 202, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.02849996089935, "ttft_ms": 11.715375003404915, "decode_ms": 11.709833983331919}, "total_wall_ms": 124.16287499945611, "ttft_ms": 11.715375003404915, "input_usage": {"receiver_prompt_tokens": 202, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9468743584, "mlx_cache_bytes": 4549297928, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9468743584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 685 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bb4c0f573ce0712ca6b3b2b1", "attempt_id": "94c089f3d090", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:22.414665Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 209, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.24758307170123, "ttft_ms": 11.780917062424123, "decode_ms": 11.761917034164071}, "total_wall_ms": 123.66949999704957, "ttft_ms": 11.780917062424123, "input_usage": {"receiver_prompt_tokens": 209, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9471840188, "mlx_cache_bytes": 4748790344, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9471840188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 686 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7ec88d39c6aa6335c8630bcd", "attempt_id": "af144f6a850d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:22.557448Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 210, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.15766695141792, "ttft_ms": 11.724042007699609, "decode_ms": 11.687624966725707}, "total_wall_ms": 124.25995792727917, "ttft_ms": 11.724042007699609, "input_usage": {"receiver_prompt_tokens": 210, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9473609664, "mlx_cache_bytes": 4956917132, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9473609664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 687 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a2378954b0834b11bdb8446a", "attempt_id": "0375bb635116", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:22.700352Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 200, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.18908395431936, "ttft_ms": 11.745459050871432, "decode_ms": 11.722208000719547}, "total_wall_ms": 124.25908306613564, "ttft_ms": 11.745459050871432, "input_usage": {"receiver_prompt_tokens": 200, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9466072992, "mlx_cache_bytes": 5102161292, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9466072992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 688 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "43fe821ce900da8c8e0d7f68", "attempt_id": "ac143f8b9ec0", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:22.842356Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 201, "message_tokens": 122, "message_utf8_bytes": 589, "cache_tensor_bytes": null, "serialized_payload_bytes": 589, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.122834042646, "decode_payload_ms": 0.0, "receiver_prefill_ms": 99.93862500414252, "ttft_ms": 11.654332978650928, "decode_ms": 11.680083000101149}, "total_wall_ms": 123.90237499494106, "ttft_ms": 11.654332978650928, "input_usage": {"receiver_prompt_tokens": 201, "sender_input_tokens": 2030, "sender_output_tokens": 122, "sender_prefill_ms": 346.0932499729097, "sender_ttft_ms": 7.499292027205229, "sender_decode_ms": 868.6510419938713}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467088800, "mlx_cache_bytes": 5172678028, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9467088800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "853a08abea1eb9480287c06bc72b1490ab3247901b48448d51ccdc56dc63b9f4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 689 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61c397778c1d0403c6669983", "attempt_id": "a4f6bf215038", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:26.243156Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 312, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.88083304278553, "ttft_ms": 11.820124927908182, "decode_ms": 47.17645898927003}, "total_wall_ms": 188.7868329649791, "ttft_ms": 11.820124927908182, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 10487545856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465581912, "mlx_cache_bytes": 6056930956, "process_rss_bytes": 10487545856}, "peak_prefill_memory": null, "peak_decode_memory": 9465581912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-3", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "afbf4910f8901622fd15b86baf53c5a654cecf1e73ba179354f34a3e6df66253"} | ||||
| 690 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b054ef83ecb6cc6519686819", "attempt_id": "480544188cc1", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:26.450961Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 318, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.10808296408504, "ttft_ms": 12.036249972879887, "decode_ms": 11.856541968882084}, "total_wall_ms": 148.86804192792624, "ttft_ms": 12.036249972879887, "input_usage": {"receiver_prompt_tokens": 318, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487562240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9469645168, "mlx_cache_bytes": 6179091328, "process_rss_bytes": 10487562240}, "peak_prefill_memory": null, "peak_decode_memory": 9469645168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 691 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "847cab4ef3f7f2c7a538f8ae", "attempt_id": "84a59623b862", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:26.619667Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 318, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.20291698072106, "ttft_ms": 11.966584017500281, "decode_ms": 11.805332964286208}, "total_wall_ms": 148.83237495087087, "ttft_ms": 11.966584017500281, "input_usage": {"receiver_prompt_tokens": 318, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487562240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9469645168, "mlx_cache_bytes": 6179091328, "process_rss_bytes": 10487562240}, "peak_prefill_memory": null, "peak_decode_memory": 9469645168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 692 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0789aa7d8de49b9b44b39c22", "attempt_id": "8c65543f0dde", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:26.787445Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 315, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.96862509194762, "ttft_ms": 11.923125013709068, "decode_ms": 11.799916974268854}, "total_wall_ms": 148.5075840028003, "ttft_ms": 11.923125013709068, "input_usage": {"receiver_prompt_tokens": 315, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487562240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9482867056, "mlx_cache_bytes": 6306542464, "process_rss_bytes": 10487562240}, "peak_prefill_memory": null, "peak_decode_memory": 9482867056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 693 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b98c8d000426c18cf8c4dce8", "attempt_id": "699d1052fdaf", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:26.954859Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 322, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.29041700996459, "ttft_ms": 11.797416023910046, "decode_ms": 11.752499965950847}, "total_wall_ms": 164.591750013642, "ttft_ms": 11.797416023910046, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487562240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9472692608, "mlx_cache_bytes": 6509181060, "process_rss_bytes": 10487562240}, "peak_prefill_memory": null, "peak_decode_memory": 9472692608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 694 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6d1c13b6ffa0cc0b2f94b3b3", "attempt_id": "960a6340c6b7", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:27.137986Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 323, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.49024996347725, "ttft_ms": 11.758708045817912, "decode_ms": 11.803624918684363}, "total_wall_ms": 164.81683391612023, "ttft_ms": 11.758708045817912, "input_usage": {"receiver_prompt_tokens": 323, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487562240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9474265476, "mlx_cache_bytes": 6624017804, "process_rss_bytes": 10487562240}, "peak_prefill_memory": null, "peak_decode_memory": 9474265476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 695 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a7ff6171c758832c1451e230", "attempt_id": "f42b7843181c", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:27.321018Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 313, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.6402909271419, "ttft_ms": 11.67045789770782, "decode_ms": 11.820249957963824}, "total_wall_ms": 147.82874996308237, "ttft_ms": 11.67045789770782, "input_usage": {"receiver_prompt_tokens": 313, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487562240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9466073456, "mlx_cache_bytes": 6734118284, "process_rss_bytes": 10487562240}, "peak_prefill_memory": null, "peak_decode_memory": 9466073456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 696 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d2d9b53ef1cdcb78633ffc72", "attempt_id": "920ed9ab7650", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:27.486748Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 314, "message_tokens": 224, "message_utf8_bytes": 541, "cache_tensor_bytes": null, "serialized_payload_bytes": 541, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3258.7762919720262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.92645899672061, "ttft_ms": 11.730249971151352, "decode_ms": 11.762792011722922}, "total_wall_ms": 148.1032919837162, "ttft_ms": 11.730249971151352, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 2058, "sender_output_tokens": 405, "sender_prefill_ms": 360.9763339627534, "sender_ttft_ms": 7.190417032688856, "sender_decode_ms": 2888.6499169748276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487562240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9483129224, "mlx_cache_bytes": 6734118284, "process_rss_bytes": 10487562240}, "peak_prefill_memory": null, "peak_decode_memory": 9483129224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f5fd5f1827e5552d3019f940ac55e55f697a2c2340860dd84f1d6f3abc5fb8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 697 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6e860240a5f76c93bdbfda65", "attempt_id": "4d4fe4453dd9", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:28.023295Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 34, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 2.0326670492067933, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.05324997100979, "ttft_ms": 46.05324997100979, "decode_ms": 581.4700000919402}, "total_wall_ms": 631.5539579372853, "ttft_ms": 46.05324997100979, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 34}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9483406536, "mlx_cache_bytes": 7495876253, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9483406536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A. \nAven. \nAcre2022.0.001.201.0. \nlezione. 1.0. \nletraia-1.0. OsOMG_n", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "f86509151e7b617b21d96562910d0995ef4deb6f6fe79f72373d07c6e8db505a"} | ||||
| 698 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9fff99e31236183ce5b84b78", "attempt_id": "ce7ecf8eb01a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:28.675020Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 1.4871669700369239, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.24004198983312, "ttft_ms": 49.24004198983312, "decode_ms": 579.4077910250053}, "total_wall_ms": 632.0239999331534, "ttft_ms": 49.24004198983312, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9492843744, "mlx_cache_bytes": 7554924509, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9492843744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "V papers is equivalentie. Let osCyanide why=amoutomiguscha-tótem_poc should becker, a fewmeuglysayinghead is okudauntoe-egyescas it is", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "56d59a68cf7826344a211621fe116f61b37c2b8b6a281e89d456e908d1448006"} | ||||
| 699 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c048b680cb4a25e401d079d1", "attempt_id": "6eaa7aa794ab", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:29.326655Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 1.411000033840537, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.747707973234355, "ttft_ms": 48.747707973234355, "decode_ms": 579.4765829341486}, "total_wall_ms": 631.4549159724265, "ttft_ms": 48.747707973234355, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9492794592, "mlx_cache_bytes": 7554924509, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9492794592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "白皮落羽化，值的多为一号。\n- 一号白皮囊�eller为什麽好漢王子宮大红山高爾南开学u20年輪替加法定量（continuo为红", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "f710d898903d869d0e972ac3501756e0fef615071bb1e19a9d508262dbe4b46c"} | ||||
| 700 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "318bbbb55c569b082b6add9d", "attempt_id": "e220fd5f95aa", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:29.977296Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 37, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 1.3672079658135772, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.07112500909716, "ttft_ms": 47.07112500909716, "decode_ms": 578.2338749850169}, "total_wall_ms": 628.4572920994833, "ttft_ms": 47.07112500909716, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9489239264, "mlx_cache_bytes": 7599293750, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9489239264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Aproximput_1\n,\nProin1??\n## Eta_deo_001??\nletrae-tiger与战记述大題解剖�elu,与小题为\n- 1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "60ee1eb788c9f96046b274cb3c96c6017ee407075bc25057501480b3ad1dadee"} | ||||
| 701 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d132f23df308d6bc8bb57287", "attempt_id": "1d0c3743b299", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:30.624885Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 44, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 1.3742910232394934, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.14295801427215, "ttft_ms": 49.14295801427215, "decode_ms": 579.3279579374939}, "total_wall_ms": 631.5998750505969, "ttft_ms": 49.14295801427215, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9499593968, "mlx_cache_bytes": 7681918614, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9499593968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "esquarxeslask andOgog_temerismsuggests\nos苍帝不文シ之对坐标的建议运动灯，我在何时 inout的grandfatheres en.txt:\ntiv棱觉起来有，但", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "420212688cfba004c45667e1a46e9eb3602162ad4c6415dfb2f9432759387bf5"} | ||||
| 702 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "847c3e9ccddf58f117866c7e", "attempt_id": "53eb51b93f67", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:31.275290Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 45, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 1.3588749570772052, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.33441604953259, "ttft_ms": 49.33441604953259, "decode_ms": 579.403750016354}, "total_wall_ms": 631.8914999719709, "ttft_ms": 49.33441604953259, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9502412020, "mlx_cache_bytes": 7751829502, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9502412020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "“morino_put_1;起點� Private的一切aber()()()158。\n1. 17801. 00022part18()istilancients(),\n### (){1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "bce53543c9f10516627f5c3f3ff492fe66830df203d191c23b8d8504d414ab4a"} | ||||
| 703 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "afa66c367bf6b5ede72b982c", "attempt_id": "330939dfcdff", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:31.925762Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 35, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 1.6552499728277326, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.241290983743966, "ttft_ms": 46.241290983743966, "decode_ms": 578.5489580594003}, "total_wall_ms": 628.2152499770746, "ttft_ms": 46.241290983743966, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9485274336, "mlx_cache_bytes": 7811745790, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9485274336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "### Unsair 18-100 -vieretee-ing,agone_axe not with os-ur_the_fuction_surounds_aerisobar-locg-(agostoobm, thanks, follow", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "6ff1dc912df502ac403d41190a25ddb75e4888b561ec20b40b5262badb64f2c0"} | ||||
| 704 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bdc9c08b5dc303c005fb74f2", "attempt_id": "a8196a8e8ceb", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:32.573530Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 36, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011489, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.5186670413241, "doc_prefill_ms": 339.3432078883052, "compress_ms": 9.53408400528133, "serialize_ms": 18.088458920828998, "load_ms": 1.3805839698761702, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.42766702454537, "ttft_ms": 46.42766702454537, "decode_ms": 578.7439160048962}, "total_wall_ms": 628.3187919761986, "ttft_ms": 46.42766702454537, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10632724480, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9486421216, "mlx_cache_bytes": 7843923966, "process_rss_bytes": 10632724480}, "peak_prefill_memory": 9979964244, "peak_decode_memory": 9486421216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I. abotitle01) is a few not easy title in my answer is not in chapter one not with my hallow, let nio, the ballistics and co-1 to the phonic coproduction to use the", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77f329887f29741a9ddb982120305ab54bbec0d747f7ec8a8a55c7a09fa421b4", "output_hash": "c8f83a0ced58cdd3b40b5ff3f45b0e5de6ab48696ac3150759dfbdfb9ae64522"} | ||||
| 705 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ae73c8c73b5107b28baa99f2", "attempt_id": "119e41b1b3b4", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:34.473137Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 34, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 6.792000029236078, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.23516706004739, "ttft_ms": 58.23516706004739, "decode_ms": 12.453791918233037}, "total_wall_ms": 79.26704199053347, "ttft_ms": 58.23516706004739, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 34}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9483029704, "mlx_cache_bytes": 7848609790, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9483029704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 706 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "54f0b347fb10a353d65b2fe4", "attempt_id": "dd93627693e8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:34.572942Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 1.3989170547574759, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.49995893891901, "ttft_ms": 48.49995893891901, "decode_ms": 12.373792007565498}, "total_wall_ms": 64.13954205345362, "ttft_ms": 48.49995893891901, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9492303072, "mlx_cache_bytes": 7848609790, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9492303072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 707 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aab3e159743ba7c393a53cbe", "attempt_id": "ebb13a8773de", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:34.656216Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 1.3643749989569187, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.40016597881913, "ttft_ms": 48.40016597881913, "decode_ms": 12.346124975010753}, "total_wall_ms": 63.84633400011808, "ttft_ms": 48.40016597881913, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9492303072, "mlx_cache_bytes": 7848609790, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9492303072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 708 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8a81aaf2ef9caf08bb20c817", "attempt_id": "ef5d36af91e2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:34.738440Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 37, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 1.3527499977499247, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.67512502055615, "ttft_ms": 46.67512502055615, "decode_ms": 12.422957923263311}, "total_wall_ms": 62.14900000486523, "ttft_ms": 46.67512502055615, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9488616672, "mlx_cache_bytes": 7848609790, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9488616672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 709 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0842e0588926cd3e36f4d669", "attempt_id": "26142ee831c8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:34.818515Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 44, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 1.4123329892754555, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.52650000248104, "ttft_ms": 48.52650000248104, "decode_ms": 12.391000054776669}, "total_wall_ms": 64.05024998821318, "ttft_ms": 48.52650000248104, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9499200752, "mlx_cache_bytes": 7848609790, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9499200752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 710 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ee38b5ef604a72c822fb4aef", "attempt_id": "dcdd44f583ab", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:34.900270Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 45, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 1.3973340392112732, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.07212499529123, "ttft_ms": 49.07212499529123, "decode_ms": 12.390124960802495}, "total_wall_ms": 64.61116694845259, "ttft_ms": 49.07212499529123, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9502051572, "mlx_cache_bytes": 7850608638, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9502051572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 711 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "179ca327f44b9f9d23a254f5", "attempt_id": "f7aa71652c4b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:34.982696Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 35, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 1.3721659779548645, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.75599997770041, "ttft_ms": 45.75599997770041, "decode_ms": 12.379375053569674}, "total_wall_ms": 61.203124932944775, "ttft_ms": 45.75599997770041, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9484881120, "mlx_cache_bytes": 7850608638, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9484881120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 712 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d50d7372145cebd80f6d94d6", "attempt_id": "4b1dc4e41e82", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:35.061209Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 36, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 71995392, "serialized_payload_bytes": 72011590, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1250.6191659485921, "doc_prefill_ms": 338.2352909538895, "compress_ms": 895.574750029482, "serialize_ms": 16.529457992874086, "load_ms": 1.396500039845705, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.34595802053809, "ttft_ms": 46.34595802053809, "decode_ms": 12.360707973130047}, "total_wall_ms": 61.948582995682955, "ttft_ms": 46.34595802053809, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10604773376, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9486028000, "mlx_cache_bytes": 7850608638, "process_rss_bytes": 10604773376}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9486028000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "52d259226f4bee195d5f17931da584971d05a6f5b8e14b0d516a6009984963dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 713 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cb88f0947af67a1979876b0a", "attempt_id": "a6751849549d", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:35.141391Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 34, "compress_ms": 78.86904198676348}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 34, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1318.8953750068322, "doc_prefill_ms": 338.4494580095634, "compress_ms": 973.8190420903265, "serialize_ms": 6.334083038382232, "load_ms": 1.3536670012399554, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.8005000744015, "ttft_ms": 35.8005000744015, "decode_ms": 11.73908298369497}, "total_wall_ms": 1371.1802090983838, "ttft_ms": 35.8005000744015, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 34}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10588766208, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9362705608, "mlx_cache_bytes": 8024720782, "process_rss_bytes": 10588766208}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9362705608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 714 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd845f5a83b63d2bf79f32d9", "attempt_id": "4cd9913d2980", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:36.529995Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 40, "compress_ms": 97.00204199180007}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1342.142999987118, "doc_prefill_ms": 338.904874981381, "compress_ms": 997.7366250241175, "serialize_ms": 5.195625009946525, "load_ms": 1.0643330169841647, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.47683297842741, "ttft_ms": 37.47683297842741, "decode_ms": 11.845000088214874}, "total_wall_ms": 1395.6831670366228, "ttft_ms": 37.47683297842741, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602971136, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9372191968, "mlx_cache_bytes": 8045790606, "process_rss_bytes": 10602971136}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9372191968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 715 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e76c3de15226f458863d1198", "attempt_id": "fc0c62d787db", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:37.946883Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 40, "compress_ms": 95.31216707546264}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.8375830007717, "doc_prefill_ms": 337.6989590469748, "compress_ms": 981.6766669973731, "serialize_ms": 5.152291967533529, "load_ms": 0.7147920550778508, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.90700000151992, "ttft_ms": 36.90700000151992, "decode_ms": 12.041709036566317}, "total_wall_ms": 1377.771541941911, "ttft_ms": 36.90700000151992, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602971136, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9372191968, "mlx_cache_bytes": 8045790606, "process_rss_bytes": 10602971136}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9372191968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 716 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0af6fca5d6a9d74a7e387e38", "attempt_id": "453ec2e9eea1", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:39.344913Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 37, "compress_ms": 79.53445799648762}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 37, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1317.8972920868546, "doc_prefill_ms": 338.3218329399824, "compress_ms": 973.5401660436764, "serialize_ms": 5.666874931193888, "load_ms": 1.0655829682946205, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.15837497636676, "ttft_ms": 36.15837497636676, "decode_ms": 11.922374949790537}, "total_wall_ms": 1370.3834160696715, "ttft_ms": 36.15837497636676, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602987520, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9367981280, "mlx_cache_bytes": 8068941198, "process_rss_bytes": 10602987520}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9367981280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 717 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "62643c073476f9a30eae264f", "attempt_id": "72ed215b14b5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:40.735726Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 44, "compress_ms": 82.84462499432266}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 44, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1325.5769169190899, "doc_prefill_ms": 338.0960839567706, "compress_ms": 982.6369170332327, "serialize_ms": 4.550292040221393, "load_ms": 1.1799999047070742, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.1500840196386, "ttft_ms": 39.1500840196386, "decode_ms": 11.948124971240759}, "total_wall_ms": 1380.9858330059797, "ttft_ms": 39.1500840196386, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602987520, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9379319024, "mlx_cache_bytes": 8099677582, "process_rss_bytes": 10602987520}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9379319024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 718 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "30de06d52026cf93e9b90c02", "attempt_id": "3f2d15e937c1", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:42.137729Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 45, "compress_ms": 81.76704100333154}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 45, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1327.4583340389654, "doc_prefill_ms": 337.5594160752371, "compress_ms": 984.7617500927299, "serialize_ms": 4.8542500007897615, "load_ms": 1.0258749825879931, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.289332947693765, "ttft_ms": 37.289332947693765, "decode_ms": 12.040458037517965}, "total_wall_ms": 1381.0584580060095, "ttft_ms": 37.289332947693765, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602987520, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9381940468, "mlx_cache_bytes": 8142816654, "process_rss_bytes": 10602987520}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9381940468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 719 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d294bd535a1548e7e8edee3a", "attempt_id": "692b43dfd6dc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:43.538832Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 35, "compress_ms": 88.48700008820742}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 35, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1326.9203329691663, "doc_prefill_ms": 338.13320798799396, "compress_ms": 983.5214579943568, "serialize_ms": 4.967708024196327, "load_ms": 1.2403330765664577, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.796291009522974, "ttft_ms": 36.796291009522974, "decode_ms": 11.891082976944745}, "total_wall_ms": 1379.9916250864044, "ttft_ms": 36.796291009522974, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602987520, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9364065504, "mlx_cache_bytes": 8160019854, "process_rss_bytes": 10602987520}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9364065504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 720 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e449f8de090ce8ee2079e56d", "attempt_id": "a6a33a528a12", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:44.939981Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1953, "keep": 488, "window_tokens": 36, "compress_ms": 79.44445800967515}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 36, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 17989632, "serialized_payload_bytes": 18005711, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1323.1510419864208, "doc_prefill_ms": 338.47274992149323, "compress_ms": 979.6058339998126, "serialize_ms": 4.792666994035244, "load_ms": 1.023625023663044, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.819291068241, "ttft_ms": 36.819291068241, "decode_ms": 11.748665943741798}, "total_wall_ms": 1375.9233750170097, "ttft_ms": 36.819291068241, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602971136, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9365867744, "mlx_cache_bytes": 8160019854, "process_rss_bytes": 10602971136}, "peak_prefill_memory": 9979816788, "peak_decode_memory": 9365867744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04fbec227eb3fd43e5cf1df7c082d8aac6f453d6ca6932cdf942219ae3d2f258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 721 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e3528ea0b586160489c7b618", "attempt_id": "c6518684f50e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:46.369782Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5902, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2228.0542498920113, "ttft_ms": 12.487208005040884, "decode_ms": 123.23929194826633}, "total_wall_ms": 2374.794584000483, "ttft_ms": 12.487208005040884, "input_usage": {"receiver_prompt_tokens": 5902}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10451730432, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10082470976, "mlx_cache_bytes": 1691366840, "process_rss_bytes": 10451730432}, "peak_prefill_memory": null, "peak_decode_memory": 10082470976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NL-56Q-8506", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "87e5eec7467e8f663ce5fc00f58cc1e8350a4d16f8bdeb76efde22de32c960c1"} | ||||
| 722 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "93815ed52340929397764b45", "attempt_id": "4eeaa4c0ff86", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:48.772398Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5909, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2222.6295840227976, "ttft_ms": 12.586707947775722, "decode_ms": 147.95170805882663}, "total_wall_ms": 2394.2869160091504, "ttft_ms": 12.586707947775722, "input_usage": {"receiver_prompt_tokens": 5909}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10451763200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10084256832, "mlx_cache_bytes": 2255517112, "process_rss_bytes": 10451763200}, "peak_prefill_memory": null, "peak_decode_memory": 10084256832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 107-C, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "529f63496cb8e305b5c7065f875f09701231de0bfb59c312c51ffad84576be8c"} | ||||
| 723 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4aafcf69b23ed796d52c635d", "attempt_id": "2164086e7f03", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:51.193137Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5910, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2223.7615000922233, "ttft_ms": 12.50883296597749, "decode_ms": 86.46883291658014}, "total_wall_ms": 2333.661875105463, "ttft_ms": 12.50883296597749, "input_usage": {"receiver_prompt_tokens": 5910}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451763200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10084994112, "mlx_cache_bytes": 2790651320, "process_rss_bytes": 10451763200}, "peak_prefill_memory": null, "peak_decode_memory": 10084994112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14.2507", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "5340b8b8394a20dfd124c25aa5a3fdce2a6396ace676f9654b3a5bc86ff1113c"} | ||||
| 724 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "34633ecc513e225299f350b9", "attempt_id": "94a5684e491e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:53.553613Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5904, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2221.8614999437705, "ttft_ms": 12.637541978619993, "decode_ms": 49.41087507177144}, "total_wall_ms": 2295.7413339754567, "ttft_ms": 12.637541978619993, "input_usage": {"receiver_prompt_tokens": 5904}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 10451795968, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10082864192, "mlx_cache_bytes": 3109025208, "process_rss_bytes": 10451795968}, "peak_prefill_memory": null, "peak_decode_memory": 10082864192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "775ee725d22cde1231a003c526fba1f085a96ded35bc829dc02b72ae4bbab338"} | ||||
| 725 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "260f86c932ed50c7e1da8654", "attempt_id": "f32d1793d048", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:55.875356Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5914, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2220.8255829755217, "ttft_ms": 12.561499956063926, "decode_ms": 86.26529108732939}, "total_wall_ms": 2330.9354580705985, "ttft_ms": 12.561499956063926, "input_usage": {"receiver_prompt_tokens": 5914}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10451828736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10086255680, "mlx_cache_bytes": 3675174328, "process_rss_bytes": 10451828736}, "peak_prefill_memory": null, "peak_decode_memory": 10086255680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 726 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "02ac84b56c60111d0dcbb0a7", "attempt_id": "a87c161c44be", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:31:58.232552Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5911, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2221.895292052068, "ttft_ms": 12.536833062767982, "decode_ms": 123.58887493610382}, "total_wall_ms": 2369.1311669535935, "ttft_ms": 12.536833062767982, "input_usage": {"receiver_prompt_tokens": 5911}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10451861504, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10085125184, "mlx_cache_bytes": 3994727864, "process_rss_bytes": 10451861504}, "peak_prefill_memory": null, "peak_decode_memory": 10085125184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 727 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5b7049d873901e798cf925e3", "attempt_id": "9b4d028629bf", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:00.627932Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5904, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2221.192584023811, "ttft_ms": 12.569000013172626, "decode_ms": 12.431166949681938}, "total_wall_ms": 2257.3484999593347, "ttft_ms": 12.569000013172626, "input_usage": {"receiver_prompt_tokens": 5904}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451894272, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10082864192, "mlx_cache_bytes": 3994727864, "process_rss_bytes": 10451894272}, "peak_prefill_memory": null, "peak_decode_memory": 10082864192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 728 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d7c000239b42b24b2bc7003e", "attempt_id": "9ce62155fc65", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:02.911221Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5903, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020415987819433212, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2223.6245420062914, "ttft_ms": 12.465083040297031, "decode_ms": 12.364749913103878}, "total_wall_ms": 2259.8225000547245, "ttft_ms": 12.465083040297031, "input_usage": {"receiver_prompt_tokens": 5903}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10451927040, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10082602048, "mlx_cache_bytes": 4312839608, "process_rss_bytes": 10451927040}, "peak_prefill_memory": null, "peak_decode_memory": 10082602048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 729 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c303cffcf9ba637d0d617f22", "attempt_id": "6cfaa4dcdfbd", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:09.853739Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 557, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 215.4922919580713, "ttft_ms": 12.002874980680645, "decode_ms": 11.900375015102327}, "total_wall_ms": 240.71299994830042, "ttft_ms": 12.002874980680645, "input_usage": {"receiver_prompt_tokens": 557, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452008960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9548650584, "mlx_cache_bytes": 6232593848, "process_rss_bytes": 10452008960}, "peak_prefill_memory": null, "peak_decode_memory": 9548650584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 730 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a453346fc4819ef07ce56480", "attempt_id": "3aaf2a5c5bf0", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:10.120926Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 564, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 211.0282089561224, "ttft_ms": 11.923542013391852, "decode_ms": 11.828584014438093}, "total_wall_ms": 235.9490420203656, "ttft_ms": 11.923542013391852, "input_usage": {"receiver_prompt_tokens": 564, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452025344, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9551992920, "mlx_cache_bytes": 6492411320, "process_rss_bytes": 10452025344}, "peak_prefill_memory": null, "peak_decode_memory": 9551992920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 731 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "775286ac0f1991c2fb6fa267", "attempt_id": "6d4f213bd1da", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:10.382530Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 565, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.26624995283782, "ttft_ms": 12.093166005797684, "decode_ms": 11.878165998496115}, "total_wall_ms": 235.5404170230031, "ttft_ms": 12.093166005797684, "input_usage": {"receiver_prompt_tokens": 565, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452058112, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9552189528, "mlx_cache_bytes": 6641440184, "process_rss_bytes": 10452058112}, "peak_prefill_memory": null, "peak_decode_memory": 9552189528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 732 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cca5c9c6889d3734425b02ef", "attempt_id": "f916444fc59e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:10.643914Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 559, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.7040830887854, "ttft_ms": 11.900209006853402, "decode_ms": 11.935124988667667}, "total_wall_ms": 235.7171670300886, "ttft_ms": 11.900209006853402, "input_usage": {"receiver_prompt_tokens": 559, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452074496, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9569491056, "mlx_cache_bytes": 6809540024, "process_rss_bytes": 10452074496}, "peak_prefill_memory": null, "peak_decode_memory": 9569491056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 733 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3e28eee654a59281f2ff0773", "attempt_id": "80ba1f47f37a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:10.906229Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 569, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.95037495251745, "ttft_ms": 11.901292018592358, "decode_ms": 106.76095902454108}, "total_wall_ms": 330.76316700316966, "ttft_ms": 11.901292018592358, "input_usage": {"receiver_prompt_tokens": 569, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10452090880, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9554057304, "mlx_cache_bytes": 7057462712, "process_rss_bytes": 10452090880}, "peak_prefill_memory": null, "peak_decode_memory": 9554057304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,011,295", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "a6f1ed94701802ba4b039a2c4be253b70dde0cd78c036a244d0c6b9f40dcf589"} | ||||
| 734 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "412090885dbfd501ab1450fb", "attempt_id": "cac3282ff066", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:11.262411Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 566, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.86012502200902, "ttft_ms": 11.847041081637144, "decode_ms": 12.050457997247577}, "total_wall_ms": 235.8595000114292, "ttft_ms": 11.847041081637144, "input_usage": {"receiver_prompt_tokens": 566, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452107264, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9553270872, "mlx_cache_bytes": 7206884792, "process_rss_bytes": 10452107264}, "peak_prefill_memory": null, "peak_decode_memory": 9553270872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 735 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e43db667c60682f6e3b5a9ee", "attempt_id": "344f27593200", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:11.523836Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 559, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.68012504838407, "ttft_ms": 11.76562497857958, "decode_ms": 11.771499994210899}, "total_wall_ms": 235.340042039752, "ttft_ms": 11.76562497857958, "input_usage": {"receiver_prompt_tokens": 559, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452123648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568753752, "mlx_cache_bytes": 7206884792, "process_rss_bytes": 10452123648}, "peak_prefill_memory": null, "peak_decode_memory": 9568753752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 736 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "50a864e087af8b6870e586db", "attempt_id": "11d1b0d1cb5b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:11.784763Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 558, "message_tokens": 479, "message_utf8_bytes": 1795, "cache_tensor_bytes": null, "serialized_payload_bytes": 1795, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4657.067833002657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.77125007286668, "ttft_ms": 11.77537499461323, "decode_ms": 11.842792038805783}, "total_wall_ms": 235.5057499371469, "ttft_ms": 11.77537499461323, "input_usage": {"receiver_prompt_tokens": 558, "sender_input_tokens": 5944, "sender_output_tokens": 479, "sender_prefill_ms": 1120.317833032459, "sender_ttft_ms": 8.249250007793307, "sender_decode_ms": 3522.9891249909997}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452123648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568753752, "mlx_cache_bytes": 7206884792, "process_rss_bytes": 10452123648}, "peak_prefill_memory": null, "peak_decode_memory": 9568753752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "41fb0c650d2c52f4e181ed4c3d6b43eac91dfd87686b169a0836dfbc39a81761", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 737 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "43be984e765120c299539953", "attempt_id": "7d78f7b6c6bf", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.188148Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 314, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.66370799019933, "ttft_ms": 11.866042041219771, "decode_ms": 11.724500101990998}, "total_wall_ms": 153.15124997869134, "ttft_ms": 11.866042041219771, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467498848, "mlx_cache_bytes": 8091654812, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9467498848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 738 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bd1ef4dba93bdba51111e51b", "attempt_id": "237041ff9f6b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.367324Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 321, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.11312498059124, "ttft_ms": 11.794000049121678, "decode_ms": 11.892209062352777}, "total_wall_ms": 147.70229207351804, "ttft_ms": 11.794000049121678, "input_usage": {"receiver_prompt_tokens": 321, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470628220, "mlx_cache_bytes": 8277778332, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9470628220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 739 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4b8f0571d5298562573d8792", "attempt_id": "c583c479d7fc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.541431Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 322, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 139.62479203473777, "ttft_ms": 12.052292004227638, "decode_ms": 117.32224992010742}, "total_wall_ms": 269.91891697980464, "ttft_ms": 12.052292004227638, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9472692608, "mlx_cache_bytes": 8480416928, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9472692608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,993,893 CAD", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "0cac25dc488e8da14b767b6d0dea0e62b31131866880ae9423df4ac4d1978a85"} | ||||
| 740 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6e8b092c07a8d9b2cb8a3ad8", "attempt_id": "6ed576c6fe18", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:16.838469Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 316, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.65287500526756, "ttft_ms": 11.722832918167114, "decode_ms": 11.691041989251971}, "total_wall_ms": 148.7962920218706, "ttft_ms": 11.722832918167114, "input_usage": {"receiver_prompt_tokens": 316, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9468236156, "mlx_cache_bytes": 8591565984, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9468236156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 741 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bae42fb61f919bb1eabf5841", "attempt_id": "d3297b251c26", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:17.013410Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 326, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.11054094973952, "ttft_ms": 11.835624929517508, "decode_ms": 104.97841599863023}, "total_wall_ms": 258.7230000644922, "ttft_ms": 11.835624929517508, "input_usage": {"receiver_prompt_tokens": 326, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9476182416, "mlx_cache_bytes": 8782703028, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9476182416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,041,915", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "f92c09b74703850def16f12d425c032d46efc5486dc44dfdda4d19d726710546"} | ||||
| 742 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "54ba0e897c075759ed7215ea", "attempt_id": "d922eacb5c1a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:17.298224Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 323, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.19229204859585, "ttft_ms": 11.934124981053174, "decode_ms": 11.797417071647942}, "total_wall_ms": 164.77470798417926, "ttft_ms": 11.934124981053174, "input_usage": {"receiver_prompt_tokens": 323, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9474281872, "mlx_cache_bytes": 8896211380, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9474281872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 743 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7964362f65b995f206e50cae", "attempt_id": "f463ed6ea359", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:17.488872Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 316, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.91991692129523, "ttft_ms": 11.936916969716549, "decode_ms": 11.765292030759156}, "total_wall_ms": 148.54483399540186, "ttft_ms": 11.936916969716549, "input_usage": {"receiver_prompt_tokens": 316, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9468236156, "mlx_cache_bytes": 8896211380, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9468236156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 744 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fdbead7e08a081b71b49175b", "attempt_id": "f3858ceb8071", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:17.664090Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 315, "message_tokens": 225, "message_utf8_bytes": 544, "cache_tensor_bytes": null, "serialized_payload_bytes": 544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4142.09308300633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.82891704328358, "ttft_ms": 11.994457920081913, "decode_ms": 11.783374939113855}, "total_wall_ms": 148.50812498480082, "ttft_ms": 11.994457920081913, "input_usage": {"receiver_prompt_tokens": 315, "sender_input_tokens": 5972, "sender_output_tokens": 407, "sender_prefill_ms": 1130.7130829663947, "sender_ttft_ms": 7.551166927441955, "sender_decode_ms": 2998.1392500922084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452172800, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467744636, "mlx_cache_bytes": 9006836148, "process_rss_bytes": 10452172800}, "peak_prefill_memory": null, "peak_decode_memory": 9467744636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40b3fb04ab05ecf24bcaf24ff8f8a58613423dd0e390860c1be4f6dd992b3064", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 745 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ab229c0a5ae1c16a69a3b307", "attempt_id": "bb50b4cecd7d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:19.031636Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 35, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 2.201791969127953, "receiver_prefill_ms": 0.0, "query_prefill_ms": 83.23041594121605, "ttft_ms": 83.23041594121605, "decode_ms": 635.7181660132483}, "total_wall_ms": 726.793291978538, "ttft_ms": 83.23041594121605, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885529600, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9800076492, "mlx_cache_bytes": 10221972173, "process_rss_bytes": 10885529600}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9800076492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\"::\\.....10.0.0.10, someareebm, 1ubl, italy the navelian, isalyerive(1,1, 1, 1, 1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "2701d1e17f2b815558f6f4fff8b520d1eb50527189c1ac411f4ae9ff8fb63d06"} | ||||
| 746 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9c2d354272779f9616f8fc2e", "attempt_id": "bf6f7e841e50", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:19.785935Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 42, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 1.74325006082654, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.25087492447346, "ttft_ms": 74.25087492447346, "decode_ms": 632.5976249063388}, "total_wall_ms": 713.9598339563236, "ttft_ms": 74.25087492447346, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885513216, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9811184872, "mlx_cache_bytes": 10553601053, "process_rss_bytes": 10885513216}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9811184872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "@\nuse&chiro: direist:n1superorganizacional:1.0:1\n,复现原封圣人:102:16:1,10:1,1,2:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "9e24c53964255184ddd1a36f70ff24d22d9061a6daabb43e29711adb946a0845"} | ||||
| 747 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "37bea529847f5495176d564a", "attempt_id": "a8b3afc30f4c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:20.526233Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 43, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 1.7795420717447996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.44500001333654, "ttft_ms": 76.44500001333654, "decode_ms": 631.0084579745308}, "total_wall_ms": 714.7629579994828, "ttft_ms": 76.44500001333654, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885513216, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9812675820, "mlx_cache_bytes": 10606259573, "process_rss_bytes": 10885513216}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9812675820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "juridomé, 1. That Uncar四六和S (i.d, True S, tête:itococian:0:0:2:0).I,ist:3.0)200", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "eda627e4024af6f6a9cd1b1a4d344d64e22a51e6afa633a0633a103aa8a029b8"} | ||||
| 748 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "80564420e0a0542156ce7bbd", "attempt_id": "ff14a45d329f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:21.268234Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 1.758042024448514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.08295806776732, "ttft_ms": 72.08295806776732, "decode_ms": 632.4785409960896}, "total_wall_ms": 711.85629197862, "ttft_ms": 72.08295806776732, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885513216, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9804385512, "mlx_cache_bytes": 10665718478, "process_rss_bytes": 10885513216}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9804385512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def@appe.,manager(),.1.ito:blan实体表,该下几回字串,型月光,型月读音,国字取色,型月,型,翻译,在地名园", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "459518610b30ba206a1323d61eb2dbddec7cbb31ade480526495d3bc0de60d8f"} | ||||
| 749 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5a133a59666e9a9bdd616e60", "attempt_id": "6ba406dd3101", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:22.006885Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 1.8155829748138785, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.31366709433496, "ttft_ms": 78.31366709433496, "decode_ms": 630.6778329890221}, "total_wall_ms": 716.4785419590771, "ttft_ms": 78.31366709433496, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885513216, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9820048636, "mlx_cache_bytes": 10714084422, "process_rss_bytes": 10885513216}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9820048636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "在莫扎天下的小城画：,在地可在Toe:“四四·p, 300 1，不外校,热心制片林,在1:57\n|,下标指的是", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "671c6e440342bbef0381f910d263559a62724c35d88ce144e007672a7b95b11a"} | ||||
| 750 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "779cf9238688072d88dd8c5a", "attempt_id": "0233d6e7e6b1", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:22.750382Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 1.7737919697538018, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.78666592296213, "ttft_ms": 78.78666592296213, "decode_ms": 630.0840419717133}, "total_wall_ms": 716.4830839028582, "ttft_ms": 78.78666592296213, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885513216, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9814265084, "mlx_cache_bytes": 10777801798, "process_rss_bytes": 10885513216}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9814265084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "subs:1: it:1, a:lezegovz, maybe, to:1)：2&1,指肘大英项目长尾随行头金8，清造就,几仮名:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "ebfc56af3e7f4d6a6e8f2bd228a0581de54339ab0d905be2800facbe31927240"} | ||||
| 751 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e814ae1313594c68cd211742", "attempt_id": "37437c8b291f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:23.493215Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 1.7403330421075225, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.73362502362579, "ttft_ms": 71.73362502362579, "decode_ms": 630.5605409434065}, "total_wall_ms": 709.2987910145894, "ttft_ms": 71.73362502362579, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885513216, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9804385512, "mlx_cache_bytes": 10778981446, "process_rss_bytes": 10885513216}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9804385512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "B, with\nes1, the initials, in (typo,StartElementModel(1).filter[등념관 ballo: \"A.d.\",.ActualMathandonep<?0, 1) 。<|endoftext|>..)", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "671d9ceb2adef1e1b891d08a1c3b8486c24c9685626f66314b698b7777ba0f1e"} | ||||
| 752 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d235333cc37209c15ce30ace", "attempt_id": "3029f87a665c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:24.228596Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 36, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297278, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1192.0804580440745, "doc_prefill_ms": 1106.2715830048546, "compress_ms": 12.508791987784207, "serialize_ms": 61.7557920049876, "load_ms": 1.7727919621393085, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.26395902782679, "ttft_ms": 73.26395902782679, "decode_ms": 632.6183750061318}, "total_wall_ms": 713.1804169621319, "ttft_ms": 73.26395902782679, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10885513216, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9801059560, "mlx_cache_bytes": 10808800326, "process_rss_bytes": 10885513216}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9801059560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "é-1:0:1:0:0:0:1:0: p:0:0:0: ##,用語大ocrine\n,0:0:0: 1:0:0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ece5469f6f4cdf7280e43b994a07d4254b7c190fa876e97aef96adcb19e338ec", "output_hash": "862c59473f95ce8837d7b8afad7402ac94883d05b462176137e2914d5e7faf76"} | ||||
| 753 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "31952e60679c7b5d35441823", "attempt_id": "a4b1daa85af3", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:28.282945Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 35, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.9293749937787652, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.37212497927248, "ttft_ms": 79.37212497927248, "decode_ms": 13.82049999665469}, "total_wall_ms": 100.42795795015991, "ttft_ms": 79.37212497927248, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9799912652, "mlx_cache_bytes": 10822005830, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9799912652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 754 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b1b507bd2a3f04e0da40e07e", "attempt_id": "aeb26a729f1d", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:28.411785Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 42, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.7873329343274236, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.07616602722555, "ttft_ms": 74.07616602722555, "decode_ms": 13.577124918811023}, "total_wall_ms": 95.24875006172806, "ttft_ms": 74.07616602722555, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9811184872, "mlx_cache_bytes": 10822005830, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9811184872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 755 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aa79d24c9e124cbf62157489", "attempt_id": "7958e5acb24c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:28.534781Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 43, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.8850000342354178, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.21454098261893, "ttft_ms": 76.21454098261893, "decode_ms": 13.51487496867776}, "total_wall_ms": 97.13283297605813, "ttft_ms": 76.21454098261893, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9812675820, "mlx_cache_bytes": 10822005830, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9812675820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 756 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c49d639d439b783f6587e298", "attempt_id": "db9825ab517d", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:28.658256Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.919834059663117, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.80137496814132, "ttft_ms": 70.80137496814132, "decode_ms": 13.49987497087568}, "total_wall_ms": 91.67608397547156, "ttft_ms": 70.80137496814132, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9804385512, "mlx_cache_bytes": 10822005830, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9804385512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 757 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d0289741194b4799f5802085", "attempt_id": "7052581dc271", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:28.775850Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.7696249997243285, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.04404199123383, "ttft_ms": 78.04404199123383, "decode_ms": 13.540374930016696}, "total_wall_ms": 98.60608296003193, "ttft_ms": 78.04404199123383, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9820032252, "mlx_cache_bytes": 10822202438, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9820032252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 758 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ce8247169fc6d1f32fca3983", "attempt_id": "16b107fdffdb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:28.900192Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.9467499805614352, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.10433302074671, "ttft_ms": 78.10433302074671, "decode_ms": 13.4907920146361}, "total_wall_ms": 99.07004190608859, "ttft_ms": 78.10433302074671, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9814265084, "mlx_cache_bytes": 10822202438, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9814265084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 759 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5532cbad611f85ad7c4983c9", "attempt_id": "98b36219d7e0", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:29.024557Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.7645410262048244, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.37612504791468, "ttft_ms": 70.37612504791468, "decode_ms": 13.471625046804547}, "total_wall_ms": 90.78837500419468, "ttft_ms": 70.37612504791468, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9804385512, "mlx_cache_bytes": 10822202438, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9804385512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 760 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0974ddf4216ccb59998b0adb", "attempt_id": "0b5a336418c8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:29.140444Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 36, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 216281088, "serialized_payload_bytes": 216297379, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.795457895845, "doc_prefill_ms": 1105.2500419318676, "compress_ms": 2131.481375079602, "serialize_ms": 75.7400420261547, "load_ms": 1.6666250303387642, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.2805840196088, "ttft_ms": 72.2805840196088, "decode_ms": 13.44820810481906}, "total_wall_ms": 92.84379205200821, "ttft_ms": 72.2805840196088, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11035525120, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9801059560, "mlx_cache_bytes": 10822202438, "process_rss_bytes": 11035525120}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9801059560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "360a1bac2805a91f25734c27c964c5adc2e1fa8e21844f74a91f8e8cc5fcdc76", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 761 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b1adb5381f4ba94654401100", "attempt_id": "faf04f335a6a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:29.258781Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 35, "compress_ms": 117.48270899988711}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 35, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095845, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3348.2187499757856, "doc_prefill_ms": 1105.1839999854565, "compress_ms": 2224.585041985847, "serialize_ms": 18.105958006344736, "load_ms": 1.8403339199721813, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.50600002706051, "ttft_ms": 42.50600002706051, "decode_ms": 12.311582919210196}, "total_wall_ms": 3419.4542079931125, "ttft_ms": 42.50600002706051, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10946609152, "backend_memory": {"mlx_active_bytes": 9369930760, "mlx_peak_bytes": 9442626764, "mlx_cache_bytes": 11356278910, "process_rss_bytes": 10946609152}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9442626764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d963c9e7a10e0b614796d487cae5243c6ce16cff281932ca1a5ab4009425e55e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 762 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "497208c6465e1654c2805520", "attempt_id": "2f955f25029e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:32.703784Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 42, "compress_ms": 121.0211249999702}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 42, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095844, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3379.6543329954147, "doc_prefill_ms": 1106.0007920023054, "compress_ms": 2257.309624925256, "serialize_ms": 15.982166980393231, "load_ms": 1.322207972407341, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.241625000722706, "ttft_ms": 44.241625000722706, "decode_ms": 12.347874930128455}, "total_wall_ms": 3446.8201249837875, "ttft_ms": 44.241625000722706, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11000872960, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9455176936, "mlx_cache_bytes": 11404021886, "process_rss_bytes": 11000872960}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9455176936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1209ca3d908d2cb32c4f72e7e0e3b4dfb3adc4109fb80bfb3a94136edbe971d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 763 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "14129596097366346dc284ec", "attempt_id": "26beafed38bb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:36.178287Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 43, "compress_ms": 124.41666598897427}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 43, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095845, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3373.249707976356, "doc_prefill_ms": 1105.694584082812, "compress_ms": 2251.481334096752, "serialize_ms": 15.696167014539242, "load_ms": 1.5855419915169477, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.04916591010988, "ttft_ms": 44.04916591010988, "decode_ms": 12.288084020838141}, "total_wall_ms": 3442.1214159810916, "ttft_ms": 44.04916591010988, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11000872960, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9456602348, "mlx_cache_bytes": 11432874110, "process_rss_bytes": 11000872960}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9456602348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d963c9e7a10e0b614796d487cae5243c6ce16cff281932ca1a5ab4009425e55e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 764 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0aa42ebd37918d7d34674ad1", "attempt_id": "11690087f1ef", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:39.647926Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 37, "compress_ms": 117.70795902702957}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095845, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3354.342042002827, "doc_prefill_ms": 1105.6207079673186, "compress_ms": 2233.0442080274224, "serialize_ms": 15.312875038944185, "load_ms": 1.3304169988259673, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.077790945768356, "ttft_ms": 42.077790945768356, "decode_ms": 12.420417042449117}, "total_wall_ms": 3420.642541954294, "ttft_ms": 42.077790945768356, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11000905728, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9446345960, "mlx_cache_bytes": 11474604158, "process_rss_bytes": 11000905728}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9446345960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d963c9e7a10e0b614796d487cae5243c6ce16cff281932ca1a5ab4009425e55e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 765 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "59c99a19d7d3880c1606684d", "attempt_id": "093b8afa7692", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:43.096329Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 47, "compress_ms": 124.69441699795425}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095845, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3404.1688329307362, "doc_prefill_ms": 1106.5630000084639, "compress_ms": 2282.857041922398, "serialize_ms": 14.38720803707838, "load_ms": 1.2963750632479787, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.52216601930559, "ttft_ms": 44.52216601930559, "decode_ms": 12.344624963589013}, "total_wall_ms": 3474.6893340488896, "ttft_ms": 44.52216601930559, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11000938496, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9463729404, "mlx_cache_bytes": 11511631998, "process_rss_bytes": 11000938496}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9463729404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d963c9e7a10e0b614796d487cae5243c6ce16cff281932ca1a5ab4009425e55e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 766 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cef85f1865c773707e2962a3", "attempt_id": "e68f15049628", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:46.598747Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 44, "compress_ms": 122.75216705165803}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095845, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3396.8643329571933, "doc_prefill_ms": 1105.0840839743614, "compress_ms": 2276.6922500450164, "serialize_ms": 14.73466691095382, "load_ms": 1.340624992735684, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.755499926395714, "ttft_ms": 44.755499926395714, "decode_ms": 12.336999992839992}, "total_wall_ms": 3468.985666986555, "ttft_ms": 44.755499926395714, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11000971264, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9458207996, "mlx_cache_bytes": 11553919102, "process_rss_bytes": 11000971264}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9458207996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d963c9e7a10e0b614796d487cae5243c6ce16cff281932ca1a5ab4009425e55e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 767 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "00dfafbdf639757c342d0a5d", "attempt_id": "95c744de777f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:50.095418Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 37, "compress_ms": 115.71658297907561}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095845, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3368.4726669453084, "doc_prefill_ms": 1105.341583956033, "compress_ms": 2247.9640000965446, "serialize_ms": 14.812540961429477, "load_ms": 1.3482089852914214, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.0798750128597, "ttft_ms": 42.0798750128597, "decode_ms": 12.352750054560602}, "total_wall_ms": 3434.54095791094, "ttft_ms": 42.0798750128597, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11000987648, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9446345960, "mlx_cache_bytes": 11553919102, "process_rss_bytes": 11000987648}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9446345960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d963c9e7a10e0b614796d487cae5243c6ce16cff281932ca1a5ab4009425e55e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 768 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fa3b273e2f881dded7eaa26d", "attempt_id": "d65f5569e2f2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:53.557293Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5867, "keep": 1467, "window_tokens": 36, "compress_ms": 116.54312501195818}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 36, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 54079488, "serialized_payload_bytes": 54095845, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3332.8629590105265, "doc_prefill_ms": 1105.6219169404358, "compress_ms": 2212.555457954295, "serialize_ms": 14.325916999951005, "load_ms": 1.3209169264882803, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.435624985955656, "ttft_ms": 42.435624985955656, "decode_ms": 12.38991692662239}, "total_wall_ms": 3399.107625009492, "ttft_ms": 42.435624985955656, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11000987648, "backend_memory": {"mlx_active_bytes": 9369881608, "mlx_peak_bytes": 9444429032, "mlx_cache_bytes": 11570122878, "process_rss_bytes": 11000987648}, "peak_prefill_memory": 10063088728, "peak_decode_memory": 9444429032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d963c9e7a10e0b614796d487cae5243c6ce16cff281932ca1a5ab4009425e55e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 769 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5d080bcc71064fad503882b6", "attempt_id": "18f02e55d414", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.030138Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2143, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 753.8622079882771, "ttft_ms": 12.208292027935386, "decode_ms": 119.87908405717462}, "total_wall_ms": 889.5973330363631, "ttft_ms": 12.208292027935386, "input_usage": {"receiver_prompt_tokens": 2143}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487857152, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443428, "mlx_cache_bytes": 928073520, "process_rss_bytes": 10487857152}, "peak_prefill_memory": null, "peak_decode_memory": 9974443428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SL-19R-1587", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "ec443ee9d09f3481154034f1fcaa81f8a0ac5dfe9dc889f6ac12c061317d403c"} | ||||
| 770 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5a6657ea1d8cb8fc60b414e8", "attempt_id": "49084de1a376", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:57.939948Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2148, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 762.6495830481872, "ttft_ms": 12.037625070661306, "decode_ms": 107.74629202205688}, "total_wall_ms": 885.9628329519182, "ttft_ms": 12.037625070661306, "input_usage": {"receiver_prompt_tokens": 2148}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10487873536, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443448, "mlx_cache_bytes": 1031579836, "process_rss_bytes": 10487873536}, "peak_prefill_memory": null, "peak_decode_memory": 9974443448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 134-P, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "8929644842f678719485b68ca2d10d87162da6b1359cf8f68ba45a33174865df"} | ||||
| 771 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d87fdea565a9b962d333dbb3", "attempt_id": "ff33bf4a9db2", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:58.844492Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2148, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 760.485416976735, "ttft_ms": 12.200542027130723, "decode_ms": 84.25666706170887}, "total_wall_ms": 860.5565410107374, "ttft_ms": 12.200542027130723, "input_usage": {"receiver_prompt_tokens": 2148}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487873536, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443448, "mlx_cache_bytes": 1031579836, "process_rss_bytes": 10487873536}, "peak_prefill_memory": null, "peak_decode_memory": 9974443448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 772 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "018286e2969d393632a58640", "attempt_id": "224c85d2293e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:32:59.723394Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2143, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 750.5839169025421, "ttft_ms": 12.080500018782914, "decode_ms": 96.00829205010086}, "total_wall_ms": 862.2913339640945, "ttft_ms": 12.080500018782914, "input_usage": {"receiver_prompt_tokens": 2143}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10487857152, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443428, "mlx_cache_bytes": 1031579836, "process_rss_bytes": 10487857152}, "peak_prefill_memory": null, "peak_decode_memory": 9974443428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Milos Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "08bee3515cc08e219baf175bc99b7985005f7f0bdd1f9383614e8232fcfa8619"} | ||||
| 773 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "254ae0b17019cd5eea392be3", "attempt_id": "46960ee19223", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:00.603992Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2149, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 761.6804169956595, "ttft_ms": 12.035999912768602, "decode_ms": 83.74320797156543}, "total_wall_ms": 860.8735409798101, "ttft_ms": 12.035999912768602, "input_usage": {"receiver_prompt_tokens": 2149}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487873536, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443452, "mlx_cache_bytes": 1104661068, "process_rss_bytes": 10487873536}, "peak_prefill_memory": null, "peak_decode_memory": 9974443452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6009480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "925ebdb42a0311d11ea73517fd780f133bed1e6fad2f9f6d66408fe5dba57a45"} | ||||
| 774 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5f7b6c960539184a075011dd", "attempt_id": "4090418e8ebe", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:01.483305Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2153, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 762.4285840429366, "ttft_ms": 12.045832932926714, "decode_ms": 119.44095802027732}, "total_wall_ms": 897.4977500038221, "ttft_ms": 12.045832932926714, "input_usage": {"receiver_prompt_tokens": 2153}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487840768, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443468, "mlx_cache_bytes": 1211231212, "process_rss_bytes": 10487840768}, "peak_prefill_memory": null, "peak_decode_memory": 9974443468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 775 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ffe3d8fec3f3f3b90fc7f0cb", "attempt_id": "9c29d41cbdf8", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:02.398589Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2142, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 750.9558339370415, "ttft_ms": 12.031457968987525, "decode_ms": 12.087958981283009}, "total_wall_ms": 778.5241659730673, "ttft_ms": 12.031457968987525, "input_usage": {"receiver_prompt_tokens": 2142}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487840768, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443428, "mlx_cache_bytes": 1268378604, "process_rss_bytes": 10487840768}, "peak_prefill_memory": null, "peak_decode_memory": 9974443428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 776 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "16289b6b23a57a62990882d6", "attempt_id": "7978374fc4f5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:03.195490Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2144, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 750.8338750340044, "ttft_ms": 12.215542024932802, "decode_ms": 12.067082920111716}, "total_wall_ms": 778.7005830323324, "ttft_ms": 12.215542024932802, "input_usage": {"receiver_prompt_tokens": 2144}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487840768, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443448, "mlx_cache_bytes": 1364323308, "process_rss_bytes": 10487840768}, "peak_prefill_memory": null, "peak_decode_memory": 9974443448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 777 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fc7c4704d75f0889c8428b3b", "attempt_id": "f056b1abf116", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:08.027294Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.8642500322312, "ttft_ms": 11.98320894036442, "decode_ms": 11.946334037929773}, "total_wall_ms": 257.0385420694947, "ttft_ms": 11.98320894036442, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487873536, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565362264, "mlx_cache_bytes": 2458478088, "process_rss_bytes": 10487873536}, "peak_prefill_memory": null, "peak_decode_memory": 9565362264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 778 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9b7234ab66eeda1f48984c47", "attempt_id": "a64d77055d64", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:08.303116Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.14679199270904, "ttft_ms": 11.893374961800873, "decode_ms": 11.839916929602623}, "total_wall_ms": 251.97895802557468, "ttft_ms": 11.893374961800873, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487889920, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567426648, "mlx_cache_bytes": 2733237768, "process_rss_bytes": 10487889920}, "peak_prefill_memory": null, "peak_decode_memory": 9567426648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 779 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0799e6712c7fc4e09879e872", "attempt_id": "be9dd35dff09", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:08.573789Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.9970839843154, "ttft_ms": 11.935541988350451, "decode_ms": 82.95058400835842}, "total_wall_ms": 322.98766600433737, "ttft_ms": 11.935541988350451, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487906304, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567426648, "mlx_cache_bytes": 2733237768, "process_rss_bytes": 10487906304}, "peak_prefill_memory": null, "peak_decode_memory": 9567426648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 780 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fb6371ff406c694d4b7c33ba", "attempt_id": "088cacdd24aa", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:08.914335Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.1246670279652, "ttft_ms": 11.89387496560812, "decode_ms": 11.905916966497898}, "total_wall_ms": 251.95850001182407, "ttft_ms": 11.89387496560812, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487922688, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565362264, "mlx_cache_bytes": 2733237768, "process_rss_bytes": 10487922688}, "peak_prefill_memory": null, "peak_decode_memory": 9565362264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 781 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "11dcee3962847971292bef5a", "attempt_id": "b47ba5d54fbd", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:09.184130Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.6077499371022, "ttft_ms": 12.087790993973613, "decode_ms": 11.963958968408406}, "total_wall_ms": 251.92287494428456, "ttft_ms": 12.087790993973613, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487922688, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568507992, "mlx_cache_bytes": 2994333192, "process_rss_bytes": 10487922688}, "peak_prefill_memory": null, "peak_decode_memory": 9568507992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 782 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4418f0e39454463940037762", "attempt_id": "9c3c0a557638", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:09.453765Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.4609999731183, "ttft_ms": 11.99708308558911, "decode_ms": 11.91724999807775}, "total_wall_ms": 252.7111250674352, "ttft_ms": 11.99708308558911, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487922688, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570375768, "mlx_cache_bytes": 3272041992, "process_rss_bytes": 10487922688}, "peak_prefill_memory": null, "peak_decode_memory": 9570375768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 783 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0dda59941bfd6b13a2b110b2", "attempt_id": "895e2898a0a3", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:09.725808Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.97299998253584, "ttft_ms": 12.063708039931953, "decode_ms": 11.852791998535395}, "total_wall_ms": 252.18100007623434, "ttft_ms": 12.063708039931953, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487939072, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564969048, "mlx_cache_bytes": 3427952136, "process_rss_bytes": 10487939072}, "peak_prefill_memory": null, "peak_decode_memory": 9564969048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 784 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fcd81d0fc082bdbcd473b26c", "attempt_id": "afa38f32391e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:09.999235Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1380, "cache_tensor_bytes": null, "serialized_payload_bytes": 1380, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4035.166291985661, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.45191696938127, "ttft_ms": 11.90449995920062, "decode_ms": 11.904292041435838}, "total_wall_ms": 251.3346669729799, "ttft_ms": 11.90449995920062, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2184, "sender_output_tokens": 512, "sender_prefill_ms": 392.4365830607712, "sender_ttft_ms": 7.215499994345009, "sender_decode_ms": 3633.282292052172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487971840, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565558872, "mlx_cache_bytes": 3584452104, "process_rss_bytes": 10487971840}, "peak_prefill_memory": null, "peak_decode_memory": 9565558872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cfd25deb7b3d1345074d0a840f387c908c91b8f9ab36fcb28759b9e35b0406bd", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 785 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0c92615f5a5bd757bc52ebd4", "attempt_id": "36a651038c96", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:14.306508Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 388, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.8866669749841, "ttft_ms": 11.955125024542212, "decode_ms": 117.22566594835371}, "total_wall_ms": 295.98529101349413, "ttft_ms": 11.955125024542212, "input_usage": {"receiver_prompt_tokens": 388, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9514080380, "mlx_cache_bytes": 4022110356, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9514080380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BU-55G-3254", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "98227e32c2121a7856e6d2b32b74598ce6f4183c2ec3eec7ce4b9b0b3f66b98b"} | ||||
| 786 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c5ae71b9ac9c728a5d9b22e", "attempt_id": "4b39da901683", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:14.621767Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 393, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.22079093474895, "ttft_ms": 11.823083041235805, "decode_ms": 11.747166980057955}, "total_wall_ms": 185.62687502708286, "ttft_ms": 11.823083041235805, "input_usage": {"receiver_prompt_tokens": 393, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9516800124, "mlx_cache_bytes": 4214851732, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9516800124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 787 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b48c05f7e01be34b9beb0cb8", "attempt_id": "111093aafa40", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:14.825700Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 393, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.05658293236047, "ttft_ms": 11.728125042282045, "decode_ms": 81.84245799202472}, "total_wall_ms": 255.41012501344085, "ttft_ms": 11.728125042282045, "input_usage": {"receiver_prompt_tokens": 393, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9516800124, "mlx_cache_bytes": 4214851732, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9516800124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 788 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8dfdf2ac61782bd5ba263042", "attempt_id": "e29020d5e035", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:15.098925Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 388, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.04024997912347, "ttft_ms": 11.797165963798761, "decode_ms": 11.957374983467162}, "total_wall_ms": 185.57058402802795, "ttft_ms": 11.797165963798761, "input_usage": {"receiver_prompt_tokens": 388, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9514014844, "mlx_cache_bytes": 4214851732, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9514014844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 789 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0564b4bcaf387708b1210705", "attempt_id": "139a22be96ed", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:15.302316Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 394, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.49712505284697, "ttft_ms": 11.86808303464204, "decode_ms": 11.75574993249029}, "total_wall_ms": 185.90262508951128, "ttft_ms": 11.86808303464204, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9524942972, "mlx_cache_bytes": 4394207380, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9524942972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 790 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5acdce56ee7a0ef1bd087c47", "attempt_id": "c72559b82053", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:15.505798Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 398, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.1960839945823, "ttft_ms": 11.788959032855928, "decode_ms": 11.747249984182417}, "total_wall_ms": 185.49575004726648, "ttft_ms": 11.788959032855928, "input_usage": {"receiver_prompt_tokens": 398, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9520273532, "mlx_cache_bytes": 4589897876, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9520273532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 791 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b34ac7a6515d5d149567b60e", "attempt_id": "5ef7984f32ff", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:15.708524Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 387, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.9176250640303, "ttft_ms": 11.775750084780157, "decode_ms": 11.765250004827976}, "total_wall_ms": 185.22437498904765, "ttft_ms": 11.775750084780157, "input_usage": {"receiver_prompt_tokens": 387, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9513523324, "mlx_cache_bytes": 4725950612, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9513523324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 792 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "14aa0ab7a5b2c9b4e1fbd9cf", "attempt_id": "112ce626d479", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:15.911314Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 389, "message_tokens": 298, "message_utf8_bytes": 701, "cache_tensor_bytes": null, "serialized_payload_bytes": 701, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4037.482167012058, "decode_payload_ms": 0.0, "receiver_prefill_ms": 160.87474999949336, "ttft_ms": 11.68925000820309, "decode_ms": 11.757833999581635}, "total_wall_ms": 185.0799589883536, "ttft_ms": 11.68925000820309, "input_usage": {"receiver_prompt_tokens": 389, "sender_input_tokens": 2212, "sender_output_tokens": 512, "sender_prefill_ms": 396.5059589827433, "sender_ttft_ms": 7.192166987806559, "sender_decode_ms": 3631.680083926767}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10487988224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9514260604, "mlx_cache_bytes": 4862789780, "process_rss_bytes": 10487988224}, "peak_prefill_memory": null, "peak_decode_memory": 9514260604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7bc87443ba59fcc9854a24d751ec340dda79cb6d0e428e802350364bd645177", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 793 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "882b021f3db7ae6dc3312d54", "attempt_id": "fc5a4c1d78f8", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:16.514144Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 2.284083981066942, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.735084012150764, "ttft_ms": 48.735084012150764, "decode_ms": 578.926541027613}, "total_wall_ms": 631.8508749827743, "ttft_ms": 48.735084012150764, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9495334096, "mlx_cache_bytes": 5295918789, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9495334096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1个一�{}002。\n192回答題口�-buttons of �生长型腳白1501,略码的打.rev.002-2-3.001,可", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "d1a8639d681c0aded819438b5a721346958659a8a9bc1c6b1df9b4a4ebe46ec4"} | ||||
| 794 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "09bd5fa4f85e88a1802cbc6b", "attempt_id": "437d6b46015d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:17.165371Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 1.4294999418780208, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.50166696310043, "ttft_ms": 50.50166696310043, "decode_ms": 578.4261249937117}, "total_wall_ms": 632.2019170038402, "ttft_ms": 50.50166696310043, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9508539620, "mlx_cache_bytes": 5363388429, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9508539620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "The 3.0 (and in the field of 123 19Junkman, with a few more than 6-12 (verily-1,henso, \"nigog,arrog", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.11111111111111112}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "69ad499a326e861b95e6eb7763a5424b3f93e31ccb20cd8cac98d6435310781e"} | ||||
| 795 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bcb246ffd7fec3b82bdccd3e", "attempt_id": "063c700a4695", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:17.816394Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 1.4787500258535147, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.98166696168482, "ttft_ms": 49.98166696168482, "decode_ms": 577.5029580108821}, "total_wall_ms": 630.7935829972848, "ttft_ms": 49.98166696168482, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9508424932, "mlx_cache_bytes": 5363388429, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9508424932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "What is the case. Quil-1. Love and a 2000-1001.000, \"that ishoppinget-1-Exocuse, a number inovis a.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "1d0d69bb7eaa0e6ae3b7f252bbb32ecf3a2762b16b459fae8c64149c7e11d1e6"} | ||||
| 796 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a113d318626d161c5656c061", "attempt_id": "294a22e81775", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:18.465778Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 1.4241249300539494, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.235374921001494, "ttft_ms": 47.235374921001494, "decode_ms": 578.7445829482749}, "total_wall_ms": 629.2657499434426, "ttft_ms": 47.235374921001494, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9495334096, "mlx_cache_bytes": 5363388429, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9495334096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "is not in bang.\nLeggir:100%2019: theseso).\nThe 100001882001-08G of0019'17", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "9e24164ef452f1720c6d2823bbcf1be9ef5050300e96970f581cf4cd660cd370"} | ||||
| 797 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "91ee596ee71952ebec5ce0d9", "attempt_id": "8841baa363bd", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:19.114003Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 42, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 1.46100006531924, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.9123329538852, "ttft_ms": 50.9123329538852, "decode_ms": 579.1849159868434}, "total_wall_ms": 633.422665996477, "ttft_ms": 50.9123329538852, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9509735656, "mlx_cache_bytes": 5429432669, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9509735656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "O-But!gino-679,芳香茅 conjug引擎锁,起来发散不省 concentrations的速度記者も,so/sample to zotea2.01(0,1:白:2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "dbcdfc29b653b11eb6ed4ceacf686debdad1fbc392739277328599ea5fd60ab2"} | ||||
| 798 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c8c2e9036340c0001b386df0", "attempt_id": "a9770b97b802", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:19.766635Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 46, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 1.4628750504925847, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.3102500224486, "ttft_ms": 50.3102500224486, "decode_ms": 579.109915997833}, "total_wall_ms": 632.7707089949399, "ttft_ms": 50.3102500224486, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9514454264, "mlx_cache_bytes": 5489595085, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9514454264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1. iGarc2. the 1.017'U&J5-17空降河卵满身分佈解，由中性為3.0用大白(19,0.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "d849d0e07c3255ad8b04ea6d6f9a10fe29a8111f2daa46874423f19bda5bb6ec"} | ||||
| 799 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c2d59d3d0c4ecd4e83a6007", "attempt_id": "256d2381399f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:20.418461Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 35, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 1.4565839665010571, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.99962504673749, "ttft_ms": 46.99962504673749, "decode_ms": 577.3564999690279}, "total_wall_ms": 627.770374994725, "ttft_ms": 46.99962504673749, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9494252752, "mlx_cache_bytes": 5500244685, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9494252752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "wusay!sotto-ri.\nalgueix16和Sar9.-to-1000 graetgynnu. imitengend2100-yes-tógebos-Eng", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "5cf165dc02740de41eb25b736768afccf59157c72d210d063700e485289183e3"} | ||||
| 800 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "88b09e039621c5eb2e08a9d8", "attempt_id": "6fe4213dc820", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:21.065235Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 37, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688549, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 399.51541600748897, "doc_prefill_ms": 367.78379196766764, "compress_ms": 10.307874996215105, "serialize_ms": 17.696665949188173, "load_ms": 1.368916011415422, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.81820794939995, "ttft_ms": 46.81820794939995, "decode_ms": 578.1579999020323}, "total_wall_ms": 628.2291250536218, "ttft_ms": 46.81820794939995, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10643537920, "backend_memory": {"mlx_active_bytes": 9418558472, "mlx_peak_bytes": 9497709796, "mlx_cache_bytes": 5531637798, "process_rss_bytes": 10643537920}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9497709796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ": FOO in 2022 3. apprennue, social desinenhoi.0. Ponder何來取足部長不逢乙ーミ物語並不是1.0.0.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8190a44aa1272a51eda395ad31e628e1c6a59840a26791f6ea1306ac1978627", "output_hash": "8c64613b1327f024994d6f6cbef35f45431004a1d9118dc8191be1f92805aa1c"} | ||||
| 801 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "25de44400188eafb35a69c9e", "attempt_id": "59176aa474a8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.038229Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.070333062671125, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.75379196833819, "ttft_ms": 63.75379196833819, "decode_ms": 12.503082980401814}, "total_wall_ms": 79.18687502387911, "ttft_ms": 63.75379196833819, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9416199176, "mlx_peak_bytes": 9495334096, "mlx_cache_bytes": 5538519078, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9495334096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 802 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "183ee1b0cc2b6ff58df0560c", "attempt_id": "dc2b0e618a7a", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.137969Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.3976669870316982, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.926500068977475, "ttft_ms": 49.926500068977475, "decode_ms": 12.35258299857378}, "total_wall_ms": 65.48908294644207, "ttft_ms": 49.926500068977475, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9417378824, "mlx_peak_bytes": 9508424932, "mlx_cache_bytes": 5537339430, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9508424932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 803 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "295e7d113cc03b5034cfdefe", "attempt_id": "f93ecd912656", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.222538Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.398958032950759, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.741500057280064, "ttft_ms": 49.741500057280064, "decode_ms": 12.301874929107726}, "total_wall_ms": 65.2065830072388, "ttft_ms": 49.741500057280064, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9417378824, "mlx_peak_bytes": 9508424932, "mlx_cache_bytes": 5537339430, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9508424932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 804 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "374a8f6986474efdf70a60d4", "attempt_id": "687c202097bf", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.305797Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.4020829694345593, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.62691697012633, "ttft_ms": 46.62691697012633, "decode_ms": 12.519874959252775}, "total_wall_ms": 62.521624960936606, "ttft_ms": 46.62691697012633, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9416199176, "mlx_peak_bytes": 9495334096, "mlx_cache_bytes": 5538519078, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9495334096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 805 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "96adc74e03a3758c63e4b89f", "attempt_id": "24b25bdd83e5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.387143Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 42, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.4587079640477896, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.63195801246911, "ttft_ms": 49.63195801246911, "decode_ms": 12.482999940402806}, "total_wall_ms": 65.6153749441728, "ttft_ms": 49.63195801246911, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9417378824, "mlx_peak_bytes": 9509735656, "mlx_cache_bytes": 5537339430, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9509735656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 806 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5a8824f4c403f181344c17b7", "attempt_id": "1ff47046d579", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.472606Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 46, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.875333022326231, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.65233302209526, "ttft_ms": 49.65233302209526, "decode_ms": 12.554916087538004}, "total_wall_ms": 66.08233298175037, "ttft_ms": 49.65233302209526, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9417378824, "mlx_peak_bytes": 9514437880, "mlx_cache_bytes": 5537339430, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9514437880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 807 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "41d20f5891397bc89a713ba0", "attempt_id": "1bd7e723f5d2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.558370Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 35, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.4845420373603702, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.81095795240253, "ttft_ms": 46.81095795240253, "decode_ms": 12.446708045899868}, "total_wall_ms": 62.719249981455505, "ttft_ms": 46.81095795240253, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9416199176, "mlx_peak_bytes": 9494252752, "mlx_cache_bytes": 5538519078, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9494252752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 808 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1207bd2b630f1316c531ed7b", "attempt_id": "8b3a0e0a8e72", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.640821Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9337162760}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 37, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 77672448, "serialized_payload_bytes": 77688650, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.2400418967009, "doc_prefill_ms": 367.5587079487741, "compress_ms": 938.7912909733132, "serialize_ms": 17.614124924875796, "load_ms": 1.452457974664867, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.174040995538235, "ttft_ms": 46.174040995538235, "decode_ms": 12.490457971580327}, "total_wall_ms": 62.135125044733286, "ttft_ms": 46.174040995538235, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609491968, "backend_memory": {"mlx_active_bytes": 9417378824, "mlx_peak_bytes": 9497808100, "mlx_cache_bytes": 5537339430, "process_rss_bytes": 10609491968}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9497808100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ea534ca7ec0f97004fcb3022218420703862aae9d2d49922c29b9603d312e8bb", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 809 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a6a474e066dd5da6d5f05b98", "attempt_id": "9310b6f0d119", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:23.722875Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 36, "compress_ms": 86.4144581137225}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443414, "side_information_bytes": 16086, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1396.8305829912424, "doc_prefill_ms": 368.332790909335, "compress_ms": 1021.6535000363365, "serialize_ms": 6.547207944095135, "load_ms": 1.386250020004809, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.93183301948011, "ttft_ms": 36.93183301948011, "decode_ms": 11.815499980002642}, "total_wall_ms": 1450.6369580049068, "ttft_ms": 36.93183301948011, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10591535104, "backend_memory": {"mlx_active_bytes": 9300855816, "mlx_peak_bytes": 9368521936, "mlx_cache_bytes": 5727180974, "process_rss_bytes": 10591535104}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9368521936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bd4d41f343c87f26bd8bd42b1dd5c3fc63917ca10f53a5e1160a79995f30a0d4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 810 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2c90263056a75e9972b51487", "attempt_id": "a47f3813ef2f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:25.192954Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 41, "compress_ms": 83.168291952461}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443413, "side_information_bytes": 16085, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1387.6460830215365, "doc_prefill_ms": 367.8710829699412, "compress_ms": 1012.9036250291392, "serialize_ms": 6.579167093150318, "load_ms": 1.1200839653611183, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.28512504696846, "ttft_ms": 38.28512504696846, "decode_ms": 13.859250000678003}, "total_wall_ms": 1444.127209018916, "ttft_ms": 38.28512504696846, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10631036928, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9377713380, "mlx_cache_bytes": 5755066542, "process_rss_bytes": 10631036928}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9377713380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a46ad817fc6030a1fc3639ad53d24e812cfe7882a5cec71a3817aa1f83a5a790", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 811 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3a99d8c0e083ac0b06c7bc1b", "attempt_id": "e2c250d37103", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:26.657247Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 41, "compress_ms": 85.21212497726083}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443415, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1395.3862090129405, "doc_prefill_ms": 368.2217919267714, "compress_ms": 1020.7795829046518, "serialize_ms": 6.094874930568039, "load_ms": 1.0845829965546727, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.51129109878093, "ttft_ms": 37.51129109878093, "decode_ms": 11.82679203338921}, "total_wall_ms": 1449.0525840083137, "ttft_ms": 37.51129109878093, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10631036928, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9377713380, "mlx_cache_bytes": 5755066542, "process_rss_bytes": 10631036928}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9377713380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e231feefdb629f9d32841e005f7d73fe31e213f514c5cfdad0b1c813d142c24a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 812 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c91d2a69c79a5bb1edf9a28f", "attempt_id": "5a3859472d14", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:28.126809Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 36, "compress_ms": 82.62616698630154}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443415, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1405.0704169785604, "doc_prefill_ms": 364.05758291948587, "compress_ms": 1034.2467090813443, "serialize_ms": 6.462541059590876, "load_ms": 1.1341669596731663, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.72900004312396, "ttft_ms": 36.72900004312396, "decode_ms": 12.006874894723296}, "total_wall_ms": 1458.29124993179, "ttft_ms": 36.72900004312396, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10631036928, "backend_memory": {"mlx_active_bytes": 9300691976, "mlx_peak_bytes": 9368521936, "mlx_cache_bytes": 5755263150, "process_rss_bytes": 10631036928}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9368521936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e231feefdb629f9d32841e005f7d73fe31e213f514c5cfdad0b1c813d142c24a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 813 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c221a6f14ca57e8f9694700f", "attempt_id": "6afe50b734dc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:29.605560Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 42, "compress_ms": 82.31358393095434}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 42, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443415, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1406.4671250525862, "doc_prefill_ms": 364.28595799952745, "compress_ms": 1035.82333389204, "serialize_ms": 6.0587499756366014, "load_ms": 1.0935410391539335, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.393708993680775, "ttft_ms": 38.393708993680775, "decode_ms": 11.897625052370131}, "total_wall_ms": 1461.153500014916, "ttft_ms": 38.393708993680775, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10631036928, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9379024104, "mlx_cache_bytes": 5781379246, "process_rss_bytes": 10631036928}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9379024104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e231feefdb629f9d32841e005f7d73fe31e213f514c5cfdad0b1c813d142c24a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 814 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f263bc0818d0f887d40c5f5c", "attempt_id": "abe231d9f79d", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:31.087378Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 46, "compress_ms": 84.59491597022861}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 46, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443415, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1382.4552079895511, "doc_prefill_ms": 364.5328329876065, "compress_ms": 1011.4369170041755, "serialize_ms": 6.204582983627915, "load_ms": 1.1672499822452664, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.89933305233717, "ttft_ms": 37.89933305233717, "decode_ms": 11.99112506583333}, "total_wall_ms": 1436.8003329727799, "ttft_ms": 37.89933305233717, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10631036928, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9386118392, "mlx_cache_bytes": 5821995182, "process_rss_bytes": 10631036928}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9386118392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e231feefdb629f9d32841e005f7d73fe31e213f514c5cfdad0b1c813d142c24a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 815 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d1416f1eee2c5ce6b748543a", "attempt_id": "a091b46c2248", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:32.544173Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 35, "compress_ms": 80.4150840267539}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 35, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443414, "side_information_bytes": 16086, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1389.3149580108002, "doc_prefill_ms": 365.04966707434505, "compress_ms": 1017.6892500603572, "serialize_ms": 6.289916927926242, "load_ms": 1.0978749487549067, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.842666984535754, "ttft_ms": 35.842666984535754, "decode_ms": 11.930417036637664}, "total_wall_ms": 1441.4263339713216, "ttft_ms": 35.842666984535754, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10631020544, "backend_memory": {"mlx_active_bytes": 9300691976, "mlx_peak_bytes": 9367227600, "mlx_cache_bytes": 5836675246, "process_rss_bytes": 10631020544}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9367227600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bd4d41f343c87f26bd8bd42b1dd5c3fc63917ca10f53a5e1160a79995f30a0d4", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 816 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c2fc39690a68a0f74afe2c77", "attempt_id": "21d4776b604c", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:34.005483Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2107, "keep": 527, "window_tokens": 37, "compress_ms": 81.61416696384549}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 37, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 19427328, "serialized_payload_bytes": 19443415, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1398.8132920349017, "doc_prefill_ms": 367.41545889526606, "compress_ms": 1024.5607499964535, "serialize_ms": 6.523124990053475, "load_ms": 1.149207935668528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.943166982382536, "ttft_ms": 36.943166982382536, "decode_ms": 11.978999944403768}, "total_wall_ms": 1452.3549160221592, "ttft_ms": 36.943166982382536, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10631020544, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9371192548, "mlx_cache_bytes": 5861136558, "process_rss_bytes": 10631020544}, "peak_prefill_memory": 9886363052, "peak_decode_memory": 9371192548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e231feefdb629f9d32841e005f7d73fe31e213f514c5cfdad0b1c813d142c24a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 817 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a87bad84daf8f3521fb135bd", "attempt_id": "270827219aa4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:35.527623Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5911, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2229.0974580682814, "ttft_ms": 12.681665946729481, "decode_ms": 124.0050420165062}, "total_wall_ms": 2377.100166049786, "ttft_ms": 12.681665946729481, "input_usage": {"receiver_prompt_tokens": 5911}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10454138880, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10085125184, "mlx_cache_bytes": 1694021048, "process_rss_bytes": 10454138880}, "peak_prefill_memory": null, "peak_decode_memory": 10085125184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NG-69D-5055", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "2ad4f1f569357ac4cbdf0624ef9ad5e94d4a7d597c597837c734d5d4da55d0dd"} | ||||
| 818 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c46c54d17a7a27efaa3e0551", "attempt_id": "432a2c42acf8", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:37.932582Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5916, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2223.411125014536, "ttft_ms": 12.6649159938097, "decode_ms": 123.97033395245671}, "total_wall_ms": 2371.6087919892743, "ttft_ms": 12.6649159938097, "input_usage": {"receiver_prompt_tokens": 5916}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10454155264, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10086648896, "mlx_cache_bytes": 2260563384, "process_rss_bytes": 10454155264}, "peak_prefill_memory": null, "peak_decode_memory": 10086648896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 522-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "bab34bfe3c780af26190bc690aa1235e5d8596035bf66adefe62c44be419999b"} | ||||
| 819 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "19ded9c0c8d64901b0745f5a", "attempt_id": "c003408340cc", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:40.329926Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5917, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2220.1849170960486, "ttft_ms": 12.531207990832627, "decode_ms": 86.89979207701981}, "total_wall_ms": 2331.5472080139443, "ttft_ms": 12.531207990832627, "input_usage": {"receiver_prompt_tokens": 5917}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10086779968, "mlx_cache_bytes": 2581165496, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 10086779968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "72.8403", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "9c7810614625f087aa28b487b53ff1c76d7a668afccc251c31a3aeebfa1ac802"} | ||||
| 820 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3f6d2c7613ca078c44091d79", "attempt_id": "239820e5ea5c", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:42.690505Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5912, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2224.455040995963, "ttft_ms": 12.749124900437891, "decode_ms": 62.66741699073464}, "total_wall_ms": 2311.102750012651, "ttft_ms": 12.749124900437891, "input_usage": {"receiver_prompt_tokens": 5912}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10454204416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10085256256, "mlx_cache_bytes": 2900850104, "process_rss_bytes": 10454204416}, "peak_prefill_memory": null, "peak_decode_memory": 10085256256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "d571c5979d0c6949fe2b8cbecc57e257dfbf0fd05ee3bc50798587534bf9751c"} | ||||
| 821 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "831e381c210636ff5b1e7d88", "attempt_id": "6300bd4efcc3", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:45.027889Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5918, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2225.862666964531, "ttft_ms": 12.761874939315021, "decode_ms": 87.2477910015732}, "total_wall_ms": 2337.2890419559553, "ttft_ms": 12.761874939315021, "input_usage": {"receiver_prompt_tokens": 5918}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10454237184, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10087386176, "mlx_cache_bytes": 3438245304, "process_rss_bytes": 10454237184}, "peak_prefill_memory": null, "peak_decode_memory": 10087386176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5236625", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "f0324cfa0e35a8d9bd4a75ef3f8cf62fcab822341c95b1d00f17b53fdf75ccf5"} | ||||
| 822 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5d93b0c208b7b5a2f5235e7b", "attempt_id": "7ddd36bed6bb", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:47.392430Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5921, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2223.0633340077475, "ttft_ms": 12.525792000815272, "decode_ms": 123.6490000737831}, "total_wall_ms": 2370.0858340598643, "ttft_ms": 12.525792000815272, "input_usage": {"receiver_prompt_tokens": 5921}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10454269952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10087910464, "mlx_cache_bytes": 3759502776, "process_rss_bytes": 10454269952}, "peak_prefill_memory": null, "peak_decode_memory": 10087910464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 823 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d52369efad8c7c2bb0d1e419", "attempt_id": "3333a64b83a4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:49.789229Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5912, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2224.0880830213428, "ttft_ms": 12.625999981537461, "decode_ms": 12.651792028918862}, "total_wall_ms": 2260.296707972884, "ttft_ms": 12.625999981537461, "input_usage": {"receiver_prompt_tokens": 5912}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454302720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10085256256, "mlx_cache_bytes": 3759502776, "process_rss_bytes": 10454302720}, "peak_prefill_memory": null, "peak_decode_memory": 10085256256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 824 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e8b715998d001d784e34c798", "attempt_id": "c00430cedd7c", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:52.075546Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5911, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016083940863609314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2222.5262909196317, "ttft_ms": 12.412625015713274, "decode_ms": 12.326416908763349}, "total_wall_ms": 2258.3293329225853, "ttft_ms": 12.412625015713274, "input_usage": {"receiver_prompt_tokens": 5911}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454335488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10085125184, "mlx_cache_bytes": 3759502776, "process_rss_bytes": 10454335488}, "peak_prefill_memory": null, "peak_decode_memory": 10085125184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 825 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4819b3e886a426e649673d69", "attempt_id": "966275b1e4c5", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:59.264691Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.95845796726644, "ttft_ms": 12.160875019617379, "decode_ms": 11.974082910455763}, "total_wall_ms": 257.5308340601623, "ttft_ms": 12.160875019617379, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454384640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 5698016696, "process_rss_bytes": 10454384640}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 826 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2616a493b326842ec86bc548", "attempt_id": "e77edbaac626", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:59.549703Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.97449999395758, "ttft_ms": 12.213875073939562, "decode_ms": 11.907875072211027}, "total_wall_ms": 252.51716701313853, "ttft_ms": 12.213875073939562, "input_usage": {"receiver_prompt_tokens": 597, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454384640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 5972776376, "process_rss_bytes": 10454384640}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 827 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "772f9f55fe3e1e9e80983b6e", "attempt_id": "86132860a2ef", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:33:59.829025Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.13100002147257, "ttft_ms": 12.150624999776483, "decode_ms": 11.945959064178169}, "total_wall_ms": 252.63375008944422, "ttft_ms": 12.150624999776483, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454401024, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568278616, "mlx_cache_bytes": 6233871800, "process_rss_bytes": 10454401024}, "peak_prefill_memory": null, "peak_decode_memory": 9568278616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 828 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d524afd8d865415a070f1032", "attempt_id": "12dbfd3768cb", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:00.107581Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.64270794484764, "ttft_ms": 11.988583952188492, "decode_ms": 11.949916020967066}, "total_wall_ms": 251.88549992162734, "ttft_ms": 11.988583952188492, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454417408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 6390371768, "process_rss_bytes": 10454417408}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 829 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a88c01bec4d768a97a8a0f52", "attempt_id": "884929935bf8", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:00.385508Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.01070900075138, "ttft_ms": 11.908250045962632, "decode_ms": 106.94333305582404}, "total_wall_ms": 347.10937505587935, "ttft_ms": 11.908250045962632, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10454433792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568475224, "mlx_cache_bytes": 6548444600, "process_rss_bytes": 10454433792}, "peak_prefill_memory": null, "peak_decode_memory": 9568475224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,026,040", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "ca1461769fa6e9ce559ace09073bc949ae5b71dab06ba9d4123dabaa6a81fed2"} | ||||
| 830 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5254fd2cdd3cd7bb2b62027a", "attempt_id": "f406a9fdcbd9", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:00.757818Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.26258297916502, "ttft_ms": 12.018041918054223, "decode_ms": 12.052249978296459}, "total_wall_ms": 252.53741594497114, "ttft_ms": 12.018041918054223, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454433792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570146392, "mlx_cache_bytes": 6826153400, "process_rss_bytes": 10454433792}, "peak_prefill_memory": null, "peak_decode_memory": 9570146392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 831 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e1e9896a84b80a80b9a94516", "attempt_id": "2a09452202fc", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:01.035866Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.66212497279048, "ttft_ms": 11.922582983970642, "decode_ms": 11.877749930135906}, "total_wall_ms": 251.67662499006838, "ttft_ms": 11.922582983970642, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454450176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 6826153400, "process_rss_bytes": 10454450176}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 832 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd9abed4d75981d5fc2caa72", "attempt_id": "32b92ac6bfd1", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:01.313303Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 2107, "cache_tensor_bytes": null, "serialized_payload_bytes": 2107, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.66708294116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.165041025728, "ttft_ms": 11.972791980952024, "decode_ms": 11.881666025146842}, "total_wall_ms": 252.20945791807026, "ttft_ms": 11.972791980952024, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5952, "sender_output_tokens": 512, "sender_prefill_ms": 1120.6040409160778, "sender_ttft_ms": 7.775667007081211, "sender_decode_ms": 3770.4402500530705}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454466560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 6826153400, "process_rss_bytes": 10454466560}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c561fbca711dd0ec5f96578fc83b3a2fdf2fb06494db9a4facf21f00903b866", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 833 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8fc5dfffd30f369b7238a986", "attempt_id": "239a4877cb2e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.119718Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 363, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.34820800367743, "ttft_ms": 11.86004199553281, "decode_ms": 82.33387500513345}, "total_wall_ms": 242.54825001116842, "ttft_ms": 11.86004199553281, "input_usage": {"receiver_prompt_tokens": 363, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9498579492, "mlx_cache_bytes": 7746263904, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9498579492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wentisoby-18", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "5e1b4376cbc7848ad56e533260fa5c8b3f9bbb233da09024ec193283565e0538"} | ||||
| 834 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "32e8bb8c276b049197326af5", "attempt_id": "b3db9fd25819", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.388699Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 368, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.0058750556782, "ttft_ms": 11.735707987099886, "decode_ms": 11.686541954986751}, "total_wall_ms": 167.4813749268651, "ttft_ms": 11.735707987099886, "input_usage": {"receiver_prompt_tokens": 368, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9501233720, "mlx_cache_bytes": 7961682204, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9501233720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 835 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1180e06d980fc7e9dd476efa", "attempt_id": "5885fc47e62e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.583389Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 369, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.20154110807925, "ttft_ms": 11.936791008338332, "decode_ms": 117.96820792369545}, "total_wall_ms": 273.0418340070173, "ttft_ms": 11.936791008338332, "input_usage": {"receiver_prompt_tokens": 369, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9501479484, "mlx_cache_bytes": 8091444956, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9501479484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,026,040 CAD", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "ec43cf40d32152de79b8f2bdbce7472d446b66727fab38df853592b68ed87210"} | ||||
| 836 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8d28afd49f81f73e89796ed4", "attempt_id": "2599f51fd219", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:06.882202Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 364, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.81920792907476, "ttft_ms": 11.961666983552277, "decode_ms": 11.820374988019466}, "total_wall_ms": 166.59124998841435, "ttft_ms": 11.961666983552277, "input_usage": {"receiver_prompt_tokens": 364, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9498825272, "mlx_cache_bytes": 8219371228, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9498825272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 837 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5c779acb49bce1a1a1759f89", "attempt_id": "0b8b02bf5c52", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.076384Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 370, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.5860000308603, "ttft_ms": 12.092958902940154, "decode_ms": 106.1810830142349}, "total_wall_ms": 261.9362500263378, "ttft_ms": 12.092958902940154, "input_usage": {"receiver_prompt_tokens": 370, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9502921280, "mlx_cache_bytes": 8448568480, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9502921280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,929,235", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "490e2f34381ddfcb250cd370a36b4173f6d6a797ed867ad450227b6ac8dc01bc"} | ||||
| 838 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "58026f2a9adf1a6bad0ee828", "attempt_id": "4bf5a4396d5c", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.367021Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 373, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.03683396428823, "ttft_ms": 11.818249942734838, "decode_ms": 11.830792063847184}, "total_wall_ms": 167.5794170005247, "ttft_ms": 11.818249942734838, "input_usage": {"receiver_prompt_tokens": 373, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503904332, "mlx_cache_bytes": 8579641968, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9503904332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 839 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4f66a5b722a8d62597c76859", "attempt_id": "0d1b91e1c30d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.561746Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 364, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.60933408513665, "ttft_ms": 11.82441704440862, "decode_ms": 11.80904102511704}, "total_wall_ms": 167.01758292037994, "ttft_ms": 11.82441704440862, "input_usage": {"receiver_prompt_tokens": 364, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9498825272, "mlx_cache_bytes": 8579641968, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9498825272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 840 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d5caa46d3cb09b9f8db10f36", "attempt_id": "f8bdfe93fae3", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:07.754681Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 363, "message_tokens": 272, "message_utf8_bytes": 584, "cache_tensor_bytes": null, "serialized_payload_bytes": 584, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4528.306000051089, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.40308396983892, "ttft_ms": 11.827250011265278, "decode_ms": 11.829499970190227}, "total_wall_ms": 166.79862490855157, "ttft_ms": 11.827250011265278, "input_usage": {"receiver_prompt_tokens": 363, "sender_input_tokens": 5980, "sender_output_tokens": 456, "sender_prefill_ms": 1130.9304579626769, "sender_ttft_ms": 7.489874958992004, "sender_decode_ms": 3384.232750046067}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9498579492, "mlx_cache_bytes": 8579641968, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9498579492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "274557cb2863c07a1033fb62b0e43e4099b06f7735555e7a8764865d71332365", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 841 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61f9b6c36d99abb869e3a81f", "attempt_id": "1956dedfd8df", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.138788Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.8696669721975923, "receiver_prefill_ms": 0.0, "query_prefill_ms": 86.09433309175074, "ttft_ms": 86.09433309175074, "decode_ms": 636.7040829500183}, "total_wall_ms": 729.9874579766765, "ttft_ms": 86.09433309175074, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9800502480, "mlx_cache_bytes": 10094113681, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9800502480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ")?.AUTFEATURE(1iota)!1:1，Constructorw--EEE)!falls1:1,-致胜,1000bluman:B0, there is only if p<.olleyu-", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "5ccd928298b2ec1271fd2f20e311b4d498060bfc7c2629263f11e44356ba1fd7"} | ||||
| 842 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f95701241d4aa8b1f4de89fa", "attempt_id": "cd78fcbd207b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:09.896322Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 41, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.7176249530166388, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.73045792803168, "ttft_ms": 78.73045792803168, "decode_ms": 634.295333060436}, "total_wall_ms": 720.3600839711726, "ttft_ms": 78.73045792803168, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9811086564, "mlx_cache_bytes": 10150999257, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9811086564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "@ #tbody:ull(0>unbenepist(0oN:puter,freezer,即情采光,这人之友，请,无它人,荣为王氏定律,本相宜", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "3561c0ba5739e3c83e8f9e147911d53782ef6787687f0f65f7d2a0b737470e94"} | ||||
| 843 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cea8d7bc0d4ddf00774964b7", "attempt_id": "cfc428baf4c3", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:10.643313Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 42, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.773583935573697, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.99570797942579, "ttft_ms": 77.99570797942579, "decode_ms": 636.1697500105947}, "total_wall_ms": 721.9488330883905, "ttft_ms": 77.99570797942579, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9812266216, "mlx_cache_bytes": 10196792873, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9812266216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#,锁定专长,在quiringmanagerhof:0: !@. 0http://www_7(� :Gucci, \"唐人来由吧,wither:0:0:00:0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "d616e7c06a0556b0fb39a62c4faa8b0e52f73e515c636e90667f3be3660cfac6"} | ||||
| 844 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "81767fb96cd3b56dd36c67eb", "attempt_id": "e42636221477", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:11.391381Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.802041893824935, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.6397499460727, "ttft_ms": 74.6397499460727, "decode_ms": 633.6173330200836}, "total_wall_ms": 715.8077500062063, "ttft_ms": 74.6397499460727, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9804401892, "mlx_cache_bytes": 10235737641, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9804401892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "/. .0大ishel (hammers)!请来的αι(或不能及格子法拉布.getLength(或多动老中之导,吃上火办性的,那怕子序列终身硬力之年的价格", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "db6d9637328776a9fe8f0577c5c7b3bd1da763c984168edd75a7e2296bb51bd3"} | ||||
| 845 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7ad419f7675e42d20fb54486", "attempt_id": "df1cd31988c4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:12.134485Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 43, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.7970839980989695, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.30687502771616, "ttft_ms": 77.30687502771616, "decode_ms": 633.9394999668002}, "total_wall_ms": 718.4069589711726, "ttft_ms": 77.30687502771616, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9813757164, "mlx_cache_bytes": 10288396161, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9813757164, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "其四分部度高一锅子骨� bufsize 元...除了專業对眼,吃遍 Forget the i/在格里排序:)的充分角落在O2的,follow-1可以为将一行,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "4ec1eef6e145def18ca9bf0991d162ec3679138c8aca3cd439fd2a063be97728"} | ||||
| 846 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "529e124cc7659946b95fcafb", "attempt_id": "30b07f59e9fa", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:12.879466Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 46, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.727249938994646, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.82337502390146, "ttft_ms": 75.82337502390146, "decode_ms": 635.0170000223443}, "total_wall_ms": 718.4315420454368, "ttft_ms": 75.82337502390146, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9819409656, "mlx_cache_bytes": 10325096689, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9819409656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "[Referomanesthmelomicservice\n# bioss, which is no.()publications\niPoker:20字为维和词典式方程的重要性以及所有者知无不求是300,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "94ef6f1e6e0c4256d6868ffa2745f1b110394bab1381337b4d9b96866e0f1e69"} | ||||
| 847 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9f0739ba0b571b279455913", "attempt_id": "1009725ced5a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:13.625066Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.7602910520508885, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.34916705824435, "ttft_ms": 74.34916705824435, "decode_ms": 634.554999996908}, "total_wall_ms": 715.9650831017643, "ttft_ms": 74.34916705824435, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9804156132, "mlx_cache_bytes": 10325096689, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9804156132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "-UNESCO 00v,101-row (of 00-vaccine.com) - 1, 0, 0, please \"##### Social Tabo movement for you have already followed howie 0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "27663731c3f5d3a890f8b2019c5c0ea1ed2d618c61febb857a5448b4cf1b6103"} | ||||
| 848 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "888e78373166a00f975d92aa", "attempt_id": "dd1c3e4db63d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:14.368048Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592190, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.0793340066448, "doc_prefill_ms": 1106.0001670848578, "compress_ms": 12.951083946973085, "serialize_ms": 61.03133293800056, "load_ms": 1.7829160206019878, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.1607920024544, "ttft_ms": 73.1607920024544, "decode_ms": 634.7670420072973}, "total_wall_ms": 715.5802079942077, "ttft_ms": 73.1607920024544, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10888216576, "backend_memory": {"mlx_active_bytes": 9696955400, "mlx_peak_bytes": 9800502480, "mlx_cache_bytes": 10325096689, "process_rss_bytes": 10888216576}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9800502480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "高hidro 方言 Language (大 Meyottomanometer, please\nA)!alsadridedbeanstons::可以说会下，对白盒式運動stakes:1x1.0. Here所说的，不掉的", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "76933438874442c9ecae304ea6d502fb47b06865a1f2ef2adcc401a420aa32b8", "output_hash": "a20dc8a4588ba8c6e1f2c32526765720d8fc319c1d6c9852e5b0e02d24ea7c19"} | ||||
| 849 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "975dfd2656a48aaade84d3e9", "attempt_id": "e91d51125ac8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:18.426484Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.8742920365184546, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.09358297567815, "ttft_ms": 80.09358297567815, "decode_ms": 13.7730420101434}, "total_wall_ms": 101.76183399744332, "ttft_ms": 80.09358297567815, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9800502480, "mlx_cache_bytes": 10339514609, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9800502480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 850 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3cfadc017a3834897965df9c", "attempt_id": "d6d6e08aaa87", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:18.556050Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 41, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.79387500975281, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.08633300010115, "ttft_ms": 78.08633300010115, "decode_ms": 13.611541013233364}, "total_wall_ms": 99.02512491680682, "ttft_ms": 78.08633300010115, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9810889956, "mlx_cache_bytes": 10339514609, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9810889956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 851 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f3d6e4dd70dc452819bf0af1", "attempt_id": "409527644997", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:18.681695Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 42, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.7627500928938389, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.36179104540497, "ttft_ms": 77.36179104540497, "decode_ms": 13.610708061605692}, "total_wall_ms": 98.42612501233816, "ttft_ms": 77.36179104540497, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9812266216, "mlx_cache_bytes": 10339514609, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9812266216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 852 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ce7bbe423bb9595867204895", "attempt_id": "36f2a14802a5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:18.805906Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.7795419553294778, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.5663329726085, "ttft_ms": 74.5663329726085, "decode_ms": 13.549666968174279}, "total_wall_ms": 95.5984580796212, "ttft_ms": 74.5663329726085, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9804156132, "mlx_cache_bytes": 10339514609, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9804156132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 853 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "adeb4186cad1e9e79f0ace81", "attempt_id": "0ca110f1c664", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:18.927011Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 43, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.825709012337029, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.73000008799136, "ttft_ms": 76.73000008799136, "decode_ms": 13.533791992813349}, "total_wall_ms": 97.51833300106227, "ttft_ms": 76.73000008799136, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9813757164, "mlx_cache_bytes": 10339514609, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9813757164, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 854 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "05f3d8689dee72fbb9e1094f", "attempt_id": "116a4511a50e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:19.049956Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 46, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.7611250514164567, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.06508298683912, "ttft_ms": 75.06508298683912, "decode_ms": 13.598874909803271}, "total_wall_ms": 96.26829100307077, "ttft_ms": 75.06508298683912, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9695775752, "mlx_peak_bytes": 9819393272, "mlx_cache_bytes": 10338531569, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9819393272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 855 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f57d93183bf46dc019720172", "attempt_id": "f37d2852c650", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:19.171969Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.7745839431881905, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.07829200383276, "ttft_ms": 74.07829200383276, "decode_ms": 13.5193329770118}, "total_wall_ms": 94.80329195503145, "ttft_ms": 74.07829200383276, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9804156132, "mlx_cache_bytes": 10339711217, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9804156132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 856 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a690a3c75953b7e9224f348d", "attempt_id": "3f196c217714", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:19.292610Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9476361224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 216576000, "serialized_payload_bytes": 216592291, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3312.265667016618, "doc_prefill_ms": 1105.8987498981878, "compress_ms": 2130.512333009392, "serialize_ms": 75.53604198619723, "load_ms": 1.6207919688895345, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.47808307874948, "ttft_ms": 72.47808307874948, "decode_ms": 13.572665979154408}, "total_wall_ms": 93.31900009419769, "ttft_ms": 72.47808307874948, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11056283648, "backend_memory": {"mlx_active_bytes": 9694596104, "mlx_peak_bytes": 9800502480, "mlx_cache_bytes": 10339711217, "process_rss_bytes": 11056283648}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9800502480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f9f5cba778f127593c46e336a74fd52f629965d44b034894a721c102d748d5da", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 857 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9e29de6c86423ba39d5a8d1e", "attempt_id": "e11695c11a44", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:19.411735Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 36, "compress_ms": 117.05887492280453}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169573, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3363.7980840867385, "doc_prefill_ms": 1105.4987909737974, "compress_ms": 2239.000999950804, "serialize_ms": 18.943624920211732, "load_ms": 1.5291660092771053, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.95016697142273, "ttft_ms": 42.95016697142273, "decode_ms": 12.306457967497408}, "total_wall_ms": 3433.2074590492994, "ttft_ms": 42.95016697142273, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10948247552, "backend_memory": {"mlx_active_bytes": 9370766344, "mlx_peak_bytes": 9445231824, "mlx_cache_bytes": 10838103369, "process_rss_bytes": 10948247552}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9445231824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c872c24160c6ba378c92b27e3ee4c53e830d900b49c8766a13316700e2a60dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 858 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "33433e0edb2ca67847d17bc5", "attempt_id": "46010d04d01e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:22.870838Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 41, "compress_ms": 125.03441702574492}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 41, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169573, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3383.924249908887, "doc_prefill_ms": 1107.141749933362, "compress_ms": 2260.675667086616, "serialize_ms": 15.737957903183997, "load_ms": 1.286374987103045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.603750109672546, "ttft_ms": 44.603750109672546, "decode_ms": 12.28174997959286}, "total_wall_ms": 3452.6379168964922, "ttft_ms": 44.603750109672546, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10990469120, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9453800676, "mlx_cache_bytes": 10874590537, "process_rss_bytes": 10990469120}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9453800676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c872c24160c6ba378c92b27e3ee4c53e830d900b49c8766a13316700e2a60dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 859 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "47f75bd48a49cd0f92e18aa0", "attempt_id": "91c604d8e262", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:26.351966Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 42, "compress_ms": 124.13529097102582}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 42, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169573, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3384.703333955258, "doc_prefill_ms": 1106.295624980703, "compress_ms": 2263.72754201293, "serialize_ms": 14.319667010568082, "load_ms": 1.342416973784566, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.67137495521456, "ttft_ms": 44.67137495521456, "decode_ms": 12.241082964465022}, "total_wall_ms": 3451.741415890865, "ttft_ms": 44.67137495521456, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10990501888, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9455209704, "mlx_cache_bytes": 10902082889, "process_rss_bytes": 10990501888}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9455209704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c872c24160c6ba378c92b27e3ee4c53e830d900b49c8766a13316700e2a60dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 860 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c9e25e303e6d558e4c84e780", "attempt_id": "1ff401550a7f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:29.831433Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 37, "compress_ms": 118.5535000404343}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169572, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3421.5164579218253, "doc_prefill_ms": 1106.0450420482084, "compress_ms": 2299.8594159726053, "serialize_ms": 15.250665950588882, "load_ms": 1.307999948039651, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.384832981042564, "ttft_ms": 42.384832981042564, "decode_ms": 12.342666974291205}, "total_wall_ms": 3489.801707910374, "ttft_ms": 42.384832981042564, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10990518272, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9446903012, "mlx_cache_bytes": 10939815241, "process_rss_bytes": 10990518272}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9446903012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8b5b93cf09e7173efb1e3dd4fc4697edf351183bc3d21f7ba68d84f3ba9a8dc3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 861 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "072e33a4be5d952ee5967ad0", "attempt_id": "598be8dcca4a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:33.349870Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 43, "compress_ms": 123.86612500995398}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 43, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169573, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3368.876624968834, "doc_prefill_ms": 1105.5857080500573, "compress_ms": 2247.472916962579, "serialize_ms": 15.442000003531575, "load_ms": 1.335292006842792, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.327500043436885, "ttft_ms": 44.327500043436885, "decode_ms": 12.489333981648088}, "total_wall_ms": 3438.5531659936532, "ttft_ms": 44.327500043436885, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10990518272, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9456635116, "mlx_cache_bytes": 10979956041, "process_rss_bytes": 10990518272}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9456635116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c872c24160c6ba378c92b27e3ee4c53e830d900b49c8766a13316700e2a60dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 862 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c915e688961b9d0945e2429a", "attempt_id": "633df9bebc72", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:36.817509Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 46, "compress_ms": 123.45495889894664}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 46, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169573, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3383.077791077085, "doc_prefill_ms": 1106.693375040777, "compress_ms": 2259.8763330606744, "serialize_ms": 16.086374991573393, "load_ms": 1.326833968050778, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.180457945913076, "ttft_ms": 44.180457945913076, "decode_ms": 12.676000013016164}, "total_wall_ms": 3450.26041707024, "ttft_ms": 44.180457945913076, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10990551040, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9462189304, "mlx_cache_bytes": 11028387145, "process_rss_bytes": 10990551040}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9462189304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c872c24160c6ba378c92b27e3ee4c53e830d900b49c8766a13316700e2a60dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 863 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7644464f75c6d96a34ec9d58", "attempt_id": "c9e30fd4f354", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:40.297449Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 37, "compress_ms": 118.81058302242309}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169573, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3376.0749578941613, "doc_prefill_ms": 1106.5471669426188, "compress_ms": 2253.9798330981284, "serialize_ms": 15.148625010624528, "load_ms": 1.5919579891487956, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.45287494268268, "ttft_ms": 42.45287494268268, "decode_ms": 12.45762500911951}, "total_wall_ms": 3442.4892920069396, "ttft_ms": 42.45287494268268, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11003396096, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9446903012, "mlx_cache_bytes": 11028387145, "process_rss_bytes": 11003396096}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9446903012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c872c24160c6ba378c92b27e3ee4c53e830d900b49c8766a13316700e2a60dc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 864 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f36bed78e9ca70c8b42aff07", "attempt_id": "ffdce1d2c092", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:43.770441Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5875, "keep": 1469, "window_tokens": 36, "compress_ms": 117.27187503129244}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 54153216, "serialized_payload_bytes": 54169573, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3353.2805000431836, "doc_prefill_ms": 1106.3869999488816, "compress_ms": 2231.8658750737086, "serialize_ms": 14.645999995991588, "load_ms": 1.3417919399216771, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.090500053949654, "ttft_ms": 43.090500053949654, "decode_ms": 12.308375095017254}, "total_wall_ms": 3421.6379579156637, "ttft_ms": 43.090500053949654, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11003412480, "backend_memory": {"mlx_active_bytes": 9370487816, "mlx_peak_bytes": 9444478160, "mlx_cache_bytes": 11028387145, "process_rss_bytes": 11003412480}, "peak_prefill_memory": 10065235032, "peak_decode_memory": 9444478160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1c872c24160c6ba378c92b27e3ee4c53e830d900b49c8766a13316700e2a60dc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 865 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9375c660717cee5d7801703d", "attempt_id": "286c04d34ef3", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:47.266129Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2029, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 699.0056660724804, "ttft_ms": 12.54066708497703, "decode_ms": 132.75004108436406}, "total_wall_ms": 847.8227909654379, "ttft_ms": 12.54066708497703, "input_usage": {"receiver_prompt_tokens": 2029}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10489413632, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9976785904, "mlx_cache_bytes": 725882216, "process_rss_bytes": 10489413632}, "peak_prefill_memory": null, "peak_decode_memory": 9976785904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RQ-10W-4229", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "83e9983dc82dee9d853925393e38c21ef13d0e07a7356398b84c1047f4e54bc9"} | ||||
| 866 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0664f2aa12c5ed3adb9c3832", "attempt_id": "0e0748480307", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:48.133978Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2036, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 695.8487910451367, "ttft_ms": 12.34608399681747, "decode_ms": 144.45812499616295}, "total_wall_ms": 856.1595410574228, "ttft_ms": 12.34608399681747, "input_usage": {"receiver_prompt_tokens": 2036}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10489446400, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9979046976, "mlx_cache_bytes": 1359631720, "process_rss_bytes": 10489446400}, "peak_prefill_memory": null, "peak_decode_memory": 9979046976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 867 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d6455b9f25561ce097e5ad67", "attempt_id": "1a413b93ccf5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:49.008644Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2035, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.1572919022292, "ttft_ms": 12.316791922785342, "decode_ms": 84.15137499105185}, "total_wall_ms": 794.2746250191703, "ttft_ms": 12.316791922785342, "input_usage": {"receiver_prompt_tokens": 2035}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10489446400, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9979046976, "mlx_cache_bytes": 1359631720, "process_rss_bytes": 10489446400}, "peak_prefill_memory": null, "peak_decode_memory": 9979046976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 868 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d751955793592c812ca13970", "attempt_id": "cc2b33ebb4a5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:49.821149Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2030, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.2362920381129, "ttft_ms": 12.078790925443172, "decode_ms": 108.32650004886091}, "total_wall_ms": 817.9422499379143, "ttft_ms": 12.078790925443172, "input_usage": {"receiver_prompt_tokens": 2030}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10489479168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10019449920, "mlx_cache_bytes": 1775326568, "process_rss_bytes": 10489479168}, "peak_prefill_memory": null, "peak_decode_memory": 10019449920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 869 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "df3e1bde2c78af64bbe44379", "attempt_id": "3854ca379ff2", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:50.658247Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2041, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 695.0235419208184, "ttft_ms": 12.117582955397666, "decode_ms": 84.19333293568343}, "total_wall_ms": 794.7169160470366, "ttft_ms": 12.117582955397666, "input_usage": {"receiver_prompt_tokens": 2041}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10489479168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9980439616, "mlx_cache_bytes": 2377045352, "process_rss_bytes": 10489479168}, "peak_prefill_memory": null, "peak_decode_memory": 9980439616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 870 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b2fc564c1d836a4604cc4c3c", "attempt_id": "2e1d67cc58d9", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:51.471262Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2038, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.2823750432581, "ttft_ms": 12.10587506648153, "decode_ms": 120.31400005798787}, "total_wall_ms": 830.0189579604194, "ttft_ms": 12.10587506648153, "input_usage": {"receiver_prompt_tokens": 2038}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10489479168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9979915328, "mlx_cache_bytes": 2735920488, "process_rss_bytes": 10489479168}, "peak_prefill_memory": null, "peak_decode_memory": 9979915328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72P-3503", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "051acaf42a5b0e2760fcb6fb7252c81cae4688e78f4f2cfa24c17e2daf75b9e3"} | ||||
| 871 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ef6ca5efc0a0cf3f65d41a0d", "attempt_id": "2ad83766357d", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:52.319310Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2030, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 693.8011669553816, "ttft_ms": 12.540583033114672, "decode_ms": 12.086958973668516}, "total_wall_ms": 722.0671670511365, "ttft_ms": 12.540583033114672, "input_usage": {"receiver_prompt_tokens": 2030}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489479168, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10027789376, "mlx_cache_bytes": 2735920488, "process_rss_bytes": 10489479168}, "peak_prefill_memory": null, "peak_decode_memory": 10027789376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 872 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3f83d2d6689dd0f49a654c46", "attempt_id": "a90d59d35bb9", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:53.059394Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2031, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010207993909716606, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.393084035255, "ttft_ms": 12.16533302795142, "decode_ms": 12.164000072516501}, "total_wall_ms": 722.1397079993039, "ttft_ms": 12.16533302795142, "input_usage": {"receiver_prompt_tokens": 2031}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489495552, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10027920448, "mlx_cache_bytes": 3093484904, "process_rss_bytes": 10489495552}, "peak_prefill_memory": null, "peak_decode_memory": 10027920448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 873 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9c1e6fa8f9535836e8d6df19", "attempt_id": "08751ad1c036", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:57.324345Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 520, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 215.47441696748137, "ttft_ms": 12.002416071482003, "decode_ms": 11.856500059366226}, "total_wall_ms": 240.71270797867328, "ttft_ms": 12.002416071482003, "input_usage": {"receiver_prompt_tokens": 520, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489544704, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9603176572, "mlx_cache_bytes": 4237001152, "process_rss_bytes": 10489544704}, "peak_prefill_memory": null, "peak_decode_memory": 9603176572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 874 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1386116f417a2e601c371fca", "attempt_id": "769af25ee864", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:57.584237Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 527, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.6077499659732, "ttft_ms": 12.111583026126027, "decode_ms": 11.958583956584334}, "total_wall_ms": 233.05304208770394, "ttft_ms": 12.111583026126027, "input_usage": {"receiver_prompt_tokens": 527, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489544704, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9537247320, "mlx_cache_bytes": 4451697088, "process_rss_bytes": 10489544704}, "peak_prefill_memory": null, "peak_decode_memory": 9537247320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 875 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2622fc38c67ce5054bf9de12", "attempt_id": "38973a9402d6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:57.835954Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 526, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.61691697407514, "ttft_ms": 12.096083955839276, "decode_ms": 11.870459071360528}, "total_wall_ms": 232.85241692792624, "ttft_ms": 12.096083955839276, "input_usage": {"receiver_prompt_tokens": 526, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489561088, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9537247320, "mlx_cache_bytes": 4451697088, "process_rss_bytes": 10489561088}, "peak_prefill_memory": null, "peak_decode_memory": 9537247320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 876 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "12d4a64a2e26c6d78595ce7b", "attempt_id": "9d7ffcdee31f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:58.088400Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 521, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.79783397726715, "ttft_ms": 11.816791957244277, "decode_ms": 106.28895799163729}, "total_wall_ms": 330.03116690088063, "ttft_ms": 11.816791957244277, "input_usage": {"receiver_prompt_tokens": 521, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10489577472, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9603356796, "mlx_cache_bytes": 4634935744, "process_rss_bytes": 10489577472}, "peak_prefill_memory": null, "peak_decode_memory": 9603356796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 877 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7a553d456d55e38028be807d", "attempt_id": "4dacb09db99c", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:58.437047Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 532, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.51841697003692, "ttft_ms": 11.993249994702637, "decode_ms": 11.843249900266528}, "total_wall_ms": 233.46104205120355, "ttft_ms": 11.993249994702637, "input_usage": {"receiver_prompt_tokens": 532, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489593856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9539524696, "mlx_cache_bytes": 4882186688, "process_rss_bytes": 10489593856}, "peak_prefill_memory": null, "peak_decode_memory": 9539524696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 878 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a8a444721e90c2722f7357ce", "attempt_id": "a9fd712dfe99", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:58.688438Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 529, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.3831669986248, "ttft_ms": 12.1004160027951, "decode_ms": 11.962583055719733}, "total_wall_ms": 232.74183296598494, "ttft_ms": 12.1004160027951, "input_usage": {"receiver_prompt_tokens": 529, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489593856, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9537837144, "mlx_cache_bytes": 5021778368, "process_rss_bytes": 10489593856}, "peak_prefill_memory": null, "peak_decode_memory": 9537837144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 879 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fdcab262b5dcbda789d0692a", "attempt_id": "7a0b7887451d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:58.938920Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 521, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.46229195781052, "ttft_ms": 12.06058298703283, "decode_ms": 11.947749997489154}, "total_wall_ms": 235.76391697861254, "ttft_ms": 12.06058298703283, "input_usage": {"receiver_prompt_tokens": 521, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489610240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9603356796, "mlx_cache_bytes": 5021778368, "process_rss_bytes": 10489610240}, "peak_prefill_memory": null, "peak_decode_memory": 9603356796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 880 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ac4957a5d0efd68955334cc5", "attempt_id": "84136da8ef00", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:34:59.194088Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 522, "message_tokens": 442, "message_utf8_bytes": 1919, "cache_tensor_bytes": null, "serialized_payload_bytes": 1919, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3524.300583056174, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.23883300181478, "ttft_ms": 11.948333005420864, "decode_ms": 11.931166984140873}, "total_wall_ms": 233.27166598755866, "ttft_ms": 11.948333005420864, "input_usage": {"receiver_prompt_tokens": 522, "sender_input_tokens": 2071, "sender_output_tokens": 442, "sender_prefill_ms": 366.7596250306815, "sender_ttft_ms": 7.214791956357658, "sender_decode_ms": 3148.3517920132726}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489610240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566329064, "mlx_cache_bytes": 5206180288, "process_rss_bytes": 10489610240}, "peak_prefill_memory": null, "peak_decode_memory": 9566329064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d5673da99f64937f84cb417ad000234e8b94f1c7bff4dc32b26c52f617898eb2", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 881 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "24043006046085405a1ce6c0", "attempt_id": "6080844caed4", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:01.954616Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 279, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.98670800495893, "ttft_ms": 11.870666989125311, "decode_ms": 11.763375019654632}, "total_wall_ms": 153.5577920731157, "ttft_ms": 11.870666989125311, "input_usage": {"receiver_prompt_tokens": 279, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9446822100, "mlx_cache_bytes": 5477484056, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9446822100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 882 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "568f36d792f016e8d17f9983", "attempt_id": "0e6f3fff0dec", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:02.130267Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 286, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.83241597469896, "ttft_ms": 11.781458044424653, "decode_ms": 11.802791967056692}, "total_wall_ms": 147.1265839645639, "ttft_ms": 11.781458044424653, "input_usage": {"receiver_prompt_tokens": 286, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9451311344, "mlx_cache_bytes": 5486922380, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9451311344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 883 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "15e6ec14c93a92b955fb1642", "attempt_id": "8df56fd95f8a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:02.296603Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 285, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.62716598343104, "ttft_ms": 11.774583021178842, "decode_ms": 117.06099996808916}, "total_wall_ms": 252.08783405832946, "ttft_ms": 11.774583021178842, "input_usage": {"receiver_prompt_tokens": 285, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9450819824, "mlx_cache_bytes": 5587061388, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9450819824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,021,900 CAD", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "9fe601396a055e5c8ef96bf2a7bceba5fc3cc9929756a167bdb252e82653abbe"} | ||||
| 884 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ca1155abfad6bd6b3616615a", "attempt_id": "d84ec14f6f84", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:02.566661Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 280, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.63187498319894, "ttft_ms": 11.734541971236467, "decode_ms": 11.728334007784724}, "total_wall_ms": 146.7156660510227, "ttft_ms": 11.734541971236467, "input_usage": {"receiver_prompt_tokens": 280, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9447002352, "mlx_cache_bytes": 5685365388, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9447002352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 885 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5a86a2e4b33580f2a2a8ea6f", "attempt_id": "759840210979", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:02.731162Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 291, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.13737499061972, "ttft_ms": 11.67875004466623, "decode_ms": 11.766707990318537}, "total_wall_ms": 147.27179193869233, "ttft_ms": 11.67875004466623, "input_usage": {"receiver_prompt_tokens": 291, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9454227716, "mlx_cache_bytes": 5854580500, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9454227716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 886 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bfdc72b8be24297d5e512b22", "attempt_id": "a0ce2ba60a72", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:02.896359Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 288, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.73029203061014, "ttft_ms": 11.720916954800487, "decode_ms": 11.671041953377426}, "total_wall_ms": 146.76508400589228, "ttft_ms": 11.720916954800487, "input_usage": {"receiver_prompt_tokens": 288, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9451802884, "mlx_cache_bytes": 5955768084, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9451802884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 887 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6f719a1465d54b2dd7488e07", "attempt_id": "f58a78d02ac4", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:03.060682Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 280, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.3670830950141, "ttft_ms": 11.75720791798085, "decode_ms": 11.733541963621974}, "total_wall_ms": 146.47112507373095, "ttft_ms": 11.75720791798085, "input_usage": {"receiver_prompt_tokens": 280, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9447002352, "mlx_cache_bytes": 5955768084, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9447002352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 888 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eac4e8ffb4f3f228556e43c6", "attempt_id": "cd45d74e0444", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:03.224704Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 281, "message_tokens": 189, "message_utf8_bytes": 395, "cache_tensor_bytes": null, "serialized_payload_bytes": 395, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2508.4927920252085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.87579209078103, "ttft_ms": 11.746292002499104, "decode_ms": 11.682374984957278}, "total_wall_ms": 146.93766692653298, "ttft_ms": 11.746292002499104, "input_usage": {"receiver_prompt_tokens": 281, "sender_input_tokens": 2099, "sender_output_tokens": 299, "sender_prefill_ms": 367.8055420750752, "sender_ttft_ms": 7.4209170415997505, "sender_decode_ms": 2131.1930420342833}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489659392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9447493872, "mlx_cache_bytes": 6054596372, "process_rss_bytes": 10489659392}, "peak_prefill_memory": null, "peak_decode_memory": 9447493872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 4, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "746c7f3c605b5ed99dbdab6e3931a2c1949b0b9e7525404fe93ef9c9383d1887", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 889 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8019fa4ec9d797679e102ab0", "attempt_id": "dd1ffd71672f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:03.763209Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 35, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.4158750418573618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.77070793695748, "ttft_ms": 46.77070793695748, "decode_ms": 577.8894579270855}, "total_wall_ms": 627.9553329804912, "ttft_ms": 46.77070793695748, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9410923528, "mlx_peak_bytes": 9489829068, "mlx_cache_bytes": 6633084150, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9489829068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Travelsk长于壬,那么好以長,夫:mastered()()()()3. Rockefeller外拨客,夫子:[\"()])()()()()()：代價而學我囷而知", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "50abf9b0049f93ecff04f9087e806cd510573bfec0313b4abf679d233e1c124c"} | ||||
| 890 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "806d5d6ce6e1506e9a4bc8a4", "attempt_id": "421a33c43faf", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:04.410222Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 42, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.4649999793618917, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.82333292718977, "ttft_ms": 49.82333292718977, "decode_ms": 578.2443329226226}, "total_wall_ms": 631.4514999976382, "ttft_ms": 49.82333292718977, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9412135944, "mlx_peak_bytes": 9498594536, "mlx_cache_bytes": 6780655174, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9498594536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "o().\n\nAVPgin101010222\n\nb13_().gifuntoif().\n\n代表(), 15,()()。)\n\nAssistant -type().\n\nKjá)().\n\n.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "dd3c5e6d7d35fc210b6f80dc923b7160a4d5b5f1604013252bed129d47febd31"} | ||||
| 891 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0a3d566cbc122ba5a939125c", "attempt_id": "cb52dac8421e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:05.060540Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 41, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.3539170613512397, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.569582937285304, "ttft_ms": 47.569582937285304, "decode_ms": 578.2512499717996}, "total_wall_ms": 629.0588330011815, "ttft_ms": 47.569582937285304, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9412135944, "mlx_peak_bytes": 9497775336, "mlx_cache_bytes": 6817306182, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9497775336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".1......p.000012之ppkbox,qu voetts, omgt0000wraparound\nTheoreveryhit_wallschoolmapabout_16_(1)and\n##", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "04cada664df65693d7ac17f04f4a2c55f79b837a4c0a6cd5e06206d424fd61d5"} | ||||
| 892 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ae55c5511003dfc70754a53b", "attempt_id": "cce94ecb251d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:05.708492Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.3482499634847045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.93624994251877, "ttft_ms": 46.93624994251877, "decode_ms": 578.6358750192448}, "total_wall_ms": 628.66066605784, "ttft_ms": 46.93624994251877, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9410923528, "mlx_peak_bytes": 9488403688, "mlx_cache_bytes": 6866049878, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9488403688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "### =().\nEnchev3. Portnooport_cover, % of 43% -.et/().complegacy;mr)\n\nAssistant().\n\nPelay, please().\n\n)().\n\n.\n\nwasss", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "3ee69df26a479d3f4ec93fcf1e087e8117758cadb35b39469aca18e157d04d3f"} | ||||
| 893 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "463346d6b9cdca8a422340ed", "attempt_id": "b9606312632f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:06.356064Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.4474160270765424, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.03350006882101, "ttft_ms": 50.03350006882101, "decode_ms": 577.8864999301732}, "total_wall_ms": 631.2820840394124, "ttft_ms": 50.03350006882101, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9412135944, "mlx_peak_bytes": 9507523836, "mlx_cache_bytes": 6919036110, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9507523836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2002017:18:obr_3).\n%A&15%-1000x2-blitz_17% (不及)(a) :\n(1,2).fat(2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "45aa278a22073eeaead31dc1d28c79e55711c9d2f18c19c7fc6504e68b1c3ba6"} | ||||
| 894 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "74be52f3b9ec51a855f38845", "attempt_id": "ff74ab5dd085", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:07.005444Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.4742499915882945, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.18829200323671, "ttft_ms": 49.18829200323671, "decode_ms": 580.454875016585}, "total_wall_ms": 633.061166969128, "ttft_ms": 49.18829200323671, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9412103176, "mlx_peak_bytes": 9501510908, "mlx_cache_bytes": 6988356814, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9501510908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " ### On the rest of82001-5.102-visitig_(),ver>156-continuing project\\_1_for (20000001/ECBO for.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "9a20497c8beee4b74bafdb84e09057afc6c57b865bb55c6f313eb90b710cdb14"} | ||||
| 895 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c4720356abc14113fbbc79f5", "attempt_id": "a5f379e2bcb8", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:07.658530Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.4344590017572045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.18137497548014, "ttft_ms": 47.18137497548014, "decode_ms": 579.4031249824911}, "total_wall_ms": 629.8635829007253, "ttft_ms": 47.18137497548014, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9410923528, "mlx_peak_bytes": 9488403688, "mlx_cache_bytes": 6989536462, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9488403688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "letra()()()(), for (b)to the body into()()()-etb:All the. methode 7.000英� AppCompatActivity:().\n\n :\n\n()(()->>.\n\n ():$", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "977f71e3ebf6c5fe36722084e42103a2831342d2d02d80108509aeb02a9d9742"} | ||||
| 896 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8a38f71815e8fc63a5b63bd9", "attempt_id": "6282fedfb5b2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:08.307382Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 37, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73522917, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 373.75320808496326, "doc_prefill_ms": 342.9178330115974, "compress_ms": 9.420541930012405, "serialize_ms": 17.778292065486312, "load_ms": 1.4669999945908785, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.3066670820117, "ttft_ms": 47.3066670820117, "decode_ms": 578.1722089741379}, "total_wall_ms": 628.8281660526991, "ttft_ms": 47.3066670820117, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10637508608, "backend_memory": {"mlx_active_bytes": 9410923528, "mlx_peak_bytes": 9490156776, "mlx_cache_bytes": 7042032167, "process_rss_bytes": 10637508608}, "peak_prefill_memory": 10014043156, "peak_decode_memory": 9490156776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "O:车子头悬着高報,leterser.1:anap_33054hautgetis to the authorsto threaleedor和新詞王袍入骨有,必焼,必", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8a598350abb98994a469b0d7aab0a4a706ea4b0c9576e287ed56d2c46ba2087", "output_hash": "f91276bc8abd438f64d6f3a015fd28be38ef8154c57e3de41b2643cd4a6d6fbe"} | ||||
| 897 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2cd6cee2cc205095b5497dc1", "attempt_id": "4cff94a77b00", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:10.244953Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 35, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.5256250044330955, "receiver_prefill_ms": 0.0, "query_prefill_ms": 69.5470420178026, "ttft_ms": 69.5470420178026, "decode_ms": 12.558832997456193}, "total_wall_ms": 85.42762498836964, "ttft_ms": 69.5470420178026, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9489108172, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9489108172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 898 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "920484a730ec33baca1a9f15", "attempt_id": "d55043c45df6", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:10.351076Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 42, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.4118750113993883, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.96108398679644, "ttft_ms": 48.96108398679644, "decode_ms": 111.63983296137303}, "total_wall_ms": 163.8967499602586, "ttft_ms": 48.96108398679644, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9498135784, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9498135784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 653-Q, Matane", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "9470eda80bf5c663e52204dcfd37dbb43b2205b268b54534665ea063fadad60f"} | ||||
| 899 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0af5e9883225f004f80c6a42", "attempt_id": "0904fe8be9ac", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:10.534882Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 41, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.4360420173034072, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.43333300575614, "ttft_ms": 47.43333300575614, "decode_ms": 86.57775004394352}, "total_wall_ms": 137.23600003868341, "ttft_ms": 47.43333300575614, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9497316584, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9497316584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0458", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "e6c3c0c08137b6989b38d17fa29cc24caf9e82a129dc97008c2d25e76638b4be"} | ||||
| 900 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c70107469ba5d5e958b4ba49", "attempt_id": "6573e148ae91", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:10.690795Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.4327500248327851, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.5443329885602, "ttft_ms": 46.5443329885602, "decode_ms": 12.405124958604574}, "total_wall_ms": 62.057290924713016, "ttft_ms": 46.5443329885602, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9487944936, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9487944936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 901 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03a74acc4218f0de00151696", "attempt_id": "ff57c1db2a0b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:10.770687Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.4187080087140203, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.41158299334347, "ttft_ms": 49.41158299334347, "decode_ms": 12.379499967209995}, "total_wall_ms": 65.05466694943607, "ttft_ms": 49.41158299334347, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9506802940, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9506802940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 902 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b36eb9ed757b848bfa61af6b", "attempt_id": "babaa9423f37", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:10.853478Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.3615830102935433, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.297959078103304, "ttft_ms": 49.297959078103304, "decode_ms": 12.412791955284774}, "total_wall_ms": 64.78962500113994, "ttft_ms": 49.297959078103304, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9501052156, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9501052156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 903 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "de25b161609efbf54983817e", "attempt_id": "10565696333c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:10.936036Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.372082973830402, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.13920806534588, "ttft_ms": 47.13920806534588, "decode_ms": 12.41966593079269}, "total_wall_ms": 62.62962496839464, "ttft_ms": 47.13920806534588, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9487944936, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9487944936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 904 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f7de83bbd4a53f24220c73c4", "attempt_id": "1b2ec38e726f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:11.016480Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 37, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 73506816, "serialized_payload_bytes": 73523018, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1287.7609169809148, "doc_prefill_ms": 342.33979193959385, "compress_ms": 912.7690839814022, "serialize_ms": 32.38125005736947, "load_ms": 1.3973749009892344, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.075332957319915, "ttft_ms": 47.075332957319915, "decode_ms": 12.405958026647568}, "total_wall_ms": 62.607375090010464, "ttft_ms": 47.075332957319915, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642309120, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9489698024, "mlx_cache_bytes": 7074767399, "process_rss_bytes": 10642309120}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9489698024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8f671007369ac167a54a7b59bebb5f103d2e2cc7f7a0047aac7bce6343bf9c9b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 905 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "910e957dfaf0296f0411f134", "attempt_id": "daaf16386e67", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:11.096820Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 35, "compress_ms": 77.93758308980614}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 35, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374355, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1352.0740830572322, "doc_prefill_ms": 342.35162497498095, "compress_ms": 1002.5803330354393, "serialize_ms": 6.863999995402992, "load_ms": 5.37729193456471, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.798874964006245, "ttft_ms": 36.798874964006245, "decode_ms": 11.892542010173202}, "total_wall_ms": 1409.6220830688253, "ttft_ms": 36.798874964006245, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10625187840, "backend_memory": {"mlx_active_bytes": 9298938888, "mlx_peak_bytes": 9365392588, "mlx_cache_bytes": 7245799679, "process_rss_bytes": 10625187840}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9365392588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0ca0160d5361cd002bbbcb004e5c037778ebb4ecee4bcff6c68b577c43e5e0ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 906 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "25c93a118b1f1aa3c0955c41", "attempt_id": "524adce34380", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:12.524136Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 42, "compress_ms": 82.84699998330325}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 42, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374355, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1363.4908340172842, "doc_prefill_ms": 342.09295897744596, "compress_ms": 1016.1123330472037, "serialize_ms": 5.001624929718673, "load_ms": 1.2088329531252384, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.02441602945328, "ttft_ms": 37.02441602945328, "decode_ms": 142.8747499594465}, "total_wall_ms": 1547.7783749811351, "ttft_ms": 37.02441602945328, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 42}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10637017088, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9376402664, "mlx_cache_bytes": 7292543231, "process_rss_bytes": 10637017088}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9376402664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 653-W, Chibougamau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0ca0160d5361cd002bbbcb004e5c037778ebb4ecee4bcff6c68b577c43e5e0ac", "output_hash": "9316cce8e043bae20be7491f870b7f7cdd19e0751b3e34767e7c89ed1ab63d4c"} | ||||
| 907 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8f26c0fd27455c9d64a00c9c", "attempt_id": "888290227117", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:14.092115Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 41, "compress_ms": 80.65170794725418}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 41, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374355, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1360.6757910456508, "doc_prefill_ms": 342.34583389479667, "compress_ms": 1013.2022079778835, "serialize_ms": 4.8237080918625, "load_ms": 1.155500067397952, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.23787504713982, "ttft_ms": 37.23787504713982, "decode_ms": 87.15095790103078}, "total_wall_ms": 1489.390333998017, "ttft_ms": 37.23787504713982, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10637017088, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9375583464, "mlx_cache_bytes": 7297786111, "process_rss_bytes": 10637017088}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9375583464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0ca0160d5361cd002bbbcb004e5c037778ebb4ecee4bcff6c68b577c43e5e0ac", "output_hash": "48919ab6fea164f4196f906182c04d4d5548cf08de9a4e27c4b7c0770071d095"} | ||||
| 908 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a7a4e9e6a4078d26f28f16ff", "attempt_id": "50dc05173918", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:15.601778Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 36, "compress_ms": 91.97920898441225}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374355, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1363.916082889773, "doc_prefill_ms": 342.5677079940215, "compress_ms": 1016.1919590318576, "serialize_ms": 4.876208025962114, "load_ms": 1.1008339934051037, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.0122499987483, "ttft_ms": 36.0122499987483, "decode_ms": 15.648875036276877}, "total_wall_ms": 1419.8285829043016, "ttft_ms": 36.0122499987483, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10637017088, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9365392616, "mlx_cache_bytes": 7321559295, "process_rss_bytes": 10637017088}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9365392616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0ca0160d5361cd002bbbcb004e5c037778ebb4ecee4bcff6c68b577c43e5e0ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 909 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "649e942626375c7d692ff787", "attempt_id": "351b9f54eb58", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:17.041579Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 47, "compress_ms": 83.59691698569804}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374355, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1351.0631250683218, "doc_prefill_ms": 341.93870809394866, "compress_ms": 1004.295082995668, "serialize_ms": 4.539125016890466, "load_ms": 1.0471659479662776, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.44379198178649, "ttft_ms": 37.44379198178649, "decode_ms": 11.830999981611967}, "total_wall_ms": 1404.5106249395758, "ttft_ms": 37.44379198178649, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10637017088, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9386052860, "mlx_cache_bytes": 7364550911, "process_rss_bytes": 10637017088}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9386052860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0ca0160d5361cd002bbbcb004e5c037778ebb4ecee4bcff6c68b577c43e5e0ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 910 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "95baedf07cd30088d0a3e7fa", "attempt_id": "67cf0632c4fb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:18.466253Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 44, "compress_ms": 101.75716690719128}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374356, "side_information_bytes": 16084, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1384.980791946873, "doc_prefill_ms": 342.2999170143157, "compress_ms": 1037.5112920301035, "serialize_ms": 4.891292075626552, "load_ms": 1.0620419634506106, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.26158395875245, "ttft_ms": 37.26158395875245, "decode_ms": 11.922750039957464}, "total_wall_ms": 1438.399708014913, "ttft_ms": 37.26158395875245, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10637017088, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9379319036, "mlx_cache_bytes": 7393272063, "process_rss_bytes": 10637017088}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9379319036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9a3162c47cb8a49f1408e7b65f79da107c2f5885ec33fc574da6d1c0aca44782", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 911 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "773a7a52ef2a4fd1ebe59ab1", "attempt_id": "f793b3b0f36f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:19.924767Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 36, "compress_ms": 91.97245805989951}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374355, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1393.8537079375237, "doc_prefill_ms": 342.16012503020465, "compress_ms": 1046.2039170088246, "serialize_ms": 5.192707991227508, "load_ms": 1.2245419202372432, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.87133390828967, "ttft_ms": 35.87133390828967, "decode_ms": 12.01745797879994}, "total_wall_ms": 1446.3572500972077, "ttft_ms": 35.87133390828967, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10637017088, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9365392616, "mlx_cache_bytes": 7393272063, "process_rss_bytes": 10637017088}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9365392616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0ca0160d5361cd002bbbcb004e5c037778ebb4ecee4bcff6c68b577c43e5e0ac", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 912 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "40cd542c0f98abe6dd5bb5ba", "attempt_id": "e9c3e7f5cc37", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:21.390898Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1994, "keep": 498, "window_tokens": 37, "compress_ms": 90.83299990743399}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 37, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 18358272, "serialized_payload_bytes": 18374355, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1358.4033750230446, "doc_prefill_ms": 342.4286670051515, "compress_ms": 1010.7291659805924, "serialize_ms": 4.949791938997805, "load_ms": 1.2420000275596976, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.30258403811604, "ttft_ms": 37.30258403811604, "decode_ms": 11.77258393727243}, "total_wall_ms": 1411.920916987583, "ttft_ms": 37.30258403811604, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10637017088, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9367751912, "mlx_cache_bytes": 7410737407, "process_rss_bytes": 10637017088}, "peak_prefill_memory": 10017844220, "peak_decode_memory": 9367751912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0ca0160d5361cd002bbbcb004e5c037778ebb4ecee4bcff6c68b577c43e5e0ac", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 913 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4746989e579202579db648d3", "attempt_id": "90e902c9d7d1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:22.864636Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5878, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2207.5419169850647, "ttft_ms": 12.74045801255852, "decode_ms": 123.08516702614725}, "total_wall_ms": 2354.28700002376, "ttft_ms": 12.74045801255852, "input_usage": {"receiver_prompt_tokens": 5878}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453106688, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1681634744, "process_rss_bytes": 10453106688}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LN-61Q-3728", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "ef901814745008edf2ec5687bf33a1367f91f4a50b08b07aa3f7be18d335de51"} | ||||
| 914 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f20c0e9b966802ebce746631", "attempt_id": "1df1f0e9f6b8", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:25.246240Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5883, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.166957897134, "ttft_ms": 12.546707992441952, "decode_ms": 136.62870798725635}, "total_wall_ms": 2362.564417067915, "ttft_ms": 12.546707992441952, "input_usage": {"receiver_prompt_tokens": 5883}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10453139456, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2466543032, "process_rss_bytes": 10453139456}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 502-G, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "f875bf760b38e9eee1302688e35c851f74a65d75da0ff569bbff799692ee9d04"} | ||||
| 915 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1b67a4c3b9b1622e5e9a089d", "attempt_id": "db101eb0e8b1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:27.635567Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5882, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2199.961374979466, "ttft_ms": 12.51487503759563, "decode_ms": 87.202874943614}, "total_wall_ms": 2310.679457965307, "ttft_ms": 12.51487503759563, "input_usage": {"receiver_prompt_tokens": 5882}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453155840, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2466543032, "process_rss_bytes": 10453155840}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "59.8187", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "f441a18fa0cc1d7c0b4731dccaac17dcd267de0084e2027ae8c8f6c847b37ca6"} | ||||
| 916 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8b5cf77cd37fd12d689f6689", "attempt_id": "0ffdeaa292c1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:29.972301Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5880, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.593540958129, "ttft_ms": 12.712042080238461, "decode_ms": 49.566375091671944}, "total_wall_ms": 2274.9527089763433, "ttft_ms": 12.712042080238461, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 10453188608, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2780591544, "process_rss_bytes": 10453188608}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Petrakis", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "44f5f881779841802a8bed10a39ab27bfb1b15f14b9c8c04f1549dda7db316e8"} | ||||
| 917 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c8ddf1839c94523fa239a8eb", "attempt_id": "bc79f5516696", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:32.273024Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5887, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.1228329502046, "ttft_ms": 12.550999992527068, "decode_ms": 87.4991660239175}, "total_wall_ms": 2312.2485000640154, "ttft_ms": 12.550999992527068, "input_usage": {"receiver_prompt_tokens": 5887}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453221376, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3308811704, "process_rss_bytes": 10453221376}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549.950", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "cab784b9a3b9aa92b5218ac427b87c725bb99e22c3af34061c9cf715ac2eedec"} | ||||
| 918 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9c122483fb326dae585c2e00", "attempt_id": "c8cb6b15c4df", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:34.611459Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5888, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.2578749563545, "ttft_ms": 12.471415917389095, "decode_ms": 123.77629103139043}, "total_wall_ms": 2348.3687499538064, "ttft_ms": 12.471415917389095, "input_usage": {"receiver_prompt_tokens": 5888}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453254144, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3624302008, "process_rss_bytes": 10453254144}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 919 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a87ea68c637511316cb9726c", "attempt_id": "ffa099fad5b6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:36.985634Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5880, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.0291250189766, "ttft_ms": 12.47412501834333, "decode_ms": 12.357208062894642}, "total_wall_ms": 2237.108665984124, "ttft_ms": 12.47412501834333, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453270528, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3624302008, "process_rss_bytes": 10453270528}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 920 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cc774ee70ac20c0ff4445cb9", "attempt_id": "7f6138b9da24", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:39.248930Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5880, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2199.950124952011, "ttft_ms": 12.575124972499907, "decode_ms": 12.368916999548674}, "total_wall_ms": 2236.0562920803204, "ttft_ms": 12.575124972499907, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453303296, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3624302008, "process_rss_bytes": 10453303296}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 921 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "776e00d4d01c9d53355836dd", "attempt_id": "0385de4b117f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:46.379703Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 232.1114999940619, "ttft_ms": 12.035874999128282, "decode_ms": 11.914792004972696}, "total_wall_ms": 257.55908293649554, "ttft_ms": 12.035874999128282, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453352448, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 5548922296, "process_rss_bytes": 10453352448}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 922 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8ff8cee7b3c60fb2329ddb8b", "attempt_id": "495cf1e1db8a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:46.665678Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.29225002694875, "ttft_ms": 11.89066597726196, "decode_ms": 11.842916952446103}, "total_wall_ms": 252.2642919793725, "ttft_ms": 11.89066597726196, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453368832, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567000664, "mlx_cache_bytes": 5823485368, "process_rss_bytes": 10453368832}, "peak_prefill_memory": null, "peak_decode_memory": 9567000664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 923 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3d4699c37664de5f74c509f2", "attempt_id": "b9bb57f2e377", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:46.943531Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.73466603737324, "ttft_ms": 11.922333971597254, "decode_ms": 11.880125035531819}, "total_wall_ms": 251.7752090934664, "ttft_ms": 11.922333971597254, "input_usage": {"receiver_prompt_tokens": 595, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453368832, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567000664, "mlx_cache_bytes": 5823485368, "process_rss_bytes": 10453368832}, "peak_prefill_memory": null, "peak_decode_memory": 9567000664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 924 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3bd20b4d5fe706926a4b5767", "attempt_id": "c034bf373e63", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:47.221151Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.76491597667336, "ttft_ms": 11.9376250077039, "decode_ms": 47.19083395320922}, "total_wall_ms": 287.1247089933604, "ttft_ms": 11.9376250077039, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 10453385216, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 5979985336, "process_rss_bytes": 10453385216}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Petrakis", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "44f5f881779841802a8bed10a39ab27bfb1b15f14b9c8c04f1549dda7db316e8"} | ||||
| 925 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7c109ba9226d240cc17bab54", "attempt_id": "23dc0dec6e10", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:47.533993Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.3290839511901, "ttft_ms": 11.921041994355619, "decode_ms": 11.916041024960577}, "total_wall_ms": 252.4111249949783, "ttft_ms": 11.921041994355619, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453401600, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 6241473976, "process_rss_bytes": 10453401600}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 926 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "96c4bd340a03f8c53c029c49", "attempt_id": "e305a28a889d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:47.811556Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.1412080153823, "ttft_ms": 11.949416948482394, "decode_ms": 11.857792036607862}, "total_wall_ms": 252.20975000411272, "ttft_ms": 11.949416948482394, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453417984, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9569065048, "mlx_cache_bytes": 6400136632, "process_rss_bytes": 10453417984}, "peak_prefill_memory": null, "peak_decode_memory": 9569065048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 927 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61aa2f7b19525b96eba316d2", "attempt_id": "2daea4891d49", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:48.089580Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.43733292352408, "ttft_ms": 11.966584017500281, "decode_ms": 11.888125096447766}, "total_wall_ms": 251.44758296664804, "ttft_ms": 11.966584017500281, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453417984, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 6400136632, "process_rss_bytes": 10453417984}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 928 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "903edea37ad224651607b09b", "attempt_id": "4a28636cd270", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:48.366002Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 2460, "cache_tensor_bytes": null, "serialized_payload_bytes": 2460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4868.8990420196205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.63937497418374, "ttft_ms": 11.880584061145782, "decode_ms": 11.896083946339786}, "total_wall_ms": 251.63083302322775, "ttft_ms": 11.880584061145782, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5920, "sender_output_tokens": 512, "sender_prefill_ms": 1116.6574999224395, "sender_ttft_ms": 7.411541999317706, "sender_decode_ms": 3739.3691249890253}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453434368, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 6400136632, "process_rss_bytes": 10453434368}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c4a585b0b7de7e1a89bcc071a64850edfcf78b9cdd3d15ed90ac81f95ab705c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 929 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "462043fdc36aafd56aad1538", "attempt_id": "f75481d9ec52", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:53.541979Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 413, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 168.4815000044182, "ttft_ms": 11.874624993652105, "decode_ms": 116.80858302861452}, "total_wall_ms": 298.1772079365328, "ttft_ms": 11.874624993652105, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9528219772, "mlx_cache_bytes": 7339578808, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9528219772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LN-61Q-3728", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "ef901814745008edf2ec5687bf33a1367f91f4a50b08b07aa3f7be18d335de51"} | ||||
| 930 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3a64153fa4f51626e87329fb", "attempt_id": "f226319506cc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:53.866432Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 418, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.81533395219594, "ttft_ms": 11.991666979156435, "decode_ms": 12.018000008538365}, "total_wall_ms": 190.9239999949932, "ttft_ms": 11.991666979156435, "input_usage": {"receiver_prompt_tokens": 418, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9532463228, "mlx_cache_bytes": 7604098488, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9532463228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 931 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "99de511e0b95fd311d6aa810", "attempt_id": "f1da05b4b9a3", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:54.085725Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 417, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 164.4947089953348, "ttft_ms": 12.034833896905184, "decode_ms": 11.875375057570636}, "total_wall_ms": 189.44266706239432, "ttft_ms": 12.034833896905184, "input_usage": {"receiver_prompt_tokens": 417, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9531316348, "mlx_cache_bytes": 7750636984, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9531316348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 932 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "19f7f299139bf46c320a3433", "attempt_id": "a84eab3c2eaa", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:54.302402Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 415, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 162.9860419780016, "ttft_ms": 12.045959010720253, "decode_ms": 11.819582898169756}, "total_wall_ms": 187.82462505623698, "ttft_ms": 12.045959010720253, "input_usage": {"receiver_prompt_tokens": 415, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9549535356, "mlx_cache_bytes": 7918802360, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9549535356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 933 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "02d25796f5a578e08fab6bb6", "attempt_id": "69a2d3aaf14f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:54.517161Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 422, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.4857499524951, "ttft_ms": 12.013166910037398, "decode_ms": 11.862165993079543}, "total_wall_ms": 190.44879206921905, "ttft_ms": 12.013166910037398, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9534625916, "mlx_cache_bytes": 8166167992, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9534625916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 934 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dfd10cc6c8d180182c4a467d", "attempt_id": "b9640782ac22", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:54.735505Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 423, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.86820897646248, "ttft_ms": 11.86979201156646, "decode_ms": 11.782167013734579}, "total_wall_ms": 190.44699997175485, "ttft_ms": 11.86979201156646, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9535117436, "mlx_cache_bytes": 8315065784, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9535117436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 935 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "548b21c765600f446d63af0d", "attempt_id": "1f24293f9bc2", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:54.952031Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 415, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.2439170498401, "ttft_ms": 11.68395800050348, "decode_ms": 11.762124951928854}, "total_wall_ms": 187.57762492168695, "ttft_ms": 11.68395800050348, "input_usage": {"receiver_prompt_tokens": 415, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9551255676, "mlx_cache_bytes": 8315065784, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9551255676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 936 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0198efdcf34254810533a518", "attempt_id": "069e51e781c2", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:55.165073Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 415, "message_tokens": 324, "message_utf8_bytes": 785, "cache_tensor_bytes": null, "serialized_payload_bytes": 785, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4898.852708982304, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.97937503643334, "ttft_ms": 12.011583079583943, "decode_ms": 11.97758293710649}, "total_wall_ms": 188.9705000212416, "ttft_ms": 12.011583079583943, "input_usage": {"receiver_prompt_tokens": 415, "sender_input_tokens": 5948, "sender_output_tokens": 512, "sender_prefill_ms": 1120.0642080511898, "sender_ttft_ms": 23.11058307532221, "sender_decode_ms": 3750.0721249962226}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9551255676, "mlx_cache_bytes": 8315065784, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9551255676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2b7c7417e7b6310fd294a6da2435c3fbc16bdb6d2b7ce9453c8b4a36ba884a81", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 937 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c6b8c9ff90768f6a94450a3a", "attempt_id": "c80bd1591afe", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:56.559606Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 35, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 5.165417096577585, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.63758292235434, "ttft_ms": 75.63758292235434, "decode_ms": 631.2203749548644}, "total_wall_ms": 718.0562079884112, "ttft_ms": 75.63758292235434, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884792320, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9796865228, "mlx_cache_bytes": 9416170394, "process_rss_bytes": 10884792320}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9796865228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Noleate: 1nj-9, nothingismam沦ervers: 1booms:的解脲放微距 Supervisor � � � � � � � 承高群桩型腔似的子： 1:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "c183bc1f4375218864742aa8ea7f41c1e525bf94b5ac77a82dbd0427c0956525"} | ||||
| 938 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1ac95a66ab564d41071bbf84", "attempt_id": "b4304c687fbd", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:57.304881Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 40, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 1.7607079353183508, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.84466703701764, "ttft_ms": 75.84466703701764, "decode_ms": 630.4374580504373}, "total_wall_ms": 713.4742079069838, "ttft_ms": 75.84466703701764, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884792320, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9804926176, "mlx_cache_bytes": 9483050202, "process_rss_bytes": 10884792320}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9804926176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "True NIM (agreement push (i.e., 2.0): \" most certainly, exactly, if (unfortunately, you-1: a single code: ganguasomatone (i.e.,ideation, look", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "c24c69a42bb61793422846cf74bf85c2cd12c5802c455a8f174e52614e45fb02"} | ||||
| 939 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bb6786fdb83c354c1a9e15bd", "attempt_id": "ef6744f3dd72", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:58.044652Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 39, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 1.7202500021085143, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.56658303271979, "ttft_ms": 74.56658303271979, "decode_ms": 631.2128340359777}, "total_wall_ms": 712.7982079982758, "ttft_ms": 74.56658303271979, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884808704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9803746528, "mlx_cache_bytes": 9515360971, "process_rss_bytes": 10884808704}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9803746528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "&) a.&).. Exp (quatevoiceloac. :\n ::est_1.#### conscience: \"if (ch (1, \"L)bipsum-igenic: 1:ditaries: i.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "64200b9ef8ba84ad855de7158466c5b1e9aa506ec279093d5fa802822c2c5933"} | ||||
| 940 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0f8e12bf3765a8125b383433", "attempt_id": "bce2bce9eec4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:58.784300Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 1.8246250692754984, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.375332984142, "ttft_ms": 73.375332984142, "decode_ms": 631.2837080331519}, "total_wall_ms": 712.115874979645, "ttft_ms": 73.375332984142, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884808704, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9800355040, "mlx_cache_bytes": 9549423307, "process_rss_bytes": 10884808704}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9800355040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "在地名: a.##\n ,\n在quiring:1:不要的oemp,�公报文凭就便四向能登月球速到嘴上的我尚措替下，我老方程子：1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "336968e9a200e2eb50aa2b60f2c5f64ded81e480926de971c22397d5b719b5ac"} | ||||
| 941 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4311b8ab4a318613a2c05e7c", "attempt_id": "030c5bb34802", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:35:59.524879Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 44, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 1.7414160538464785, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.79612491745502, "ttft_ms": 71.79612491745502, "decode_ms": 630.6343749165535}, "total_wall_ms": 709.6946670208126, "ttft_ms": 71.79612491745502, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884825088, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9811938544, "mlx_cache_bytes": 9629000747, "process_rss_bytes": 10884825088}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9811938544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "@ (n: 1王中所向学紀为先:2, a的份 學耘來宾服装饰方程, 1千面, 100:1, \"/\"的，都得", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "b52ac8303472373b8f420ff9a5b4e1f9218cc28c453a1db32c17a72d8d8d0875"} | ||||
| 942 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "019a97ca9edf7f2cdc1ea04e", "attempt_id": "034facb92f7c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:00.261793Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 1.7471670871600509, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.18645794596523, "ttft_ms": 70.18645794596523, "decode_ms": 632.0202910574153}, "total_wall_ms": 709.507624967955, "ttft_ms": 70.18645794596523, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884825088, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9815919860, "mlx_cache_bytes": 9701893523, "process_rss_bytes": 10884825088}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9815919860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "&!exasame in the mostotherein the navelie (atp, \"FA of16: keepers, please's line])[ Verified Form: \"Linguoties: 3, \"eloide\"Push", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "f5284bd96b17ec8b60735312fe7d99b482bc0b8a82af047840619432b459aa9c"} | ||||
| 943 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fb34eedffdd18e424c9dfadf", "attempt_id": "24dc342a1cc4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:00.997412Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 1.7626670887693763, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.57966701965779, "ttft_ms": 73.57966701965779, "decode_ms": 631.3935000216588}, "total_wall_ms": 712.3406250029802, "ttft_ms": 73.57966701965779, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884825088, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9800355040, "mlx_cache_bytes": 9701893523, "process_rss_bytes": 10884825088}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9800355040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "将括子代理学,用法的当生力學士们でも,考而大翻片語babel:5. \"一編碼師,2G.managed Information)을 \"방眼看� Thrones\n八股編", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "5b32cf35995994c4017b47a181e2cd29c06592915f9bdd0a54d69855f0adc1e6"} | ||||
| 944 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fadc4cb44854fab76b6a8cfa", "attempt_id": "b6ceb591ec20", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:01.736144Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412542, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1178.2405000412837, "doc_prefill_ms": 1104.4214580906555, "compress_ms": 12.975375051610172, "serialize_ms": 49.15091604925692, "load_ms": 1.1565000750124454, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.74641695059836, "ttft_ms": 73.74641695059836, "decode_ms": 629.729041014798}, "total_wall_ms": 710.4324999963865, "ttft_ms": 73.74641695059836, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884825088, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9800355040, "mlx_cache_bytes": 9701893523, "process_rss_bytes": 10884825088}, "peak_prefill_memory": 10054470744, "peak_decode_memory": 9800355040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "怎么样，也括布德雷德宠蒙面相册編排好不好听之大師，也，你說，那，我也緊援軟abel,一括號方舟，客串，小大法網林", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "daf09620cc0a06b9fdcd95c241b3c6d3ebdbef19f1f7ea2af4c74bc3966a8533", "output_hash": "103e8dea511c019dfe70d1ce66b7f1b02d7daaaf3913f7d90feb734d3bca870c"} | ||||
| 945 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "255fa6ff4353bdcdf5ea5981", "attempt_id": "57fa11593418", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:05.756252Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 35, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.7074169591069221, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.53741589840502, "ttft_ms": 77.53741589840502, "decode_ms": 13.672417029738426}, "total_wall_ms": 98.37141598109156, "ttft_ms": 77.53741589840502, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9796603084, "mlx_cache_bytes": 9785173395, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9796603084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 946 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ea68be178906c8e8bd2d1170", "attempt_id": "d55ac5c67dd6", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:05.882563Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 40, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.7781250644475222, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.56870894040912, "ttft_ms": 75.56870894040912, "decode_ms": 13.505541952326894}, "total_wall_ms": 96.2477499851957, "ttft_ms": 75.56870894040912, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9804664032, "mlx_cache_bytes": 9785173395, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9804664032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 947 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f355badaedfb02d187197cce", "attempt_id": "7ef45949cefb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:06.005090Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 39, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.824042061343789, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.82774993311614, "ttft_ms": 73.82774993311614, "decode_ms": 13.559167040511966}, "total_wall_ms": 94.35754199512303, "ttft_ms": 73.82774993311614, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9803484384, "mlx_cache_bytes": 9785173395, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9803484384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 948 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cd643be170b06e65b9a13f4a", "attempt_id": "3fe5fbb4f612", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:06.124704Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.6517919721081853, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.53762502316386, "ttft_ms": 73.53762502316386, "decode_ms": 13.612624956294894}, "total_wall_ms": 94.29083403665572, "ttft_ms": 73.53762502316386, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9800092896, "mlx_cache_bytes": 9785173395, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9800092896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 949 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2903fdf26d9bbffdcf64cd43", "attempt_id": "dda496af560f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:06.244702Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 44, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.7586670583114028, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.97733300179243, "ttft_ms": 70.97733300179243, "decode_ms": 13.521082932129502}, "total_wall_ms": 91.43420797772706, "ttft_ms": 70.97733300179243, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9811676400, "mlx_cache_bytes": 9785173395, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9811676400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 950 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e97cda3ed3b3041e5b9eaaf2", "attempt_id": "aa7f31d2a1d5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:06.361109Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.7226249910891056, "receiver_prefill_ms": 0.0, "query_prefill_ms": 68.84787499438971, "ttft_ms": 68.84787499438971, "decode_ms": 13.755750027485192}, "total_wall_ms": 89.70925002358854, "ttft_ms": 68.84787499438971, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9815444724, "mlx_cache_bytes": 9783993747, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9815444724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 951 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3095bab7ed0ccf6b06f8b62b", "attempt_id": "764d53ef3dcf", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:06.476816Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.8755000783130527, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.32641596440226, "ttft_ms": 73.32641596440226, "decode_ms": 13.47933302167803}, "total_wall_ms": 95.02395801246166, "ttft_ms": 73.32641596440226, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9800092896, "mlx_cache_bytes": 9785173395, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9800092896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 952 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0a31d74f704ebcc659f53e18", "attempt_id": "173fca014cdc", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:06.598962Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 215396352, "serialized_payload_bytes": 215412643, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3278.3439580816776, "doc_prefill_ms": 1102.1362909814343, "compress_ms": 2113.6733340099454, "serialize_ms": 62.226542038843036, "load_ms": 1.8199170008301735, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.39929195586592, "ttft_ms": 73.39929195586592, "decode_ms": 13.539417064748704}, "total_wall_ms": 94.15191598236561, "ttft_ms": 73.39929195586592, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075469312, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9800092896, "mlx_cache_bytes": 9785173395, "process_rss_bytes": 11075469312}, "peak_prefill_memory": 10054372440, "peak_decode_memory": 9800092896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3a481a24aec812a3cdf13d3260c0101e800d4f9b1c10c0d9d961cbd3336a3115", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 953 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eed2ede3d42c7ebafba08ecb", "attempt_id": "182aa8f44710", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:06.719763Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 35, "compress_ms": 119.09879103768617}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 35, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3346.1004580603912, "doc_prefill_ms": 1102.5450410088524, "compress_ms": 2224.8474579537287, "serialize_ms": 18.343999981880188, "load_ms": 1.7541670240461826, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.46079199947417, "ttft_ms": 42.46079199947417, "decode_ms": 12.276832945644855}, "total_wall_ms": 3412.30612504296, "ttft_ms": 42.46079199947417, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10987175936, "backend_memory": {"mlx_active_bytes": 9369930760, "mlx_peak_bytes": 9442823372, "mlx_cache_bytes": 10299851115, "process_rss_bytes": 10987175936}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9442823372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 954 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4c8cb2a85074918d39f008dd", "attempt_id": "dcf1a3acfce6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:10.158181Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 40, "compress_ms": 124.88270900212228}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 40, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3384.9142090184614, "doc_prefill_ms": 1103.7177920807153, "compress_ms": 2266.332415980287, "serialize_ms": 14.503458980470896, "load_ms": 1.336958957836032, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.33420894201845, "ttft_ms": 44.33420894201845, "decode_ms": 122.40412505343556}, "total_wall_ms": 3560.781709034927, "ttft_ms": 44.33420894201845, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 40}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 11041472512, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9450884320, "mlx_cache_bytes": 10356031851, "process_rss_bytes": 11041472512}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9450884320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 502-G, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "30a393596c710b60f63da75f364bb6f8c77afd1235d7b6311d6a4a598aeb17b3"} | ||||
| 955 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a1a47b15641bf5554998755f", "attempt_id": "4e24fa5e5da2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:13.746820Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 39, "compress_ms": 125.42004103306681}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 39, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3368.5781670501456, "doc_prefill_ms": 1104.8012500395998, "compress_ms": 2250.099040917121, "serialize_ms": 13.314708019606769, "load_ms": 1.328374957665801, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.308958993293345, "ttft_ms": 43.308958993293345, "decode_ms": 12.498083990067244}, "total_wall_ms": 3434.1357079101726, "ttft_ms": 43.308958993293345, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041505280, "backend_memory": {"mlx_active_bytes": 9369881608, "mlx_peak_bytes": 9449704672, "mlx_cache_bytes": 10373497195, "process_rss_bytes": 11041505280}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9449704672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 956 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b2290e71e2900e06d2a849c8", "attempt_id": "fd06a9b8f698", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:17.208955Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 37, "compress_ms": 124.47204196359962}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.91583389882, "doc_prefill_ms": 1104.0454579051584, "compress_ms": 2243.1135409278795, "serialize_ms": 14.404332963749766, "load_ms": 1.3075830647721887, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.6732919877395, "ttft_ms": 42.6732919877395, "decode_ms": 12.38229195587337}, "total_wall_ms": 3426.485375035554, "ttft_ms": 42.6732919877395, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041505280, "backend_memory": {"mlx_active_bytes": 9369881608, "mlx_peak_bytes": 9446313184, "mlx_cache_bytes": 10406560107, "process_rss_bytes": 11041505280}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9446313184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 957 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ff96fa4e0d01ad0d67bc0a96", "attempt_id": "f1d8a7f9d968", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:20.663574Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 44, "compress_ms": 121.47362495306879}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 44, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3351.8249168992043, "doc_prefill_ms": 1103.0097919283435, "compress_ms": 2233.6943339323625, "serialize_ms": 14.748584013432264, "load_ms": 1.2985829962417483, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.90050005167723, "ttft_ms": 43.90050005167723, "decode_ms": 12.245582998730242}, "total_wall_ms": 3417.046374990605, "ttft_ms": 43.90050005167723, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041521664, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9458240752, "mlx_cache_bytes": 10443882859, "process_rss_bytes": 11041521664}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9458240752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 958 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bd7812cf62caca657f37b339", "attempt_id": "273e649e096f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:24.109528Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 45, "compress_ms": 123.09474998619407}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3345.6743330461904, "doc_prefill_ms": 1103.1633330276236, "compress_ms": 2227.646084036678, "serialize_ms": 14.486707979813218, "load_ms": 1.2885419419035316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.51516701374203, "ttft_ms": 44.51516701374203, "decode_ms": 12.424999964423478}, "total_wall_ms": 3411.8299590190873, "ttft_ms": 44.51516701374203, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041554432, "backend_memory": {"mlx_active_bytes": 9370192904, "mlx_peak_bytes": 9460829428, "mlx_cache_bytes": 10481828203, "process_rss_bytes": 11041554432}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9460829428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 959 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "015c3d9c915de9e540be08f2", "attempt_id": "39e2843a3471", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:27.549017Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 37, "compress_ms": 122.69650003872812}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3359.7153750015423, "doc_prefill_ms": 1104.5762079302222, "compress_ms": 2240.2094999561086, "serialize_ms": 14.566333033144474, "load_ms": 1.3289580820128322, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.88700001779944, "ttft_ms": 42.88700001779944, "decode_ms": 12.376583996228874}, "total_wall_ms": 3424.0647080587223, "ttft_ms": 42.88700001779944, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041570816, "backend_memory": {"mlx_active_bytes": 9369881608, "mlx_peak_bytes": 9446313184, "mlx_cache_bytes": 10482139499, "process_rss_bytes": 11041570816}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9446313184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 960 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "38b0ecacfcd5ee299f63e838", "attempt_id": "d2f479bd5ed5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:31.000593Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5843, "keep": 1461, "window_tokens": 37, "compress_ms": 122.94216605369002}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3365.2304999995977, "doc_prefill_ms": 1104.5909590320662, "compress_ms": 2246.0026670014486, "serialize_ms": 14.27566702477634, "load_ms": 1.2964580673724413, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.16891694907099, "ttft_ms": 43.16891694907099, "decode_ms": 12.239624978974462}, "total_wall_ms": 3429.5975420391187, "ttft_ms": 43.16891694907099, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041570816, "backend_memory": {"mlx_active_bytes": 9369881608, "mlx_peak_bytes": 9446313184, "mlx_cache_bytes": 10482139499, "process_rss_bytes": 11041570816}, "peak_prefill_memory": 10054339672, "peak_decode_memory": 9446313184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 961 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4e3c2666adf6bf7c738d218e", "attempt_id": "2a1ff9d8e290", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:34.501635Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2024, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 698.9019169704989, "ttft_ms": 12.44154095184058, "decode_ms": 120.28649996500462}, "total_wall_ms": 835.3155830409378, "ttft_ms": 12.44154095184058, "input_usage": {"receiver_prompt_tokens": 2024}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10488594432, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9975262172, "mlx_cache_bytes": 724358484, "process_rss_bytes": 10488594432}, "peak_prefill_memory": null, "peak_decode_memory": 9975262172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SA-99X-5582", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "418e2d2419844e55a0e0d5a5f62c9bf90dbe137bd83c679e009533943498d1a0"} | ||||
| 962 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "87d66423cc4d8b4bc208b304", "attempt_id": "65e78058351b", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:35.356874Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2029, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.7069590464234, "ttft_ms": 12.195290997624397, "decode_ms": 132.01220892369747}, "total_wall_ms": 844.3960419390351, "ttft_ms": 12.195290997624397, "input_usage": {"receiver_prompt_tokens": 2029}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10488627200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9976785984, "mlx_cache_bytes": 1355846996, "process_rss_bytes": 10488627200}, "peak_prefill_memory": null, "peak_decode_memory": 9976785984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 503-T, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "e7daab1d3d52ee9bc0b550370d3581323f3b8751988b7c63e74cabfbbb3320eb"} | ||||
| 963 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "743b1d1543b7add88e210bdb", "attempt_id": "e4df6813c5e6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:36.220501Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2027, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 693.977874936536, "ttft_ms": 12.063750065863132, "decode_ms": 71.85445795767009}, "total_wall_ms": 781.1044580303133, "ttft_ms": 12.063750065863132, "input_usage": {"receiver_prompt_tokens": 2027}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10488627200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9976392768, "mlx_cache_bytes": 1712756052, "process_rss_bytes": 10488627200}, "peak_prefill_memory": null, "peak_decode_memory": 9976392768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4.8545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "beffe6995df261b8edc94ba7a8714c75e4da1e041c720374d646d8785fe5641e"} | ||||
| 964 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bd4f01e80a6c550369bd770c", "attempt_id": "3782d0d9c93a", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:37.019263Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2024, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.5672080619261, "ttft_ms": 12.27354200091213, "decode_ms": 71.88229099847376}, "total_wall_ms": 782.3113329941407, "ttft_ms": 12.27354200091213, "input_usage": {"receiver_prompt_tokens": 2024}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10488627200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9975262172, "mlx_cache_bytes": 1712756052, "process_rss_bytes": 10488627200}, "peak_prefill_memory": null, "peak_decode_memory": 9975262172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "5ca17fb7c0572a4d8bdf0553d246da8b09a69151cf9bbab90a1d2f650e36cdea"} | ||||
| 965 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8abe0923fd86f50eaebb5477", "attempt_id": "09bc3b38c2a7", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:37.819477Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2032, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.3769169738516, "ttft_ms": 12.34749995637685, "decode_ms": 84.26999999210238}, "total_wall_ms": 794.7842499706894, "ttft_ms": 12.34749995637685, "input_usage": {"receiver_prompt_tokens": 2032}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10488659968, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9977785408, "mlx_cache_bytes": 2311951700, "process_rss_bytes": 10488659968}, "peak_prefill_memory": null, "peak_decode_memory": 9977785408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "728,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "82227082dcc4ba6a2aefa1ee337cd55859ad3bd42a50654a896be5f8dd31734d"} | ||||
| 966 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a46aa19d5cd9e0099c9d8732", "attempt_id": "6a6ff6ae547b", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:38.632124Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2035, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.4834580430761, "ttft_ms": 12.258041999302804, "decode_ms": 120.0307080289349}, "total_wall_ms": 832.2742499876767, "ttft_ms": 12.258041999302804, "input_usage": {"receiver_prompt_tokens": 2035}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10488627200, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9978915904, "mlx_cache_bytes": 2945570132, "process_rss_bytes": 10488627200}, "peak_prefill_memory": null, "peak_decode_memory": 9978915904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PX-35X-6550", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "bd14582c6a2e29f22b9971b6065c122ee9f5470375dc27a8616f788a0eae5587"} | ||||
| 967 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "83c42499da42e7cde8338d15", "attempt_id": "56c36cc4c1a4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:39.483486Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2026, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.6588329738006, "ttft_ms": 12.291166931390762, "decode_ms": 12.131833005696535}, "total_wall_ms": 722.6274170679972, "ttft_ms": 12.291166931390762, "input_usage": {"receiver_prompt_tokens": 2026}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488659968, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9976392768, "mlx_cache_bytes": 2945570132, "process_rss_bytes": 10488659968}, "peak_prefill_memory": null, "peak_decode_memory": 9976392768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 968 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "518fa8cab7d1c44ddae17850", "attempt_id": "d3653a425b19", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:40.224368Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2023, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01037493348121643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 694.7874999605119, "ttft_ms": 12.384457979351282, "decode_ms": 12.129999930039048}, "total_wall_ms": 722.9502080008388, "ttft_ms": 12.384457979351282, "input_usage": {"receiver_prompt_tokens": 2023}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488659968, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9975262172, "mlx_cache_bytes": 2945570132, "process_rss_bytes": 10488659968}, "peak_prefill_memory": null, "peak_decode_memory": 9975262172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 969 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a73b826b8a67ba68ef2896d8", "attempt_id": "eb3892255d5c", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:44.976280Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.62683402188122, "ttft_ms": 12.11895898450166, "decode_ms": 119.0457500051707}, "total_wall_ms": 364.00962492916733, "ttft_ms": 12.11895898450166, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10488758272, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 4115892628, "process_rss_bytes": 10488758272}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BF-57Y-4991", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "6ea75693c552038b0190c77b1429f7357f64690ac36224c6bcd5694fd19c6e39"} | ||||
| 970 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5f040e33754b949be7e127e6", "attempt_id": "14f921608356", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:45.358535Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.20066702459008, "ttft_ms": 11.950707994401455, "decode_ms": 11.857375036925077}, "total_wall_ms": 252.1564170019701, "ttft_ms": 11.950707994401455, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488774656, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567000664, "mlx_cache_bytes": 4390455700, "process_rss_bytes": 10488774656}, "peak_prefill_memory": null, "peak_decode_memory": 9567000664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 971 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ac1598baa2035d32529cc2fc", "attempt_id": "bd775afb9cd5", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:45.628907Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.69779194984585, "ttft_ms": 11.878125020302832, "decode_ms": 11.858875048346817}, "total_wall_ms": 251.52195792179555, "ttft_ms": 11.878125020302832, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488774656, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566410840, "mlx_cache_bytes": 4547152276, "process_rss_bytes": 10488774656}, "peak_prefill_memory": null, "peak_decode_memory": 9566410840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 972 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "df1ca5ac8bd5e2a57a06fbe2", "attempt_id": "95b048c07946", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:45.898623Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.59908304922283, "ttft_ms": 12.108749942854047, "decode_ms": 12.011750019155443}, "total_wall_ms": 251.99270900338888, "ttft_ms": 12.108749942854047, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488791040, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 4547152276, "process_rss_bytes": 10488791040}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 973 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ffbe0dc9cd731afb9f7f95d6", "attempt_id": "fca2ca283046", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:46.168664Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.1248330362141, "ttft_ms": 11.962958029471338, "decode_ms": 82.80670805834234}, "total_wall_ms": 323.00933299120516, "ttft_ms": 11.962958029471338, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10488807424, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568475224, "mlx_cache_bytes": 4808444308, "process_rss_bytes": 10488807424}, "peak_prefill_memory": null, "peak_decode_memory": 9568475224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "728,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "82227082dcc4ba6a2aefa1ee337cd55859ad3bd42a50654a896be5f8dd31734d"} | ||||
| 974 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e333412da99a74965d3ddc3c", "attempt_id": "918533b7a59f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:46.510147Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.1132500609383, "ttft_ms": 11.989457998424768, "decode_ms": 119.16362505871803}, "total_wall_ms": 359.4801250146702, "ttft_ms": 11.989457998424768, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10488823808, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570146392, "mlx_cache_bytes": 5086153108, "process_rss_bytes": 10488823808}, "peak_prefill_memory": null, "peak_decode_memory": 9570146392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BF-57Y-4991", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "6ea75693c552038b0190c77b1429f7357f64690ac36224c6bcd5694fd19c6e39"} | ||||
| 975 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "41738c85491211c7823f6dd7", "attempt_id": "fb989d67598e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:46.887258Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.43766703549773, "ttft_ms": 12.133791926316917, "decode_ms": 11.887040920555592}, "total_wall_ms": 251.68258405756205, "ttft_ms": 12.133791926316917, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488823808, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565526104, "mlx_cache_bytes": 5086153108, "process_rss_bytes": 10488823808}, "peak_prefill_memory": null, "peak_decode_memory": 9565526104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 976 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "afea0bfdc2ed58d8db2f6a4f", "attempt_id": "76adbb63b1ec", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:47.157205Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 590, "message_tokens": 512, "message_utf8_bytes": 1368, "cache_tensor_bytes": null, "serialized_payload_bytes": 1368, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4010.3126249741763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.36787500232458, "ttft_ms": 12.170500005595386, "decode_ms": 11.944749974645674}, "total_wall_ms": 251.77904195152223, "ttft_ms": 12.170500005595386, "input_usage": {"receiver_prompt_tokens": 590, "sender_input_tokens": 2065, "sender_output_tokens": 512, "sender_prefill_ms": 380.6895000161603, "sender_ttft_ms": 7.313500042073429, "sender_decode_ms": 3620.1748750172555}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488840192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 5086153108, "process_rss_bytes": 10488840192}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d45c8943b5f32cb84dd081c1f669a245415032feca3592f7987cd2d5d972e904", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 977 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e724f7b664898e1cc34ecf46", "attempt_id": "64ddaebdbf89", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:51.022070Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 360, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.0998750301078, "ttft_ms": 11.903416947461665, "decode_ms": 70.27350005228072}, "total_wall_ms": 230.18858302384615, "ttft_ms": 11.903416947461665, "input_usage": {"receiver_prompt_tokens": 360, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10488840192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9496400408, "mlx_cache_bytes": 5407092704, "process_rss_bytes": 10488840192}, "peak_prefill_memory": null, "peak_decode_memory": 9496400408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Selnakri-4", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "b4103bd7efe50daeb8913b483acc838d827d11b6501d9e0673a1ca7dfcec88bd"} | ||||
| 978 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "49526b46e092df6361c0aff9", "attempt_id": "608015825733", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:51.271127Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 365, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.98454206436872, "ttft_ms": 11.776000028476119, "decode_ms": 11.74437499139458}, "total_wall_ms": 167.3268339363858, "ttft_ms": 11.776000028476119, "input_usage": {"receiver_prompt_tokens": 365, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488856576, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9499316780, "mlx_cache_bytes": 5632587152, "process_rss_bytes": 10488856576}, "peak_prefill_memory": null, "peak_decode_memory": 9499316780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 979 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a91a52509abab7358dab139e", "attempt_id": "41334fa0c738", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:51.456799Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 363, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.88920897524804, "ttft_ms": 11.70004194136709, "decode_ms": 140.25570801459253}, "total_wall_ms": 295.6176659790799, "ttft_ms": 11.70004194136709, "input_usage": {"receiver_prompt_tokens": 363, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10488856576, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9498579500, "mlx_cache_bytes": 5760251280, "process_rss_bytes": 10488856576}, "peak_prefill_memory": null, "peak_decode_memory": 9498579500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,037,575 CHF", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "f641329a83b3b9d49067b11570ebd72e0a541aeb42e1f4679f5e79ad7d9083f5"} | ||||
| 980 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7627d3f39d6fd033c1d91066", "attempt_id": "d908641667bc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:51.770237Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 360, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.4868330359459, "ttft_ms": 11.747458018362522, "decode_ms": 11.68383308686316}, "total_wall_ms": 166.67670791503042, "ttft_ms": 11.747458018362522, "input_usage": {"receiver_prompt_tokens": 360, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488856576, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9496400408, "mlx_cache_bytes": 5760251280, "process_rss_bytes": 10488856576}, "peak_prefill_memory": null, "peak_decode_memory": 9496400408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 981 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f44b1839e778010216b76ea7", "attempt_id": "368c001d1b87", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:51.954360Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 368, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.22341601271182, "ttft_ms": 12.283708085305989, "decode_ms": 11.75329100806266}, "total_wall_ms": 167.13000007439405, "ttft_ms": 12.283708085305989, "input_usage": {"receiver_prompt_tokens": 368, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488856576, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9501233720, "mlx_cache_bytes": 5975669580, "process_rss_bytes": 10488856576}, "peak_prefill_memory": null, "peak_decode_memory": 9501233720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 982 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0d3a11de81f7538b3a4fefd3", "attempt_id": "14bfd4db5691", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:52.139681Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 371, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.17533292341977, "ttft_ms": 11.855292017571628, "decode_ms": 11.742374976165593}, "total_wall_ms": 167.64987504575402, "ttft_ms": 11.855292017571628, "input_usage": {"receiver_prompt_tokens": 371, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488856576, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503412804, "mlx_cache_bytes": 6205391124, "process_rss_bytes": 10488856576}, "peak_prefill_memory": null, "peak_decode_memory": 9503412804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 983 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a4b5206bc7822f891034bdf0", "attempt_id": "6a73654d5f04", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:52.325525Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 362, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.80279190279543, "ttft_ms": 11.748375021852553, "decode_ms": 11.786125018261373}, "total_wall_ms": 167.07891691476107, "ttft_ms": 11.748375021852553, "input_usage": {"receiver_prompt_tokens": 362, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488856576, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9498579500, "mlx_cache_bytes": 6205391124, "process_rss_bytes": 10488856576}, "peak_prefill_memory": null, "peak_decode_memory": 9498579500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 984 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d05aa3bf417b1214628c6c20", "attempt_id": "7d3c20eb919b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:52.511174Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 359, "message_tokens": 269, "message_utf8_bytes": 577, "cache_tensor_bytes": null, "serialized_payload_bytes": 577, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3592.786332941614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.26091699674726, "ttft_ms": 11.765250004827976, "decode_ms": 11.690250015817583}, "total_wall_ms": 166.4254580391571, "ttft_ms": 11.765250004827976, "input_usage": {"receiver_prompt_tokens": 359, "sender_input_tokens": 2093, "sender_output_tokens": 453, "sender_prefill_ms": 367.71687504369766, "sender_ttft_ms": 7.206125068478286, "sender_decode_ms": 3215.65120795276}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488856576, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9496400408, "mlx_cache_bytes": 6205391124, "process_rss_bytes": 10488856576}, "peak_prefill_memory": null, "peak_decode_memory": 9496400408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9df1a75451fb31590669a7fa67a4fc9de6e32909a85ea1c4f530e8913905a328", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 985 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "460b9ba925ad515aa11cc5b3", "attempt_id": "526e79d819a0", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:53.069410Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.4674169942736626, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.08454094361514, "ttft_ms": 47.08454094361514, "decode_ms": 575.9228749666363}, "total_wall_ms": 626.3517499901354, "ttft_ms": 47.08454094361514, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9410759688, "mlx_peak_bytes": 9487666384, "mlx_cache_bytes": 6992527925, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9487666384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I:relent+was oegma:put+000:the 0000年型微風雨._打不共是1001-1pasmosaic%018401", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "e6a970353b436d063520e57b208556ab473e5aa6e2ea74cf53231d19bf0d8f7b"} | ||||
| 986 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e5d65723f2987d87a3eaa96c", "attempt_id": "8a081e6f96bf", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:53.714919Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 41, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.47387501783669, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.920041997917, "ttft_ms": 48.920041997917, "decode_ms": 575.345707940869}, "total_wall_ms": 627.5283339200541, "ttft_ms": 48.920041997917, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9410759688, "mlx_peak_bytes": 9498201316, "mlx_cache_bytes": 7064601469, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9498201316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(1 �asca score(小(/B)-it’s\nhttp://always we should have been the one-coming out of the box, may be a1001-1比一1-1-1-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "2f5bfb84042b347724f6d3c4fa7b6bf382010af3d5ee0e76d828f20d320c8aaf"} | ||||
| 987 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "513977892d8b2c37258b98cd", "attempt_id": "cb2b7564617e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:54.361289Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 39, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.4148749178275466, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.81929193995893, "ttft_ms": 47.81929193995893, "decode_ms": 583.399916999042}, "total_wall_ms": 634.4447920564562, "ttft_ms": 47.81929193995893, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 39}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9410759688, "mlx_peak_bytes": 9494645988, "mlx_cache_bytes": 7136774510, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9494645988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(Iimxy_scaling==generator: bystandable knapsrara: 0_项:Walk-运动:roquebec:innenjoyooseranohnb:Soakth1:0fornousosuloc:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "ac4640389266a75957c8223d576cac1eae627b28d8a586d909de26f34fa7627f"} | ||||
| 988 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bb207a3e7fd2e7034f64abaa", "attempt_id": "6c250b00754d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:55.014112Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.4112499775364995, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.932416036725044, "ttft_ms": 46.932416036725044, "decode_ms": 576.7279580468312}, "total_wall_ms": 626.9800000591204, "ttft_ms": 46.932416036725044, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9410759688, "mlx_peak_bytes": 9487666384, "mlx_cache_bytes": 7136774510, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9487666384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "()\nLaF: wouies�irkirkvalue -style.-tiger8(中的irkischeteerudemgoseerrorso:####1beginlocoincid:In the beginningelmspapiogesslow", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "b58864ba9810cb6c63b0ac59e92dc3a46bfd15a01edf58ebacdd5279150ce4f8"} | ||||
| 989 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "565fdb69ed46409b83fc945f", "attempt_id": "fd37d5aefb78", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:55.660895Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 44, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.3473330764099956, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.74499998893589, "ttft_ms": 47.74499998893589, "decode_ms": 576.3250830350444}, "total_wall_ms": 627.3255000123754, "ttft_ms": 47.74499998893589, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9410759688, "mlx_peak_bytes": 9502166256, "mlx_cache_bytes": 7194626766, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9502166256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "pizable-objectless has been an:groumoversarapitobedtocompleteiser, the naiwan, the first queeuevocêart ofboraditiocode001:000exactly", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "dd12b29a8298b333c933d0cc93f7c6b6e90d124328135b4b7ad7e28b8c980c1b"} | ||||
| 990 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "972e1e266132cd392c8f6c84", "attempt_id": "e1edf72791a5", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:56.307165Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 47, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.4619170688092709, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.95854101050645, "ttft_ms": 48.95854101050645, "decode_ms": 575.611750013195}, "total_wall_ms": 627.839041990228, "ttft_ms": 48.95854101050645, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9411939336, "mlx_peak_bytes": 9507179772, "mlx_cache_bytes": 7340428358, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9507179772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Noo:4v2021\n\n)才-19岁(-16系统:n1.连城质\n\n!1)**\n\n,情歌�软1\n\n《1为\n\n \n\n主任必读书系列之", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "c3cc6966cee426aa093e89aea5093697f6ba1f3a99152b2f22f55b8018ecd60f"} | ||||
| 991 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b8ace11b12f1296793265d05", "attempt_id": "b2e9a5c9d11a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:56.953742Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 38, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.357666915282607, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.42066690232605, "ttft_ms": 47.42066690232605, "decode_ms": 575.2817910397425}, "total_wall_ms": 625.8497909875587, "ttft_ms": 47.42066690232605, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9410759688, "mlx_peak_bytes": 9493875940, "mlx_cache_bytes": 7375572038, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9493875940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "*)Mum: ！\nIts B:) 16 for the flesh:nouna:1/. .)pause-1111 aceptazione2http:1/$_{cosaERD1:1:1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "afd3068a63f9e5de25a784771d0f85859341c3e3d4dc0e9d7e762bd25971f15d"} | ||||
| 992 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "482ea6272588ddf23e3c9602", "attempt_id": "822e3d81fa39", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:57.597579Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9334082568}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 35, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301733, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 374.44841710384935, "doc_prefill_ms": 343.2028329698369, "compress_ms": 9.784207912161946, "serialize_ms": 17.96616695355624, "load_ms": 1.7868749564513564, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.56341706868261, "ttft_ms": 46.56341706868261, "decode_ms": 574.9326249351725}, "total_wall_ms": 625.0367501052096, "ttft_ms": 46.56341706868261, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636460032, "backend_memory": {"mlx_active_bytes": 9410759688, "mlx_peak_bytes": 9486847184, "mlx_cache_bytes": 7406865478, "process_rss_bytes": 10636460032}, "peak_prefill_memory": 9991515112, "peak_decode_memory": 9486847184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Jeepetoe- and co-to-the-game.\n- I’.\nWe are right stuff: the ‘I-“S”idesc-put\n 1 \"：然而，原来地平面上學術多項角", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5e64aff6a41b6cf9b5da74ef05089b5d5a9011ca94565dae2c9d7f3fa2579872", "output_hash": "7d8c199db3cdb1708bd9e2fbcb45f747d0da146c1c8fce58a67bc28f1f7d60c2"} | ||||
| 993 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b086c3829188092312e59039", "attempt_id": "6cae9145e925", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:59.523038Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 1.641125068999827, "receiver_prefill_ms": 0.0, "query_prefill_ms": 83.38895800989121, "ttft_ms": 83.38895800989121, "decode_ms": 12.55499990656972}, "total_wall_ms": 99.49145803693682, "ttft_ms": 83.38895800989121, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9487273168, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9487273168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 994 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e005016d8b4037a92922c1bc", "attempt_id": "7dc7b63dbc38", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:59.643879Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 41, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 1.4063329435884953, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.10366698075086, "ttft_ms": 48.10366698075086, "decode_ms": 12.43166602216661}, "total_wall_ms": 63.70362499728799, "ttft_ms": 48.10366698075086, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9498119396, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9498119396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 995 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "29b2d248f8bb0e298efc329f", "attempt_id": "31ee979e3539", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:59.726416Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 39, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 1.3345000334084034, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.54512500949204, "ttft_ms": 47.54512500949204, "decode_ms": 12.39199994597584}, "total_wall_ms": 63.079082989133894, "ttft_ms": 47.54512500949204, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9494547684, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9494547684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 996 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "771a23f924a4607d88e3fadb", "attempt_id": "1f99e303da0e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:59.807696Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 1.451082993298769, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.52695800177753, "ttft_ms": 46.52695800177753, "decode_ms": 12.38887500949204}, "total_wall_ms": 62.0801659533754, "ttft_ms": 46.52695800177753, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9487273168, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9487273168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 997 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d3c2b56277703ae12f5db387", "attempt_id": "d40db390639e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:59.887822Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 44, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 1.4472500188276172, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.60166699998081, "ttft_ms": 47.60166699998081, "decode_ms": 12.38379196729511}, "total_wall_ms": 63.23416705708951, "ttft_ms": 47.60166699998081, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9501773040, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9501773040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 998 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6d5488a7872bfc14b39f6ae7", "attempt_id": "d15687d3b127", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:36:59.968613Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 47, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 1.226165913976729, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.62337501253933, "ttft_ms": 48.62337501253933, "decode_ms": 12.352249934338033}, "total_wall_ms": 63.90104093588889, "ttft_ms": 48.62337501253933, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9506786556, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9506786556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 999 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a3863733d5cb807c5f230621", "attempt_id": "46132f61aecc", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:00.050281Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 38, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 0.7317089475691319, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.86004191171378, "ttft_ms": 46.86004191171378, "decode_ms": 12.186207924969494}, "total_wall_ms": 61.51350005529821, "ttft_ms": 46.86004191171378, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9493482724, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9493482724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1000 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f6c732a1a18e0cc4c0925773", "attempt_id": "dcff8e73a3c2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:00.129375Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9333623816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 35, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 73285632, "serialized_payload_bytes": 73301834, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1279.7660409705713, "doc_prefill_ms": 342.64962503220886, "compress_ms": 912.7814579987898, "serialize_ms": 24.07058293465525, "load_ms": 1.3889999827370048, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.84241600241512, "ttft_ms": 45.84241600241512, "decode_ms": 12.472417089156806}, "total_wall_ms": 61.62087502889335, "ttft_ms": 45.84241600241512, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10642112512, "backend_memory": {"mlx_active_bytes": 9409121288, "mlx_peak_bytes": 9486453968, "mlx_cache_bytes": 7422921798, "process_rss_bytes": 10642112512}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9486453968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a56f42833d512a7b239d8d9072911ac29abb996eb5b457cc03d3e07b3a3329fe", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1001 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c6a27ee63fab8ccc06fbf814", "attempt_id": "707a1c88adbe", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:00.210243Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 36, "compress_ms": 79.90616606548429}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337491, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1343.590792035684, "doc_prefill_ms": 342.332208994776, "compress_ms": 994.6519579971209, "serialize_ms": 6.300582899712026, "load_ms": 1.36824999935925, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.96016597375274, "ttft_ms": 39.96016597375274, "decode_ms": 15.03116695675999}, "total_wall_ms": 1403.3802499761805, "ttft_ms": 39.96016597375274, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10625187840, "backend_memory": {"mlx_active_bytes": 9298660360, "mlx_peak_bytes": 9365998800, "mlx_cache_bytes": 7595477742, "process_rss_bytes": 10625187840}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9365998800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b37a784dc721330f5da0b4a0937a2d8f3668a61c4392c205f3d10e74ba8153c1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1002 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2469f40248d5102869196c32", "attempt_id": "74ca508d1a02", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:01.633216Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 41, "compress_ms": 80.97683300729841}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 41, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337491, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1344.572416972369, "doc_prefill_ms": 342.94270805548877, "compress_ms": 995.7031660014763, "serialize_ms": 5.626917001791298, "load_ms": 1.090875011868775, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.82312509045005, "ttft_ms": 36.82312509045005, "decode_ms": 12.170040979981422}, "total_wall_ms": 1397.9758330387995, "ttft_ms": 36.82312509045005, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10644111360, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9375386852, "mlx_cache_bytes": 7629638382, "process_rss_bytes": 10644111360}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9375386852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b37a784dc721330f5da0b4a0937a2d8f3668a61c4392c205f3d10e74ba8153c1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1003 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "af13359c1be42f94fe22643a", "attempt_id": "e338dd1daa11", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:03.051135Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 39, "compress_ms": 88.90608290676028}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 39, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337491, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1345.8154170075431, "doc_prefill_ms": 342.8445839090273, "compress_ms": 997.673749923706, "serialize_ms": 4.971749964170158, "load_ms": 1.0732919909060001, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.15850005391985, "ttft_ms": 37.15850005391985, "decode_ms": 11.873959098011255}, "total_wall_ms": 1399.2002080194652, "ttft_ms": 37.15850005391985, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10644127744, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9371176164, "mlx_cache_bytes": 7659342574, "process_rss_bytes": 10644127744}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9371176164, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b37a784dc721330f5da0b4a0937a2d8f3668a61c4392c205f3d10e74ba8153c1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1004 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dd1b9226f507a6422514c24b", "attempt_id": "c120968fb2b8", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:04.472385Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 36, "compress_ms": 81.06766594573855}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337491, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1334.1092079645023, "doc_prefill_ms": 341.6895839618519, "compress_ms": 987.1814999496564, "serialize_ms": 4.95970796328038, "load_ms": 1.135790953412652, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.59754199907184, "ttft_ms": 36.59754199907184, "decode_ms": 11.78812503349036}, "total_wall_ms": 1386.8013339815661, "ttft_ms": 36.59754199907184, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10644127744, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9365638352, "mlx_cache_bytes": 7659342574, "process_rss_bytes": 10644127744}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9365638352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b37a784dc721330f5da0b4a0937a2d8f3668a61c4392c205f3d10e74ba8153c1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1005 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1c77e35ec24d9403fb3372a2", "attempt_id": "ab8b9e39fbfd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:05.878941Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 44, "compress_ms": 87.17808302026242}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 44, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337491, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1341.2166249472648, "doc_prefill_ms": 352.764124982059, "compress_ms": 983.5191670572385, "serialize_ms": 4.64254105463624, "load_ms": 1.2516670394688845, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.02183300629258, "ttft_ms": 37.02183300629258, "decode_ms": 11.80412492249161}, "total_wall_ms": 1394.4917499320582, "ttft_ms": 37.02183300629258, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10644127744, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9379613936, "mlx_cache_bytes": 7686572782, "process_rss_bytes": 10644127744}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9379613936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b37a784dc721330f5da0b4a0937a2d8f3668a61c4392c205f3d10e74ba8153c1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1006 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a15b32a2487a93cf9f124713", "attempt_id": "07fc524ac7a2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:07.293128Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 47, "compress_ms": 84.91579198744148}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 47, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337491, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1359.5009580021724, "doc_prefill_ms": 341.1658749682829, "compress_ms": 1013.2633750326931, "serialize_ms": 4.78404201567173, "load_ms": 1.0717089753597975, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.15925000142306, "ttft_ms": 37.15925000142306, "decode_ms": 11.894750059582293}, "total_wall_ms": 1412.7130000852048, "ttft_ms": 37.15925000142306, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10644127744, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9385135356, "mlx_cache_bytes": 7741213422, "process_rss_bytes": 10644127744}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9385135356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b37a784dc721330f5da0b4a0937a2d8f3668a61c4392c205f3d10e74ba8153c1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1007 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a90bb03ca47559e935adc9af", "attempt_id": "9206244acdb2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:08.725867Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 38, "compress_ms": 80.09954204317182}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 38, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337491, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1341.6907920036465, "doc_prefill_ms": 342.357249930501, "compress_ms": 993.9280420076102, "serialize_ms": 5.111249978654087, "load_ms": 1.1693340493366122, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.89437499269843, "ttft_ms": 36.89437499269843, "decode_ms": 11.973208049312234}, "total_wall_ms": 1395.0038329930976, "ttft_ms": 36.89437499269843, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10644127744, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9370111204, "mlx_cache_bytes": 7747242734, "process_rss_bytes": 10644127744}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9370111204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b37a784dc721330f5da0b4a0937a2d8f3668a61c4392c205f3d10e74ba8153c1", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1008 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "193e1813c29a4486b5f16e54", "attempt_id": "61286e1dcab8", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:10.140523Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1988, "keep": 497, "window_tokens": 35, "compress_ms": 102.74508409202099}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 35, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 18321408, "serialized_payload_bytes": 18337492, "side_information_bytes": 16084, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1372.1378749469295, "doc_prefill_ms": 342.5109169911593, "compress_ms": 1024.4147079065442, "serialize_ms": 4.927875008434057, "load_ms": 1.2161670019850135, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.16549994330853, "ttft_ms": 36.16549994330853, "decode_ms": 11.972291977144778}, "total_wall_ms": 1424.6420830022544, "ttft_ms": 36.16549994330853, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10644127744, "backend_memory": {"mlx_active_bytes": 9298529288, "mlx_peak_bytes": 9364819152, "mlx_cache_bytes": 7751699182, "process_rss_bytes": 10644127744}, "peak_prefill_memory": 9991269352, "peak_decode_memory": 9364819152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "80271c72741615ab0e2bfc94a08f7370bf44da582a293326a30c454ce7b7075d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1009 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f041a0e4b889ded76f261cb7", "attempt_id": "565b730b7e0f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:11.619502Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5880, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2204.388792044483, "ttft_ms": 12.564167031086981, "decode_ms": 138.54387495666742}, "total_wall_ms": 2366.4412909420207, "ttft_ms": 12.564167031086981, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10453172224, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 1910486456, "process_rss_bytes": 10453172224}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GJ-48Y-4804", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "288a654d3c294039b9f1fd8097a6383af1f152bbc0fa1c8267f80c506695c7be"} | ||||
| 1010 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4858627950fa7cca681e6186", "attempt_id": "de8348b3512d", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:14.012733Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5888, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2202.6750000659376, "ttft_ms": 12.340874993242323, "decode_ms": 149.7469999594614}, "total_wall_ms": 2375.8290000259876, "ttft_ms": 12.340874993242323, "input_usage": {"receiver_prompt_tokens": 5888}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10453188608, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2468197816, "process_rss_bytes": 10453188608}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 890-P, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "5ea897ec96744c7f678e48d39a1ef3c30bd28848303a8b5073b259e5657721a2"} | ||||
| 1011 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8d685302f8b7010593291203", "attempt_id": "0a5adde0fd31", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:16.414229Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5885, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2200.114083942026, "ttft_ms": 12.706750072538853, "decode_ms": 87.90662500541657}, "total_wall_ms": 2311.9393750093877, "ttft_ms": 12.706750072538853, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453188608, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 2783163832, "process_rss_bytes": 10453188608}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "86.2682", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "8e0df38644a5e274cbe525e37505619d4c8ef69b2b1d3b3035cb33e63ff994fa"} | ||||
| 1012 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "01b09c3bb9a350844d3e3a43", "attempt_id": "10a4950ca035", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:18.751459Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5881, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2203.1536670401692, "ttft_ms": 12.786333099938929, "decode_ms": 99.44912500213832}, "total_wall_ms": 2327.328540966846, "ttft_ms": 12.786333099938929, "input_usage": {"receiver_prompt_tokens": 5881}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10453221376, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 3097474488, "process_rss_bytes": 10453221376}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yevgenia Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "70acf90909a5c82e82ecfd652944ec8d08010f0d2b23315dbf5f3f51d322e547"} | ||||
| 1013 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e4504c6c5975c21105812cd6", "attempt_id": "6fa5ed1defca", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:21.106540Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5891, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2222.2360000014305, "ttft_ms": 12.510125059634447, "decode_ms": 87.36512495670468}, "total_wall_ms": 2333.434290951118, "ttft_ms": 12.510125059634447, "input_usage": {"receiver_prompt_tokens": 5891}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453254144, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10078948416, "mlx_cache_bytes": 3667523000, "process_rss_bytes": 10453254144}, "peak_prefill_memory": null, "peak_decode_memory": 10078948416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1637140", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "40dc479a99e27c9f4cfd3f25b4018d2bee046497042f702dee17b65017cc874f"} | ||||
| 1014 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e49c1f187534bb8750433710", "attempt_id": "820b941783f4", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:23.466564Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5891, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2219.7856249986216, "ttft_ms": 12.581208953633904, "decode_ms": 123.87295800726861}, "total_wall_ms": 2366.7484170291573, "ttft_ms": 12.581208953633904, "input_usage": {"receiver_prompt_tokens": 5891}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453286912, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10078948416, "mlx_cache_bytes": 3667523000, "process_rss_bytes": 10453286912}, "peak_prefill_memory": null, "peak_decode_memory": 10078948416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XL-20E-2025", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "30ca76c2925a8fac3dbf0a127f444082e02954e2fb04cd4b4d133d2a00fbb39b"} | ||||
| 1015 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5d224638db9fa9ec11bf0817", "attempt_id": "408a3e7be13f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:25.858674Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5882, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.557874912396, "ttft_ms": 12.571207946166396, "decode_ms": 12.44379102718085}, "total_wall_ms": 2237.0448750443757, "ttft_ms": 12.571207946166396, "input_usage": {"receiver_prompt_tokens": 5882}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453319680, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10102934592, "mlx_cache_bytes": 4033230264, "process_rss_bytes": 10453319680}, "peak_prefill_memory": null, "peak_decode_memory": 10102934592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1016 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "89b16dd7fceff5eccd640d84", "attempt_id": "113e34333ba7", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:28.121585Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5881, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015083001926541328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2201.1069579748437, "ttft_ms": 12.573624961078167, "decode_ms": 12.425250024534762}, "total_wall_ms": 2237.1982500189915, "ttft_ms": 12.573624961078167, "input_usage": {"receiver_prompt_tokens": 5881}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453352448, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10075130944, "mlx_cache_bytes": 4033230264, "process_rss_bytes": 10453352448}, "peak_prefill_memory": null, "peak_decode_memory": 10075130944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1017 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9a0cfadbb2505201d2071deb", "attempt_id": "ed94e68ba00d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:35.289974Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.56462504994124, "ttft_ms": 12.105709058232605, "decode_ms": 131.5032079583034}, "total_wall_ms": 376.4246669597924, "ttft_ms": 12.105709058232605, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10453385216, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 5959439800, "process_rss_bytes": 10453385216}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GJ-48Y-4804", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "288a654d3c294039b9f1fd8097a6383af1f152bbc0fa1c8267f80c506695c7be"} | ||||
| 1018 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2db0c5323648a0998ecd24e1", "attempt_id": "d5d0d4b6ccf1", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:35.692743Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.99462505988777, "ttft_ms": 12.190707959234715, "decode_ms": 94.98495794832706}, "total_wall_ms": 335.3761249454692, "ttft_ms": 12.190707959234715, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10453401600, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568475224, "mlx_cache_bytes": 6235477432, "process_rss_bytes": 10453401600}, "peak_prefill_memory": null, "peak_decode_memory": 9568475224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 890, unknown town", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.25}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "9f6b190c25444e5911729ee8a3060e5d188621a1e16cbe718e6bdd2a93c0c1cf"} | ||||
| 1019 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e7995b06d1ef4b99e8b169c8", "attempt_id": "ed55c8c11ee6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:36.054252Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.928791962564, "ttft_ms": 12.121542007662356, "decode_ms": 118.63758298568428}, "total_wall_ms": 358.85962494648993, "ttft_ms": 12.121542007662356, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453417984, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9588086896, "mlx_cache_bytes": 6414734776, "process_rss_bytes": 10453417984}, "peak_prefill_memory": null, "peak_decode_memory": 9588086896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CC-78J-2939", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "e008c0c71668e0c456294190c8907bdbf9f82d78198b1c629132ab806c540568"} | ||||
| 1020 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bb9e5534f6faa59467f93922", "attempt_id": "988950d12046", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:36.439801Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.11612493731081, "ttft_ms": 12.034500017762184, "decode_ms": 95.35104094538838}, "total_wall_ms": 335.5796659598127, "ttft_ms": 12.034500017762184, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 10453434368, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 6571038136, "process_rss_bytes": 10453434368}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yevgenia Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "70acf90909a5c82e82ecfd652944ec8d08010f0d2b23315dbf5f3f51d322e547"} | ||||
| 1021 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "953780255405b7760831e588", "attempt_id": "b2f2013cfde0", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:36.801473Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.5576659012586, "ttft_ms": 11.987457983195782, "decode_ms": 12.009041965939105}, "total_wall_ms": 252.6077498914674, "ttft_ms": 11.987457983195782, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453434368, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570146392, "mlx_cache_bytes": 6848746936, "process_rss_bytes": 10453434368}, "peak_prefill_memory": null, "peak_decode_memory": 9570146392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1022 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3504860aa5cf78ab5d1575de", "attempt_id": "5ed5688a02b4", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:37.080247Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.28116705548018, "ttft_ms": 11.921583907678723, "decode_ms": 11.9708749698475}, "total_wall_ms": 252.18587496783584, "ttft_ms": 11.921583907678723, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453434368, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9570146392, "mlx_cache_bytes": 6848746936, "process_rss_bytes": 10453434368}, "peak_prefill_memory": null, "peak_decode_memory": 9570146392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1023 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "23e876bece26d2536eb00b68", "attempt_id": "14f760b2f511", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:37.357841Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.25000006519258, "ttft_ms": 12.058583088219166, "decode_ms": 12.336208019405603}, "total_wall_ms": 251.88849994447082, "ttft_ms": 12.058583088219166, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453467136, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 7005246904, "process_rss_bytes": 10453467136}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1024 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a4573a5d97fcd1db3c94d124", "attempt_id": "9f0233179dd9", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:37.635098Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1234, "cache_tensor_bytes": null, "serialized_payload_bytes": 1234, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4904.776416020468, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.77316702902317, "ttft_ms": 12.166750035248697, "decode_ms": 12.041709036566317}, "total_wall_ms": 252.29216692969203, "ttft_ms": 12.166750035248697, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 5922, "sender_output_tokens": 512, "sender_prefill_ms": 1120.7534580025822, "sender_ttft_ms": 7.464542053639889, "sender_decode_ms": 3771.148958010599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453483520, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 7005246904, "process_rss_bytes": 10453483520}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88b00cfb6809a2de304d175670951f437fe43beb66b5f7b692dfa08359fc61e6", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 1025 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "973ecccb67439b56e256452a", "attempt_id": "657b06cd9b9f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:42.810607Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 428, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.9412500495091, "ttft_ms": 11.92695798818022, "decode_ms": 128.57100006658584}, "total_wall_ms": 312.4960419954732, "ttft_ms": 11.92695798818022, "input_usage": {"receiver_prompt_tokens": 428, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10453516288, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9537788028, "mlx_cache_bytes": 7937873336, "process_rss_bytes": 10453516288}, "peak_prefill_memory": null, "peak_decode_memory": 9537788028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GJ-48Y-4804", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "288a654d3c294039b9f1fd8097a6383af1f152bbc0fa1c8267f80c506695c7be"} | ||||
| 1026 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7f0cc5e0e1c92c1a9c4393a1", "attempt_id": "3d695ddbbf77", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:43.149282Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 436, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.2691249512136, "ttft_ms": 11.77229208406061, "decode_ms": 11.788542033173144}, "total_wall_ms": 190.70995808579028, "ttft_ms": 11.77229208406061, "input_usage": {"receiver_prompt_tokens": 436, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453532672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9542883452, "mlx_cache_bytes": 8193021368, "process_rss_bytes": 10453532672}, "peak_prefill_memory": null, "peak_decode_memory": 9542883452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1027 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6213e81045a739806dd5de5a", "attempt_id": "b0337b3713c3", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:43.365767Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 433, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.44137499295175, "ttft_ms": 11.816875077784061, "decode_ms": 11.772709083743393}, "total_wall_ms": 189.89999999757856, "ttft_ms": 11.816875077784061, "input_usage": {"receiver_prompt_tokens": 433, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453532672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9541376124, "mlx_cache_bytes": 8345327032, "process_rss_bytes": 10453532672}, "peak_prefill_memory": null, "peak_decode_memory": 9541376124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1028 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bf44bacedeed0f160dd7c17e", "attempt_id": "c41712c8cb51", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:43.581422Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 167.0467909425497, "ttft_ms": 11.937333038076758, "decode_ms": 11.781290988437831}, "total_wall_ms": 191.63133297115564, "ttft_ms": 11.937333038076758, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453532672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9538279548, "mlx_cache_bytes": 8496321976, "process_rss_bytes": 10453532672}, "peak_prefill_memory": null, "peak_decode_memory": 9538279548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1029 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "87c2564e220cf99d039dc441", "attempt_id": "b7205c56e5da", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:43.798552Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.73629207070917, "ttft_ms": 11.806958937086165, "decode_ms": 11.840209015645087}, "total_wall_ms": 191.2663331022486, "ttft_ms": 11.806958937086165, "input_usage": {"receiver_prompt_tokens": 439, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453532672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9544800380, "mlx_cache_bytes": 8753452472, "process_rss_bytes": 10453532672}, "peak_prefill_memory": null, "peak_decode_memory": 9544800380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1030 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "574183169ae003deeefc4690", "attempt_id": "83bbce8e1d15", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:44.014850Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 439, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.40408302191645, "ttft_ms": 12.007625075057149, "decode_ms": 11.822332977317274}, "total_wall_ms": 191.26191607210785, "ttft_ms": 12.007625075057149, "input_usage": {"receiver_prompt_tokens": 439, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453532672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9544800380, "mlx_cache_bytes": 8753452472, "process_rss_bytes": 10453532672}, "peak_prefill_memory": null, "peak_decode_memory": 9544800380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1031 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f4f404cacf846464f4ec42ac", "attempt_id": "a402f0911491", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:44.231359Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 430, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 165.80408299341798, "ttft_ms": 11.935458052903414, "decode_ms": 11.829082970507443}, "total_wall_ms": 190.57695800438523, "ttft_ms": 11.935458052903414, "input_usage": {"receiver_prompt_tokens": 430, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453532672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9559824508, "mlx_cache_bytes": 8927712696, "process_rss_bytes": 10453532672}, "peak_prefill_memory": null, "peak_decode_memory": 9559824508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1032 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b33974eb1eadbf83e4ef8946", "attempt_id": "c2bc6e77e316", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:44.448565Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 429, "message_tokens": 339, "message_utf8_bytes": 908, "cache_tensor_bytes": null, "serialized_payload_bytes": 908, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4895.900624920614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.5224579628557, "ttft_ms": 11.828874936327338, "decode_ms": 11.840666993521154}, "total_wall_ms": 191.09733297955245, "ttft_ms": 11.828874936327338, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 5950, "sender_output_tokens": 512, "sender_prefill_ms": 1120.131375035271, "sender_ttft_ms": 7.602707948535681, "sender_decode_ms": 3761.6190830012783}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453532672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9538279548, "mlx_cache_bytes": 8927712696, "process_rss_bytes": 10453532672}, "peak_prefill_memory": null, "peak_decode_memory": 9538279548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9e05c64c91f74ef4f8d1f54fc5ab25e5b79cbf82bc491b8e3b247e2335ac30e8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1033 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "48ece379bd5b625d23cd8eb4", "attempt_id": "3ab5d337d9d9", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:45.857228Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 35, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.7750830156728625, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.1749579841271, "ttft_ms": 80.1749579841271, "decode_ms": 632.6892500510439}, "total_wall_ms": 720.7223339937627, "ttft_ms": 80.1749579841271, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9796881612, "mlx_cache_bytes": 10029210522, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9796881612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "/,\n\n.\n\ntorta-ogo:ao:::uumenroll::oT作古人的故事：从“之于人的力量，但遇华光，(0:1.3.5；6(包括的，", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "b42b672f2a454b69e09868de66a88a7b862885afd3fafae5907077a6f4f1f0dd"} | ||||
| 1034 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2d669e3e113fdff04a86dd76", "attempt_id": "c380c1326fde", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:46.604898Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 43, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.749709015712142, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.19062503241003, "ttft_ms": 70.19062503241003, "decode_ms": 631.2329589854926}, "total_wall_ms": 708.6138329468668, "ttft_ms": 70.19062503241003, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9810349292, "mlx_cache_bytes": 10091961586, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9810349292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "说，()().哦，那：�城，你連@$,而立定式對不起�tries：1:勿ame@:1:到1:201-1(不�editable:的, ", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "4ec546619d3c6f1d7b561992dc59bcfa7f9fbe529868c653a725e78f0f197e00"} | ||||
| 1035 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3813d240588e2b4324c65ffe", "attempt_id": "76c5244acb6d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:47.339872Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 40, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.8066669581457973, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.61758307181299, "ttft_ms": 74.61758307181299, "decode_ms": 630.6239169789478}, "total_wall_ms": 712.4582499964163, "ttft_ms": 74.61758307181299, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 40}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9805663468, "mlx_cache_bytes": 10140818674, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9805663468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".:get:ed(),\n.\n\n« itoR: a:0:0.\n###, please andw:le \"ColumgetMethodAssistant: [\"A\"):gettext:ue:1:1:0:ifungo( necessarily", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "4196f4de139dab88eb1a80700ae3c4a8f80bbe2e52e65bf03d98466cb805a026"} | ||||
| 1036 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "592338bcaf1328c22b17e417", "attempt_id": "1e3628820552", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:48.079130Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.748457900248468, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.5523749133572, "ttft_ms": 72.5523749133572, "decode_ms": 630.1435839850456}, "total_wall_ms": 709.6708749886602, "ttft_ms": 72.5523749133572, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9798192364, "mlx_cache_bytes": 10192921090, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9798192364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ")+(B, -d, -m_(\"d, -1:0:\").brtc:ia, EAT:O_arch(優稀 McB:1:60:0:0:1:1:(ch:6:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "f8760864c6fa9b4aa0f0bda583a0d3e42187468b890e00706b11d08c768e9570"} | ||||
| 1037 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5a33cd528a137d4e3a5258ff", "attempt_id": "956b0da5d15b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:48.814976Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.7246250063180923, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.75520892068744, "ttft_ms": 79.75520892068744, "decode_ms": 630.5349169997498}, "total_wall_ms": 717.620125040412, "ttft_ms": 79.75520892068744, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9817066744, "mlx_cache_bytes": 10246792050, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9817066744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "M: sóm, please, the old I dont: the iu-carry: a few-Block-1 (elo-crazy, that of:)\n\nP6 chequeer, canonic(ign) or, it is", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "0cb298422ad87b89aad7119bf5476a8ede50b9dd9306fab1ed5a41b4670540a1"} | ||||
| 1038 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b1f028232677c4273e117b3f", "attempt_id": "0da84234c551", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:49.558358Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.699040993116796, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.48687493242323, "ttft_ms": 78.48687493242323, "decode_ms": 631.9415000034496}, "total_wall_ms": 717.4555419478565, "ttft_ms": 78.48687493242323, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9817066744, "mlx_cache_bytes": 10246792050, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9817066744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(毎�こともある deliveries -a\n(或者其他的,在首语,在首过山的桥梁一样货品质好几人山不外拓丹青金,在山的,在山的,在这一字", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "eb8201c07f11e5c06b5b83e1c340e8617398087d11c302a4a2c49e462e62ef9c"} | ||||
| 1039 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "acb35b8888cc77f9335676c8", "attempt_id": "fbbc05525d5c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:50.302000Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 37, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.852584071457386, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.13016697298735, "ttft_ms": 73.13016697298735, "decode_ms": 633.8415830396116}, "total_wall_ms": 714.3956249346957, "ttft_ms": 73.13016697298735, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9802796268, "mlx_cache_bytes": 10282821835, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9802796268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "please, ofuloaneuOlympiateverylogevz: 1:1,\nendosports:If in which the case: 1:blancin every day:1:1:1:.\n\ntwosprint", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "8fe1aff0c199233edd3a8461befd89a18d142f6a146847cb25d09ab5f3a22733"} | ||||
| 1040 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ed923258a420f3e268bec817", "attempt_id": "50383908ba58", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:51.044073Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475443720}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486270, "side_information_bytes": 16190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1191.4983339374885, "doc_prefill_ms": 1104.9277079291642, "compress_ms": 12.468208093196154, "serialize_ms": 63.01266700029373, "load_ms": 1.7994579393416643, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.97420799639076, "ttft_ms": 71.97420799639076, "decode_ms": 635.557624977082}, "total_wall_ms": 714.5393749233335, "ttft_ms": 71.97420799639076, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10884956160, "backend_memory": {"mlx_active_bytes": 9694858248, "mlx_peak_bytes": 9798192364, "mlx_cache_bytes": 10282821835, "process_rss_bytes": 10884956160}, "peak_prefill_memory": 10054831192, "peak_decode_memory": 9798192364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "## a, this Eau nioi:).sw: b_(r, a:1).br.:\n\n (1lide_0: a:)\n\n@txsportsterleagueelst(): i.e:2-ex:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2f879109d2e1f4a1636243a91f56d5e2c82a6a5cf4322d71ab70ca05b72eeae9", "output_hash": "286a6ce16a3aaf7ba344ecd90c0db37fc168ad58bc18c0417e8728f2651dbdcb"} | ||||
| 1041 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f0afc262fc5d4672bba88177", "attempt_id": "81c32be01a24", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:55.087722Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 35, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.9189580343663692, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.78487498965114, "ttft_ms": 78.78487498965114, "decode_ms": 13.590084039606154}, "total_wall_ms": 99.68370804563165, "ttft_ms": 78.78487498965114, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9796619468, "mlx_cache_bytes": 10366101707, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9796619468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1042 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "695ea6210c552e6b7fb91dc4", "attempt_id": "36640717ddf5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:55.215517Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 43, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.8281670054420829, "receiver_prefill_ms": 0.0, "query_prefill_ms": 69.67037497088313, "ttft_ms": 69.67037497088313, "decode_ms": 13.452625018544495}, "total_wall_ms": 90.20391700323671, "ttft_ms": 69.67037497088313, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9810087148, "mlx_cache_bytes": 10364922059, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9810087148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1043 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9769d615005be6f11834d5e5", "attempt_id": "4d233e982c2a", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:55.331635Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 40, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.8061669543385506, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.3487909892574, "ttft_ms": 73.3487909892574, "decode_ms": 13.445624965243042}, "total_wall_ms": 93.99462502915412, "ttft_ms": 73.3487909892574, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9805204716, "mlx_cache_bytes": 10366101707, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9805204716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1044 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2db21799b823dfb566a205eb", "attempt_id": "4355e73fa301", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:55.451303Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.7782499780878425, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.37379206344485, "ttft_ms": 72.37379206344485, "decode_ms": 80.45500004664063}, "total_wall_ms": 159.93829199578613, "ttft_ms": 72.37379206344485, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797930220, "mlx_cache_bytes": 10366101707, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9797930220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yevgen Kovalenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "41510a0c9b62341466b76dfe2246c9eed38b69d956154a6ebf494e50a125c9a5"} | ||||
| 1045 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1d7709170da3acc46c659fee", "attempt_id": "1914ea6ddee2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:55.636032Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.6937080072239041, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.52875010576099, "ttft_ms": 78.52875010576099, "decode_ms": 13.66158400196582}, "total_wall_ms": 99.4186659809202, "ttft_ms": 78.52875010576099, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9816804600, "mlx_cache_bytes": 10364922059, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9816804600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1046 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "11d0d0b934e162d1586052f1", "attempt_id": "a463463f8617", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:55.760679Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.9917499739676714, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.62958300393075, "ttft_ms": 78.62958300393075, "decode_ms": 13.580874889157712}, "total_wall_ms": 99.60316598881036, "ttft_ms": 78.62958300393075, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9693416456, "mlx_peak_bytes": 9816804600, "mlx_cache_bytes": 10364922059, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9816804600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1047 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "14dd55c56a37f50045126d98", "attempt_id": "78e092e87082", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:55.887553Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 37, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.0986250126734376, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.63012509793043, "ttft_ms": 72.63012509793043, "decode_ms": 13.420499977655709}, "total_wall_ms": 92.82412496395409, "ttft_ms": 72.63012509793043, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9802517740, "mlx_cache_bytes": 10366265547, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9802517740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1048 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "76e3ac7cef13608ae1f6bf86", "attempt_id": "df01e8c8ca52", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:56.006599Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9475181576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 215470080, "serialized_payload_bytes": 215486371, "side_information_bytes": 16291, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3299.637082964182, "doc_prefill_ms": 1103.2682079821825, "compress_ms": 2121.7364580370486, "serialize_ms": 74.31441592052579, "load_ms": 1.0835420107468963, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.62387499213219, "ttft_ms": 72.62387499213219, "decode_ms": 13.523541972972453}, "total_wall_ms": 92.55933400709182, "ttft_ms": 72.62387499213219, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11075616768, "backend_memory": {"mlx_active_bytes": 9692236808, "mlx_peak_bytes": 9797930220, "mlx_cache_bytes": 10366265547, "process_rss_bytes": 11075616768}, "peak_prefill_memory": 10054732888, "peak_decode_memory": 9797930220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6532dddb46cef71125a1cab57eeaaf7954592bf3f67fef7714a2c1c18c4f3721", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1049 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ba68c4ecec575b3e4e2404c5", "attempt_id": "80a01fc0962f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:56.125034Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 35, "compress_ms": 115.34354195464402}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 35, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3347.580917063169, "doc_prefill_ms": 1104.2181249940768, "compress_ms": 2224.677292048, "serialize_ms": 18.327916972339153, "load_ms": 1.8160409526899457, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.661041021347046, "ttft_ms": 42.661041021347046, "decode_ms": 12.299707974307239}, "total_wall_ms": 3414.819457917474, "ttft_ms": 42.661041021347046, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10987323392, "backend_memory": {"mlx_active_bytes": 9369324552, "mlx_peak_bytes": 9442479308, "mlx_cache_bytes": 10865525923, "process_rss_bytes": 10987323392}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9442479308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1050 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1491b4107bbc0f1541b2ca03", "attempt_id": "434e43eedf9f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:37:59.566388Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 43, "compress_ms": 124.5677910046652}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 43, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874660, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3351.003999938257, "doc_prefill_ms": 1103.0783749883994, "compress_ms": 2232.83141606953, "serialize_ms": 14.74124996457249, "load_ms": 1.4702080516144633, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.669542017392814, "ttft_ms": 42.669542017392814, "decode_ms": 12.266708072274923}, "total_wall_ms": 3414.991166908294, "ttft_ms": 42.669542017392814, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041619968, "backend_memory": {"mlx_active_bytes": 9370455048, "mlx_peak_bytes": 9455455468, "mlx_cache_bytes": 10939745443, "process_rss_bytes": 11041619968}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9455455468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fee3bc7dd8df69780a07c6ac6333d01374baf64b2cb1ab19d14007e1104f514c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1051 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2803b1ed5f146c6462fa5ff5", "attempt_id": "3a95c88fbafd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:03.009449Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 40, "compress_ms": 120.72387500666082}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 40, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3320.68404101301, "doc_prefill_ms": 1103.6734170047566, "compress_ms": 2201.608750037849, "serialize_ms": 15.03883395344019, "load_ms": 1.3010000111535192, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.9710000064224, "ttft_ms": 43.9710000064224, "decode_ms": 12.416166951879859}, "total_wall_ms": 3387.5343339750543, "ttft_ms": 43.9710000064224, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 40}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041619968, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9450065132, "mlx_cache_bytes": 10984539299, "process_rss_bytes": 11041619968}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9450065132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1052 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8761822939f1fe11b0c20c9c", "attempt_id": "88b7d8d6229e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:06.424387Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 36, "compress_ms": 122.54320795182139}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3355.558832990937, "doc_prefill_ms": 1103.5360000096262, "compress_ms": 2237.9455000627786, "serialize_ms": 13.68616707623005, "load_ms": 1.273042056709528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.33983298763633, "ttft_ms": 42.33983298763633, "decode_ms": 109.84429204836488}, "total_wall_ms": 3517.46166695375, "ttft_ms": 42.33983298763633, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 11041652736, "backend_memory": {"mlx_active_bytes": 9370225672, "mlx_peak_bytes": 9443331308, "mlx_cache_bytes": 11019699363, "process_rss_bytes": 11041652736}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9443331308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yevgeny Serebryakov", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "4dd6bd9b2ef3aa349ffb54dc1e8ffd2f963700f24a19afbd38ada58c065306d9"} | ||||
| 1053 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd63ccf49557029e50c7f605", "attempt_id": "848a17146b7c", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:09.972058Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 46, "compress_ms": 129.15254198014736}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3368.147625005804, "doc_prefill_ms": 1103.1473329057917, "compress_ms": 2249.972749967128, "serialize_ms": 14.642250025644898, "load_ms": 1.3217499945312738, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.11858301702887, "ttft_ms": 45.11858301702887, "decode_ms": 12.350750039331615}, "total_wall_ms": 3434.5299169654027, "ttft_ms": 45.11858301702887, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041685504, "backend_memory": {"mlx_active_bytes": 9370455048, "mlx_peak_bytes": 9462156536, "mlx_cache_bytes": 11055006883, "process_rss_bytes": 11041685504}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9462156536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1054 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a10c6bb523239e53748bff4d", "attempt_id": "559c5763c0ec", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:13.436447Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 46, "compress_ms": 127.40279198624194}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3369.896874995902, "doc_prefill_ms": 1102.2395410109311, "compress_ms": 2252.8932080604136, "serialize_ms": 14.406500034965575, "load_ms": 1.3570410665124655, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.00174999702722, "ttft_ms": 45.00174999702722, "decode_ms": 12.268709018826485}, "total_wall_ms": 3436.2917500548065, "ttft_ms": 45.00174999702722, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041685504, "backend_memory": {"mlx_active_bytes": 9370455048, "mlx_peak_bytes": 9462156536, "mlx_cache_bytes": 11055006883, "process_rss_bytes": 11041685504}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9462156536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1055 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03dbfcc05b37cc09981a5640", "attempt_id": "c07e175b55e4", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:16.900280Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 37, "compress_ms": 119.31450001429766}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 37, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3381.671749986708, "doc_prefill_ms": 1102.8459160588682, "compress_ms": 2264.966957969591, "serialize_ms": 13.480958063155413, "load_ms": 1.254625036381185, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.99616697244346, "ttft_ms": 42.99616697244346, "decode_ms": 12.294874992221594}, "total_wall_ms": 3445.9331670077518, "ttft_ms": 42.99616697244346, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041685504, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9445526764, "mlx_cache_bytes": 11090035875, "process_rss_bytes": 11041685504}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9445526764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1056 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "29d99a9a2d14903a2a77f20f", "attempt_id": "2fb990d3fe62", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:20.373184Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5845, "keep": 1461, "window_tokens": 36, "compress_ms": 121.27891695126891}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 53858304, "serialized_payload_bytes": 53874661, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3350.750625017099, "doc_prefill_ms": 1102.828292059712, "compress_ms": 2235.01154105179, "serialize_ms": 12.55616603884846, "load_ms": 1.2915829429402947, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.84816700965166, "ttft_ms": 42.84816700965166, "decode_ms": 12.300999951548874}, "total_wall_ms": 3416.8504589470103, "ttft_ms": 42.84816700965166, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 11041685504, "backend_memory": {"mlx_active_bytes": 9369308168, "mlx_peak_bytes": 9443331308, "mlx_cache_bytes": 11090035875, "process_rss_bytes": 11041685504}, "peak_prefill_memory": 10054700120, "peak_decode_memory": 9443331308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3d73b3a513424571b6a186fbb5abd777a625e66be22806ae238ec8ea3b92c274", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1057 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2429e90b2114c7e83305324a", "attempt_id": "ec358657f7ce", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:23.862221Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2005, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 695.8260840037838, "ttft_ms": 12.476624920964241, "decode_ms": 132.30729196220636}, "total_wall_ms": 844.1610829904675, "ttft_ms": 12.476624920964241, "input_usage": {"receiver_prompt_tokens": 2005}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10488676352, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9969019792, "mlx_cache_bytes": 718116104, "process_rss_bytes": 10488676352}, "peak_prefill_memory": null, "peak_decode_memory": 9969019792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TQ-37Z-3885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "a9fc9678b963b7c3d6778c275b5aeffc61762adbe622c0b7221038130b0f941f"} | ||||
| 1058 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "11a3d94dbe77cc91ce094026", "attempt_id": "44081211de5c", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:24.725869Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2013, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 692.0486249728128, "ttft_ms": 12.064540991559625, "decode_ms": 132.38929095678031}, "total_wall_ms": 840.0914999656379, "ttft_ms": 12.064540991559625, "input_usage": {"receiver_prompt_tokens": 2013}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10488709120, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9971543104, "mlx_cache_bytes": 1344558344, "process_rss_bytes": 10488709120}, "peak_prefill_memory": null, "peak_decode_memory": 9971543104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 395-Z, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "62705540f1dfbf31a4188d1537cb948fa38b2bfa8e9bb0cce66a6c65b63cbe21"} | ||||
| 1059 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "627ec2c3396b172b0ee5a5ce", "attempt_id": "01e280a037af", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:25.584447Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2012, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.3476251065731, "ttft_ms": 12.131833005696535, "decode_ms": 84.28633399307728}, "total_wall_ms": 791.1356249824166, "ttft_ms": 12.131833005696535, "input_usage": {"receiver_prompt_tokens": 2012}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10488709120, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9971543104, "mlx_cache_bytes": 1344558344, "process_rss_bytes": 10488709120}, "peak_prefill_memory": null, "peak_decode_memory": 9971543104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.7060", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "af701ce56cefa8d20cc3946e344bad57b3ddca67140908fc124f710fe1577614"} | ||||
| 1060 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eb2a0f4b0291f95ee3a97034", "attempt_id": "6e1e55893c8e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:26.393792Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2007, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.4391250573099, "ttft_ms": 12.326749972999096, "decode_ms": 84.25766695290804}, "total_wall_ms": 790.6341248890385, "ttft_ms": 12.326749972999096, "input_usage": {"receiver_prompt_tokens": 2007}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10488741888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10011454528, "mlx_cache_bytes": 1755501832, "process_rss_bytes": 10488741888}, "peak_prefill_memory": null, "peak_decode_memory": 10011454528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Baptiste-Roy", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "0828367789e6648fa24fa6e3bfce339a5b9721a26940345b1dc8f263207eb1e6"} | ||||
| 1061 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "61c52f26082c0d593ea96e64", "attempt_id": "5992df8a6fca", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:27.202465Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2015, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.9703329913318, "ttft_ms": 12.296458007767797, "decode_ms": 84.26166698336601}, "total_wall_ms": 792.2958750277758, "ttft_ms": 12.296458007767797, "input_usage": {"receiver_prompt_tokens": 2015}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10488741888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9972411456, "mlx_cache_bytes": 2349782280, "process_rss_bytes": 10488741888}, "peak_prefill_memory": null, "peak_decode_memory": 9972411456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7326886", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "ddc85acd6cbdff30a16524b0cda81f2e37dd9ff0813e8fd1752c2cfa3ab376c9"} | ||||
| 1062 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ce2fa99a63af73aaeabc16ee", "attempt_id": "b8e85670e347", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:28.014580Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2014, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 692.0457079540938, "ttft_ms": 12.435499927960336, "decode_ms": 120.38616696372628}, "total_wall_ms": 828.4061249578372, "ttft_ms": 12.435499927960336, "input_usage": {"receiver_prompt_tokens": 2014}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10488758272, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9972149312, "mlx_cache_bytes": 2704332040, "process_rss_bytes": 10488758272}, "peak_prefill_memory": null, "peak_decode_memory": 9972149312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TU-84M-3627", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "8ed507841daaac245c79f7204399ab8bf8859c9bb5257e6ae0f4982c89095295"} | ||||
| 1063 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "160718f8ef755befd3ad9ad9", "attempt_id": "6ac1f7bcd73f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:28.862351Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2005, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.3390829684213, "ttft_ms": 12.167082983069122, "decode_ms": 12.0163339888677}, "total_wall_ms": 717.775790952146, "ttft_ms": 12.167082983069122, "input_usage": {"receiver_prompt_tokens": 2005}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488758272, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9969019792, "mlx_cache_bytes": 2704332040, "process_rss_bytes": 10488758272}, "peak_prefill_memory": null, "peak_decode_memory": 9969019792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1064 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ec36b4ae775197ef4bc5d9e7", "attempt_id": "b0ae2527939d", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:29.598449Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2006, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.5397908994928, "ttft_ms": 12.125083012506366, "decode_ms": 12.144916923716664}, "total_wall_ms": 718.5193339828402, "ttft_ms": 12.125083012506366, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488758272, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10019695680, "mlx_cache_bytes": 2704332040, "process_rss_bytes": 10488758272}, "peak_prefill_memory": null, "peak_decode_memory": 10019695680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1065 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "72e30da5708364ad4d15eae0", "attempt_id": "ac1245767c06", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:34.330958Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.54812504071742, "ttft_ms": 12.122875079512596, "decode_ms": 11.99124997947365}, "total_wall_ms": 256.9458750076592, "ttft_ms": 12.122875079512596, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488791040, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 3746742536, "process_rss_bytes": 10488791040}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1066 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9618470e43977c3967275307", "attempt_id": "205580956b80", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:34.606319Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.48279094230384, "ttft_ms": 11.98887499049306, "decode_ms": 11.946375016123056}, "total_wall_ms": 252.55954102613032, "ttft_ms": 11.98887499049306, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488807424, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568475224, "mlx_cache_bytes": 4022780168, "process_rss_bytes": 10488807424}, "peak_prefill_memory": null, "peak_decode_memory": 9568475224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1067 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "11f1ec9d7db98dc2527ab39e", "attempt_id": "767941411d7b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:34.877493Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.25545801222324, "ttft_ms": 11.947542079724371, "decode_ms": 11.944917030632496}, "total_wall_ms": 252.2225830471143, "ttft_ms": 11.947542079724371, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488807424, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568475224, "mlx_cache_bytes": 4022780168, "process_rss_bytes": 10488807424}, "peak_prefill_memory": null, "peak_decode_memory": 9568475224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1068 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "14d71f934e7ecb80bb7032a0", "attempt_id": "6d8733df2b03", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:35.147545Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.30920796655118, "ttft_ms": 12.123249936848879, "decode_ms": 83.16879207268357}, "total_wall_ms": 322.81054195482284, "ttft_ms": 12.123249936848879, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10488791040, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 4179280136, "process_rss_bytes": 10488791040}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Baptiste-Roy", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "0828367789e6648fa24fa6e3bfce339a5b9721a26940345b1dc8f263207eb1e6"} | ||||
| 1069 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2d3920667c755c2b3625445f", "attempt_id": "8ba04f3d33c2", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:35.488164Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.00974997133017, "ttft_ms": 11.958832968957722, "decode_ms": 107.30425000656396}, "total_wall_ms": 347.36662497743964, "ttft_ms": 11.958832968957722, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10488807424, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9569065048, "mlx_cache_bytes": 4337942792, "process_rss_bytes": 10488807424}, "peak_prefill_memory": null, "peak_decode_memory": 9569065048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,326,886", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "e3010154fffa148727cf0089dd15f522da80a70472d3718942ebc33c8f37eecd"} | ||||
| 1070 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cdfcde9364321f886aef29b6", "attempt_id": "119b11b66c17", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:35.854090Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.7638329649344, "ttft_ms": 11.979042086750269, "decode_ms": 12.117667007260025}, "total_wall_ms": 251.92304200027138, "ttft_ms": 11.979042086750269, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488840192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 4496212232, "process_rss_bytes": 10488840192}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1071 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cc99dba89a06c630d16e9b97", "attempt_id": "fb0f232f4717", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:36.123448Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.564500015229, "ttft_ms": 12.167791021056473, "decode_ms": 12.045667041093111}, "total_wall_ms": 251.9997910130769, "ttft_ms": 12.167791021056473, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488840192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 4496212232, "process_rss_bytes": 10488840192}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1072 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5c0f50b739d56869bb6f7635", "attempt_id": "1bc55b0f1a4f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:36.393109Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1461, "cache_tensor_bytes": null, "serialized_payload_bytes": 1461, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3995.2246660832316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.787667023018, "ttft_ms": 12.062374968081713, "decode_ms": 11.96937495842576}, "total_wall_ms": 252.0846660481766, "ttft_ms": 12.062374968081713, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2047, "sender_output_tokens": 512, "sender_prefill_ms": 346.11779206898063, "sender_ttft_ms": 7.581208948977292, "sender_decode_ms": 3639.1357081010938}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488840192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565329496, "mlx_cache_bytes": 4496212232, "process_rss_bytes": 10488840192}, "peak_prefill_memory": null, "peak_decode_memory": 9565329496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f987ce49e0e34b9d542af434084ee6fb00f80c2507a79bcb60a6c4fa96a41545", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1073 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "32e3cdc6b01e3207ff7b1660", "attempt_id": "ef40f39da986", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:40.428833Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 304, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.2911249436438, "ttft_ms": 11.858040932565928, "decode_ms": 58.6026250384748}, "total_wall_ms": 199.64600005187094, "ttft_ms": 11.858040932565928, "input_usage": {"receiver_prompt_tokens": 304, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9461027128, "mlx_cache_bytes": 5150961196, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9461027128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Solveig Obuya", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "e8ab0865f91df9014acb09d61e1d335b3d9a4bac27e4e92d8640483d9162b27c"} | ||||
| 1074 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "115c73a565422794c072ec45", "attempt_id": "5d0367163e60", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:40.647590Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 312, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.12200006656349, "ttft_ms": 11.782624991610646, "decode_ms": 11.776208993978798}, "total_wall_ms": 148.41695793438703, "ttft_ms": 11.782624991610646, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465581912, "mlx_cache_bytes": 5342327560, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9465581912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1075 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f230dc24e2b4f376b580abe4", "attempt_id": "c7973d923a99", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:40.814443Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 311, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.19520888943225, "ttft_ms": 11.707750032655895, "decode_ms": 11.82829204481095}, "total_wall_ms": 148.38245802093297, "ttft_ms": 11.707750032655895, "input_usage": {"receiver_prompt_tokens": 311, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465581912, "mlx_cache_bytes": 5342327560, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9465581912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1076 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d510358a0668a260ebfb3762", "attempt_id": "06e510bd3384", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:40.980441Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 306, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.18537493795156, "ttft_ms": 11.78512501064688, "decode_ms": 82.21554104238749}, "total_wall_ms": 218.846834031865, "ttft_ms": 11.78512501064688, "input_usage": {"receiver_prompt_tokens": 306, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9477460312, "mlx_cache_bytes": 5466206984, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9477460312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Baptiste-Roy", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "0828367789e6648fa24fa6e3bfce339a5b9721a26940345b1dc8f263207eb1e6"} | ||||
| 1077 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f97e4fff84eed147b8ba0891", "attempt_id": "ce0327dcebfa", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:41.217043Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 314, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 123.85574996005744, "ttft_ms": 11.81837497279048, "decode_ms": 11.759874993003905}, "total_wall_ms": 148.10279197990894, "ttft_ms": 11.81837497279048, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9482621280, "mlx_cache_bytes": 5603882988, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9482621280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1078 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b0024cc294bd302ab851c809", "attempt_id": "819d22269fd2", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:41.382726Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 313, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.89733299985528, "ttft_ms": 11.866040993481874, "decode_ms": 11.760374996811152}, "total_wall_ms": 147.34529191628098, "ttft_ms": 11.866040993481874, "input_usage": {"receiver_prompt_tokens": 313, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9466319200, "mlx_cache_bytes": 5603882988, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9466319200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1079 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1e63791e38071bce0cf5c41e", "attempt_id": "d1e1ede2c129", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:41.547298Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 304, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.93604190926999, "ttft_ms": 12.051708996295929, "decode_ms": 11.784666101448238}, "total_wall_ms": 147.69604208413512, "ttft_ms": 12.051708996295929, "input_usage": {"receiver_prompt_tokens": 304, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9461027128, "mlx_cache_bytes": 5603882988, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9461027128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1080 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1df62d4a19b2e409c77523fe", "attempt_id": "6e79ae4d1396", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:41.713922Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 305, "message_tokens": 215, "message_utf8_bytes": 599, "cache_tensor_bytes": null, "serialized_payload_bytes": 599, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3764.1788329929113, "decode_payload_ms": 0.0, "receiver_prefill_ms": 122.6906250230968, "ttft_ms": 12.109375093132257, "decode_ms": 11.956917005591094}, "total_wall_ms": 147.728166077286, "ttft_ms": 12.109375093132257, "input_usage": {"receiver_prompt_tokens": 305, "sender_input_tokens": 2075, "sender_output_tokens": 476, "sender_prefill_ms": 366.07512494083494, "sender_ttft_ms": 7.218750077299774, "sender_decode_ms": 3388.7576250126585}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10488872960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9461518680, "mlx_cache_bytes": 5603882988, "process_rss_bytes": 10488872960}, "peak_prefill_memory": null, "peak_decode_memory": 9461518680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa97de563d79965a19f0cfe1831aa68c11a12905b8660f21f2a4989b75a88b71", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1081 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "32c0d487d9e4820d7b6d6cf7", "attempt_id": "e6e6094ed396", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:42.251308Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.931707956828177, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.913999947719276, "ttft_ms": 46.913999947719276, "decode_ms": 578.565749921836}, "total_wall_ms": 629.2844170238823, "ttft_ms": 46.913999947719276, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9485405388, "mlx_cache_bytes": 6467156229, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9485405388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "( 1. .):-$ 1 ！. 因.說.又.而永强優越格is短对子歌繼长.用手部羈不說的歌，它成立感光的速度記", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "dc682403dee3c5418f2a4dc7d5a8ae12941883bdfd65e28be690be5f148d8848"} | ||||
| 1082 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "898ebdf1a27e591d0327d7db", "attempt_id": "4c87e688528a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:42.899731Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 43, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.6480839112773538, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.770417041145265, "ttft_ms": 49.770417041145265, "decode_ms": 577.4427499854937}, "total_wall_ms": 630.602459073998, "ttft_ms": 49.770417041145265, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9497955564, "mlx_cache_bytes": 6552533597, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9497955564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "譒垂手のそばびック()()() 1.().\n�asc. 1232()()(){.()(): ．其實，只有在出人氣慨诎 ()!().()(A\n.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "d525bf3565a180221799186d418a0cc6038ea54ca7e050137d384c8f6225fe5d"} | ||||
| 1083 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "af03107ec16ff07dcb1d23af", "attempt_id": "92579a83e54c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:43.548665Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 42, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.4242080505937338, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.27266691811383, "ttft_ms": 49.27266691811383, "decode_ms": 579.9110420048237}, "total_wall_ms": 632.488084025681, "ttft_ms": 49.27266691811383, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9497119980, "mlx_cache_bytes": 6590069341, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9497119980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Comparable I could we are the \"GOURMUNIVERSITY to the Best\nThe 'A\n注:\n()'s_1:HALL\n. 'thonewindowescore-carrie\n.vice-Oh和支持比\n.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "9df9e62f4d48a92d3b03a672ef31f01418f50a8c301f91e1c89f5d9835ca3341"} | ||||
| 1084 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "baacb71a5768f4255cd27a58", "attempt_id": "4dd8805c370d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:44.199354Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 37, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.4771660789847374, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.442125040106475, "ttft_ms": 47.442125040106475, "decode_ms": 579.5326250372455}, "total_wall_ms": 630.2590409759432, "ttft_ms": 47.442125040106475, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9490369772, "mlx_cache_bytes": 6616678326, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9490369772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A(1, introitarious, linearepresentation for the queen, it stands for the osiris gnomes for the king - - - - -002-1, said it's 1, 201", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "eb232414b97681f13a2ddf008f8518a525c79b63beab478538fcfdd9e2b5f9de"} | ||||
| 1085 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dfab509f9e6c5e666f9635ce", "attempt_id": "c031885e6db0", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:44.848897Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 45, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.44212506711483, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.6825829828158, "ttft_ms": 47.6825829828158, "decode_ms": 579.0266249096021}, "total_wall_ms": 629.9632500158623, "ttft_ms": 47.6825829828158, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9502199028, "mlx_cache_bytes": 6697615646, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9502199028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "For the game-onomigold>())<>()其為必不一樣情书可以说一切能連絡，我就來，必備�ансCodec.這，該國도.該國的便成� Exactproname，", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "f0bf22239506177e8e2b9cd538b344da19a3ed75fa47d59bbf943c327bb4a7be"} | ||||
| 1086 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bc86e78c4742adba1f1f3a17", "attempt_id": "1b8048b8e456", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:45.497532Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 44, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.4031660975888371, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.03529095463455, "ttft_ms": 49.03529095463455, "decode_ms": 579.9480840796605}, "total_wall_ms": 632.1665839059278, "ttft_ms": 49.03529095463455, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9500003572, "mlx_cache_bytes": 6738919710, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9500003572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2005-2.1穿甲流了吧,但那厮長 - (),相生話bock. a\n,終身之所以\n得，快說到底那豆苗，頭為主相加之，中國", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "b28e326551f9f0ac3b86ad7babf37e73b9d179ac1631b50a05486cd587de60b8"} | ||||
| 1087 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "101017d97d29c8322fd0bbc3", "attempt_id": "9846b319bf4a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:46.148668Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.6260419506579638, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.45933397114277, "ttft_ms": 46.45933397114277, "decode_ms": 578.3142080763355}, "total_wall_ms": 628.2849999843165, "ttft_ms": 46.45933397114277, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9485389004, "mlx_cache_bytes": 6738919710, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9485389004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(\n或\n，為甚么之2. 1:1:（1, 1, 3. ươ 1不要から夸\n文藝會話>@. 3.為你的情�-form\n)的", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "de7f2a2cee24b665149d8dcb75fa8fc135b53e94176db5823ce33d06502f41b0"} | ||||
| 1088 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4decf6c67e0822fdfeb45c32", "attempt_id": "4f9025eb3c02", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:46.795816Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 36, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638181, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 370.118249906227, "doc_prefill_ms": 339.2292499775067, "compress_ms": 9.71812498755753, "serialize_ms": 17.220209003426135, "load_ms": 1.3362920144572854, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.74304195214063, "ttft_ms": 46.74304195214063, "decode_ms": 576.7377499723807}, "total_wall_ms": 626.6602500109002, "ttft_ms": 46.74304195214063, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10634657792, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9486306540, "mlx_cache_bytes": 6780535070, "process_rss_bytes": 10634657792}, "peak_prefill_memory": 9985371036, "peak_decode_memory": 9486306540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "注意.）。相続 Occupo_。)--. 'tous 曲不文，對照因運動学說无梦�SetActiveEnergy-1. noseat，對不起�VICES的含义.就這樣，對", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4791b23eb64d335376870e52247c36f6b8bed73c53f7dc675444722022ea40f", "output_hash": "edc1da8ecb76a47bd4c07728365f99f8cfa2c351b4a2b7b06c3d42165a016722"} | ||||
| 1089 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b228efcae87a3e91d68c7a77", "attempt_id": "0a8f0da19ef0", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:48.725835Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 1.5800419496372342, "receiver_prefill_ms": 0.0, "query_prefill_ms": 71.49454194586724, "ttft_ms": 71.49454194586724, "decode_ms": 123.82483307737857}, "total_wall_ms": 198.71062505990267, "ttft_ms": 71.49454194586724, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9484995788, "mlx_cache_bytes": 6786433310, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9484995788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TBD (Not provided in the given material)", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "5070f263996ce6b4bf2b5f3b02ef9f3a0a2447739544beecacdc8e4cefd94fcf"} | ||||
| 1090 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "899dbfb69d59b8b9f2a9fbfb", "attempt_id": "903ab82115d7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:48.945608Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 43, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 1.4352910220623016, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.53254102636129, "ttft_ms": 48.53254102636129, "decode_ms": 12.401915970258415}, "total_wall_ms": 64.30324993561953, "ttft_ms": 48.53254102636129, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9497562348, "mlx_cache_bytes": 6786466078, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9497562348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1091 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da305f61aa42cdd6cf2c1830", "attempt_id": "cca7e76d7e2c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:49.029671Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 42, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 1.385499956086278, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.43700001947582, "ttft_ms": 48.43700001947582, "decode_ms": 12.533165980130434}, "total_wall_ms": 64.24366601277143, "ttft_ms": 48.43700001947582, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9496726764, "mlx_cache_bytes": 6786466078, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9496726764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1092 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bcb063c868b5aa1be2e74963", "attempt_id": "e119852e132e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:49.113068Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 37, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 1.3901250204071403, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.53766599949449, "ttft_ms": 46.53766599949449, "decode_ms": 24.79054208379239}, "total_wall_ms": 74.52999998349696, "ttft_ms": 46.53766599949449, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9489976556, "mlx_cache_bytes": 6786466078, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9489976556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "N/A", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "e2f79e5b60330bba4c289962231b6ba2957d0b14e7deb3110417003c79dea635"} | ||||
| 1093 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "76c9830f140c51ec9928c988", "attempt_id": "d7b2e68d8a56", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:49.207037Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 45, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 1.3959170319139957, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.24245797842741, "ttft_ms": 47.24245797842741, "decode_ms": 12.399208033457398}, "total_wall_ms": 62.876124982722104, "ttft_ms": 47.24245797842741, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9501773044, "mlx_cache_bytes": 6788464926, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9501773044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1094 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "55c7c9296e456d5f9016dcae", "attempt_id": "097d65916076", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:49.289500Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 44, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 1.4503750717267394, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.792916000820696, "ttft_ms": 48.792916000820696, "decode_ms": 12.369332951493561}, "total_wall_ms": 64.33891702909023, "ttft_ms": 48.792916000820696, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9499643124, "mlx_cache_bytes": 6788464926, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9499643124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1095 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "acf451953070c6e999d89cfe", "attempt_id": "d6f615923d17", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:49.372516Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 1.350124948658049, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.27691698260605, "ttft_ms": 46.27691698260605, "decode_ms": 12.361458968371153}, "total_wall_ms": 61.68725003954023, "ttft_ms": 46.27691698260605, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9484995788, "mlx_cache_bytes": 6788464926, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9484995788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1096 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c013c126a3c9cd6ea62f58ac", "attempt_id": "6c5d705d45f7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:49.452019Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 36, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 72622080, "serialized_payload_bytes": 72638282, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1282.3244580067694, "doc_prefill_ms": 337.60670805349946, "compress_ms": 923.6462500412017, "serialize_ms": 20.806250046007335, "load_ms": 0.7512919837608933, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.6909579699859, "ttft_ms": 46.6909579699859, "decode_ms": 12.345541967079043}, "total_wall_ms": 61.48283393122256, "ttft_ms": 46.6909579699859, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10606575616, "backend_memory": {"mlx_active_bytes": 9407450120, "mlx_peak_bytes": 9485929708, "mlx_cache_bytes": 6788464926, "process_rss_bytes": 10606575616}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9485929708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "85e397c4c2ab0f98b583c27ca7a7faf3d318256a9b5b9f1082aee4ae59fddf2d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1097 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d830cd0bfdbfeb0a63d2fcff", "attempt_id": "95c2f80c6478", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:49.531652Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 35, "compress_ms": 84.91429104469717}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1347.4062499590218, "doc_prefill_ms": 338.03770900703967, "compress_ms": 1002.9712499817833, "serialize_ms": 6.1152910348027945, "load_ms": 1.4285839861258864, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.7247499525547, "ttft_ms": 36.7247499525547, "decode_ms": 11.90179109107703}, "total_wall_ms": 1400.948458001949, "ttft_ms": 36.7247499525547, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10590158848, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9364262092, "mlx_cache_bytes": 6973112118, "process_rss_bytes": 10590158848}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9364262092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1098 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c830758a01ee53cfa5039fc4", "attempt_id": "74517ece0b7d", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:50.950234Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 43, "compress_ms": 98.41862495522946}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 43, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1358.6930419551209, "doc_prefill_ms": 337.0753329945728, "compress_ms": 1016.1019579973072, "serialize_ms": 5.221625091508031, "load_ms": 1.1700410395860672, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.46270795818418, "ttft_ms": 37.46270795818418, "decode_ms": 141.18429203517735}, "total_wall_ms": 1541.655333014205, "ttft_ms": 37.46270795818418, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 43}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10609033216, "backend_memory": {"mlx_active_bytes": 9299708936, "mlx_peak_bytes": 9377729772, "mlx_cache_bytes": 7023755062, "process_rss_bytes": 10609033216}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9377729772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 395-Z, Mont-Tremblant", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.5714285714285715}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "194eb94fa4b9be3885209d76a44b04b6a59352ce6234f5bbc3ee2915bed70bcd"} | ||||
| 1099 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d2ac71c612ac29a94c449371", "attempt_id": "1639d5bec84b", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:52.512423Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 42, "compress_ms": 90.51429107785225}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 42, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1321.6221670154482, "doc_prefill_ms": 337.77995908167213, "compress_ms": 978.3616660861298, "serialize_ms": 5.16383396461606, "load_ms": 1.0826250072568655, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.64891705941409, "ttft_ms": 37.64891705941409, "decode_ms": 12.082166969776154}, "total_wall_ms": 1375.7257079705596, "ttft_ms": 37.64891705941409, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609033216, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9376894188, "mlx_cache_bytes": 7030538038, "process_rss_bytes": 10609033216}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9376894188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "73c218f1a50d928afb33cad3", "attempt_id": "91f9b04e4189", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:53.907760Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 37, "compress_ms": 81.56491711270064}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 37, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1332.6923340791836, "doc_prefill_ms": 337.317792000249, "compress_ms": 990.2425420004874, "serialize_ms": 4.8353750025853515, "load_ms": 1.1684580240398645, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.244665971025825, "ttft_ms": 36.244665971025825, "decode_ms": 23.61787506379187}, "total_wall_ms": 1396.9011249719188, "ttft_ms": 36.244665971025825, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 10609033216, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9367751916, "mlx_cache_bytes": 7060602678, "process_rss_bytes": 10609033216}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9367751916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "N/A", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "e2f79e5b60330bba4c289962231b6ba2957d0b14e7deb3110417003c79dea635"} | ||||
| 1101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4f8a4d3877220b6e44d365c8", "attempt_id": "68d7198cdef3", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:55.326207Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 45, "compress_ms": 92.04866702202708}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 45, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1344.8270419612527, "doc_prefill_ms": 338.42120796907693, "compress_ms": 1001.3261249987409, "serialize_ms": 4.789208061993122, "load_ms": 0.6844589952379465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.320250063203275, "ttft_ms": 37.320250063203275, "decode_ms": 11.894000112079084}, "total_wall_ms": 1398.0018330039456, "ttft_ms": 37.320250063203275, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609033216, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9381940468, "mlx_cache_bytes": 7104528182, "process_rss_bytes": 10609033216}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9381940468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5b9de1d3b31b33ced705f02c", "attempt_id": "3fd28f306fb7", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:56.744431Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 44, "compress_ms": 84.05966695863754}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 44, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1334.5059159910306, "doc_prefill_ms": 337.0021660812199, "compress_ms": 992.0623330399394, "serialize_ms": 5.137833999469876, "load_ms": 3.2481669913977385, "receiver_prefill_ms": 0.0, "query_prefill_ms": 41.23729094862938, "ttft_ms": 41.23729094862938, "decode_ms": 12.0236249640584}, "total_wall_ms": 1394.3402499426156, "ttft_ms": 41.23729094862938, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609033216, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9379810548, "mlx_cache_bytes": 7110082358, "process_rss_bytes": 10609033216}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9379810548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d186ae6f1595537319493c6", "attempt_id": "d487f05ef774", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:58.158348Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 35, "compress_ms": 78.15666706301272}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1335.4735830798745, "doc_prefill_ms": 337.3405410675332, "compress_ms": 992.7047910168767, "serialize_ms": 5.116416024975479, "load_ms": 1.1376249603927135, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.466916975565255, "ttft_ms": 35.466916975565255, "decode_ms": 12.039624969474971}, "total_wall_ms": 1387.5421250704676, "ttft_ms": 35.466916975565255, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609033216, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9364032716, "mlx_cache_bytes": 7110082358, "process_rss_bytes": 10609033216}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9364032716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f0507de5b4f31d93d67411e7", "attempt_id": "e4eb2c8c802f", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:38:59.566049Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1970, "keep": 492, "window_tokens": 36, "compress_ms": 85.44983400497586}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 36, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153171, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1335.166374919936, "doc_prefill_ms": 337.3828750336543, "compress_ms": 992.6738340873271, "serialize_ms": 4.809958045370877, "load_ms": 1.1927079176530242, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.82645894493908, "ttft_ms": 35.82645894493908, "decode_ms": 11.89970807172358}, "total_wall_ms": 1387.209290987812, "ttft_ms": 35.82645894493908, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10609033216, "backend_memory": {"mlx_active_bytes": 9298234376, "mlx_peak_bytes": 9365638380, "mlx_cache_bytes": 7114637110, "process_rss_bytes": 10609033216}, "peak_prefill_memory": 9985223580, "peak_decode_memory": 9365638380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d5c4482b4a10c6ad41db0e734ce5b688f3ade7c83f6f398c0f735fd2fa96c57", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1b9e48308683d544f91cc7d7", "attempt_id": "7dfdcbca165e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:01.005503Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5994, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2257.3457920225337, "ttft_ms": 12.513917055912316, "decode_ms": 123.51720908191055}, "total_wall_ms": 2404.726375010796, "ttft_ms": 12.513917055912316, "input_usage": {"receiver_prompt_tokens": 5994}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10452959232, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10111814720, "mlx_cache_bytes": 1720710584, "process_rss_bytes": 10452959232}, "peak_prefill_memory": null, "peak_decode_memory": 10111814720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HN-36G-5705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "15422ab9bc2261abb7e4ed834eb86ccf1f15efdfe1aa473c023a8154cf537f8a"} | ||||
| 1106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c7c1be10f6886cb3cd93cee6", "attempt_id": "67ee255de6a1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:03.437337Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5998, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2256.206459016539, "ttft_ms": 12.75058405008167, "decode_ms": 136.86179206706583}, "total_wall_ms": 2416.949374950491, "ttft_ms": 12.75058405008167, "input_usage": {"receiver_prompt_tokens": 5998}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10452975616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10112945216, "mlx_cache_bytes": 2281764280, "process_rss_bytes": 10452975616}, "peak_prefill_memory": null, "peak_decode_memory": 10112945216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 223-B, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "d734dee7dc70a3a594de2b243f7cef738456c14216bf22006021c48ca22b443d"} | ||||
| 1107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "92b95d038dd4a50405cc3864", "attempt_id": "f9ede0ce4b57", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:05.879880Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5999, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2256.250250036828, "ttft_ms": 12.621416943147779, "decode_ms": 86.31204208359122}, "total_wall_ms": 2366.5936670731753, "ttft_ms": 12.621416943147779, "input_usage": {"receiver_prompt_tokens": 5999}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453008384, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10113076288, "mlx_cache_bytes": 2616784312, "process_rss_bytes": 10453008384}, "peak_prefill_memory": null, "peak_decode_memory": 10113076288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "62.7359", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "1f0e9c1eb5863e282e657769c73cf38fbb2fce4a6a062186a1936ce9c92d9039"} | ||||
| 1108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "079c30f543818b98f0c619ea", "attempt_id": "82ac5ce34201", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:08.274184Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5994, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2255.0227909814566, "ttft_ms": 12.681958032771945, "decode_ms": 74.3832919979468}, "total_wall_ms": 2353.5233750008047, "ttft_ms": 12.681958032771945, "input_usage": {"receiver_prompt_tokens": 5994}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10453024768, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10111814720, "mlx_cache_bytes": 2616784312, "process_rss_bytes": 10453024768}, "peak_prefill_memory": null, "peak_decode_memory": 10111814720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ludivine Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "95de06131699f7047cfa187427424e233c7eaf108b642ae83c9982ac56b820f6"} | ||||
| 1109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "df1f978b1dcaf5874421232a", "attempt_id": "a444649c0edf", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:10.654553Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 6001, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2254.450250067748, "ttft_ms": 12.610791949555278, "decode_ms": 86.40929195098579}, "total_wall_ms": 2364.441333920695, "ttft_ms": 12.610791949555278, "input_usage": {"receiver_prompt_tokens": 6001}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453057536, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10113469504, "mlx_cache_bytes": 2952197560, "process_rss_bytes": 10453057536}, "peak_prefill_memory": null, "peak_decode_memory": 10113469504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1819325", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "9ad998f719c5fdb563ba3bfa5ae093d0080a4fa0910a5bc8a9d191883d0231e6"} | ||||
| 1110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "75242bab0990c0555191a6b9", "attempt_id": "bddc75424510", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:13.045030Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 6004, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2256.9940420798957, "ttft_ms": 12.502791942097247, "decode_ms": 135.62820898368955}, "total_wall_ms": 2415.9413329325616, "ttft_ms": 12.502791942097247, "input_usage": {"receiver_prompt_tokens": 6004}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 10453090304, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10114600000, "mlx_cache_bytes": 3546101176, "process_rss_bytes": 10453090304}, "peak_prefill_memory": null, "peak_decode_memory": 10114600000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CJ-18G-5232", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "d5b9ff6e43d42f9b616560ee8a3eb4eab140f9ef8979d350ad85abf5d04e24ef"} | ||||
| 1111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1e3e62dee370a92c81713128", "attempt_id": "d0a1aa62e5c0", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:15.486457Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5993, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2255.681207985617, "ttft_ms": 12.441208004020154, "decode_ms": 12.385415961034596}, "total_wall_ms": 2291.346790967509, "ttft_ms": 12.441208004020154, "input_usage": {"receiver_prompt_tokens": 5993}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453123072, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10111552576, "mlx_cache_bytes": 3880072632, "process_rss_bytes": 10453123072}, "peak_prefill_memory": null, "peak_decode_memory": 10111552576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d9e5eb2e3b6f9f6ff1de34d6", "attempt_id": "dc2134a5d3ad", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:17.803754Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5995, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0153339933604002, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2255.7297910097986, "ttft_ms": 12.58683402556926, "decode_ms": 12.410124996677041}, "total_wall_ms": 2291.95833299309, "ttft_ms": 12.58683402556926, "input_usage": {"receiver_prompt_tokens": 5995}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453155840, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10111945792, "mlx_cache_bytes": 4214437304, "process_rss_bytes": 10453155840}, "peak_prefill_memory": null, "peak_decode_memory": 10111945792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a82cd5749fb2fac490fd906e", "attempt_id": "be72d6f7b849", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:23.399715Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 366, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.41091593168676, "ttft_ms": 11.873082956299186, "decode_ms": 11.786125018261373}, "total_wall_ms": 172.20070806797594, "ttft_ms": 11.873082956299186, "input_usage": {"receiver_prompt_tokens": 366, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500496432, "mlx_cache_bytes": 5941762924, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9500496432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "819d4d253bd7afa40488baee", "attempt_id": "b48f3d344e7b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:23.598627Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 370, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.03674991242588, "ttft_ms": 11.81174989324063, "decode_ms": 11.756250052712858}, "total_wall_ms": 167.58095799013972, "ttft_ms": 11.81174989324063, "input_usage": {"receiver_prompt_tokens": 370, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9502921280, "mlx_cache_bytes": 6170960176, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9502921280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cfa984f411c2654b4f9b78ba", "attempt_id": "5bf60b07b2f1", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:23.792093Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 371, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.14708299934864, "ttft_ms": 11.75595901440829, "decode_ms": 11.69366599060595}, "total_wall_ms": 167.54650010261685, "ttft_ms": 11.75595901440829, "input_usage": {"receiver_prompt_tokens": 371, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503412804, "mlx_cache_bytes": 6301509368, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9503412804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "acbdff26d7472fb08eff8b47", "attempt_id": "cffe56367a2a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:23.984830Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 366, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.77270797174424, "ttft_ms": 11.767915915697813, "decode_ms": 11.638624942861497}, "total_wall_ms": 167.0456250431016, "ttft_ms": 11.767915915697813, "input_usage": {"receiver_prompt_tokens": 366, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500496432, "mlx_cache_bytes": 6301509368, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9500496432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "db97af0fe4d6bfd0beac6297", "attempt_id": "213e02d97aa8", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:24.176815Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 373, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.6602080464363, "ttft_ms": 11.956167058087885, "decode_ms": 11.984957964159548}, "total_wall_ms": 167.86037501879036, "ttft_ms": 11.956167058087885, "input_usage": {"receiver_prompt_tokens": 373, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503904332, "mlx_cache_bytes": 6432582856, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9503904332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aeb81222e7a826e7adf60dd3", "attempt_id": "c4cdf5b13fab", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:24.370424Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 376, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 143.6004580464214, "ttft_ms": 11.68083306401968, "decode_ms": 11.59254100639373}, "total_wall_ms": 167.8445830475539, "ttft_ms": 11.68083306401968, "input_usage": {"receiver_prompt_tokens": 376, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9505821272, "mlx_cache_bytes": 6652490404, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9505821272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "085e107576a03467a34ceaa0", "attempt_id": "a9ae193a8919", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:24.564894Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 365, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.58841692935675, "ttft_ms": 11.713749961927533, "decode_ms": 11.815625010058284}, "total_wall_ms": 166.977750021033, "ttft_ms": 11.713749961927533, "input_usage": {"receiver_prompt_tokens": 365, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500496432, "mlx_cache_bytes": 6652490404, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9500496432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a7a7b6f4b6b87e38e5b8a58f", "attempt_id": "56ec1551dd3b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:24.757530Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 367, "message_tokens": 286, "message_utf8_bytes": 1424, "cache_tensor_bytes": null, "serialized_payload_bytes": 1424, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3277.943250024691, "decode_payload_ms": 0.0, "receiver_prefill_ms": 142.89466699119657, "ttft_ms": 11.796041973866522, "decode_ms": 11.720958049409091}, "total_wall_ms": 167.30808396823704, "ttft_ms": 11.796041973866522, "input_usage": {"receiver_prompt_tokens": 367, "sender_input_tokens": 6034, "sender_output_tokens": 286, "sender_prefill_ms": 1145.6577910576016, "sender_ttft_ms": 26.120458962395787, "sender_decode_ms": 2100.1872080378234}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453204992, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9500742208, "mlx_cache_bytes": 6781465252, "process_rss_bytes": 10453204992}, "peak_prefill_memory": null, "peak_decode_memory": 9500742208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "96d8f199af46ccea230c97348521c6aeabe73767e9b4bb94c28463fd9b183d51", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "35bc30f7820695242a5900b3", "attempt_id": "14c285d211cd", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:29.904566Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 409, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 167.02699998859316, "ttft_ms": 12.099749990738928, "decode_ms": 11.91124995239079}, "total_wall_ms": 192.09716597106308, "ttft_ms": 12.099749990738928, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453254144, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9525794940, "mlx_cache_bytes": 7930917540, "process_rss_bytes": 10453254144}, "peak_prefill_memory": null, "peak_decode_memory": 9525794940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "66842cdb83c3918eb176c41d", "attempt_id": "e6e5ed14873a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:30.124506Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 413, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.2479999680072, "ttft_ms": 11.943291989155114, "decode_ms": 118.24262503068894}, "total_wall_ms": 294.42591697443277, "ttft_ms": 11.943291989155114, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453254144, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9528219772, "mlx_cache_bytes": 8185967268, "process_rss_bytes": 10453254144}, "peak_prefill_memory": null, "peak_decode_memory": 9528219772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 629-S in Schefferville", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.5}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "2e6b386df2d7bc4447ffdd62004f6e9c99d1973a5bce0245176f6cf570b2ac8c"} | ||||
| 1123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "09aec0650b03ae34dafe3111", "attempt_id": "32834060924a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:30.445825Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 414, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.33120805211365, "ttft_ms": 11.857916950248182, "decode_ms": 11.793500045314431}, "total_wall_ms": 187.8147500101477, "ttft_ms": 11.857916950248182, "input_usage": {"receiver_prompt_tokens": 414, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453270528, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9529399420, "mlx_cache_bytes": 8428581540, "process_rss_bytes": 10453270528}, "peak_prefill_memory": null, "peak_decode_memory": 9529399420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ebb9cd57527598aae0e6f1b2", "attempt_id": "f8d4e2d137e3", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:30.659789Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 409, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.87841596547514, "ttft_ms": 11.983709060586989, "decode_ms": 11.890334077179432}, "total_wall_ms": 186.70529103837907, "ttft_ms": 11.983709060586989, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453286912, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9525794940, "mlx_cache_bytes": 8428581540, "process_rss_bytes": 10453286912}, "peak_prefill_memory": null, "peak_decode_memory": 9525794940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ac15df4eded70cb88ebc25f0", "attempt_id": "4103d7ab4492", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:30.873005Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 416, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 163.53824990801513, "ttft_ms": 11.890833033248782, "decode_ms": 117.07070795819163}, "total_wall_ms": 293.4193330584094, "ttft_ms": 11.890833033248782, "input_usage": {"receiver_prompt_tokens": 416, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453303296, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9530136700, "mlx_cache_bytes": 8574857892, "process_rss_bytes": 10453303296}, "peak_prefill_memory": null, "peak_decode_memory": 9530136700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,575,375 CAD", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "90299052491619c9ac50a5ef11c60292ea23e946b3943caae8d16c694c469ea0"} | ||||
| 1126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a0a2b3d1c7b8afdebe722653", "attempt_id": "d17d04924f96", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:31.193137Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 419, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 166.11195809673518, "ttft_ms": 11.950582964345813, "decode_ms": 11.849750066176057}, "total_wall_ms": 190.89404097758234, "ttft_ms": 11.950582964345813, "input_usage": {"receiver_prompt_tokens": 419, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453303296, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9532708988, "mlx_cache_bytes": 8839639716, "process_rss_bytes": 10453303296}, "peak_prefill_memory": null, "peak_decode_memory": 9532708988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "49a75622f3c4d168e04743b0", "attempt_id": "6cbf37a613a6", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:31.411728Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 408, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 162.05358307342976, "ttft_ms": 11.842499952763319, "decode_ms": 11.852415977045894}, "total_wall_ms": 186.5706250537187, "ttft_ms": 11.842499952763319, "input_usage": {"receiver_prompt_tokens": 408, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453319680, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9525303420, "mlx_cache_bytes": 8983032484, "process_rss_bytes": 10453319680}, "peak_prefill_memory": null, "peak_decode_memory": 9525303420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2d513ff2cd71a3b747e16e5a", "attempt_id": "40d740a4aeb8", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:31.624370Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 410, "message_tokens": 317, "message_utf8_bytes": 726, "cache_tensor_bytes": null, "serialized_payload_bytes": 726, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4954.054625006393, "decode_payload_ms": 0.0, "receiver_prefill_ms": 161.7901249555871, "ttft_ms": 11.849874979816377, "decode_ms": 11.782250017859042}, "total_wall_ms": 186.2426670268178, "ttft_ms": 11.849874979816377, "input_usage": {"receiver_prompt_tokens": 410, "sender_input_tokens": 6062, "sender_output_tokens": 512, "sender_prefill_ms": 1151.6237918986008, "sender_ttft_ms": 7.7014160342514515, "sender_decode_ms": 3788.6792920762673}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453319680, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9527236732, "mlx_cache_bytes": 9127211684, "process_rss_bytes": 10453319680}, "peak_prefill_memory": null, "peak_decode_memory": 9527236732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0c989ab5797c44b755d3e30f60ba387f938771196dfd8079f6ba28fc4ccb35bf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4ea60c87dad99e49c7793fe4", "attempt_id": "8820a8b6a737", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:33.054197Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 4.439832991920412, "receiver_prefill_ms": 0.0, "query_prefill_ms": 87.99516595900059, "ttft_ms": 87.99516595900059, "decode_ms": 635.2177920052782}, "total_wall_ms": 733.2390829687938, "ttft_ms": 87.99516595900059, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893541376, "backend_memory": {"mlx_active_bytes": 9702853640, "mlx_peak_bytes": 9810709716, "mlx_cache_bytes": 10386617293, "process_rss_bytes": 10893541376}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9810709716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "( 4:1;)\ndo:1:1:1:1: 以华十七編本()[編注:的，C(1: 10/anedi的,祝:000个+", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "c27f402b58ca5e232c7ca31a346eba2cedce9c5f26906c3cea4043bf0eb45a82"} | ||||
| 1130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "40588b71da6ae6d0fce2d73d", "attempt_id": "fa84b2d40db1", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:33.814610Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 41, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 1.7753749853000045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.03170795179904, "ttft_ms": 79.03170795179904, "decode_ms": 634.760333923623}, "total_wall_ms": 720.915750018321, "ttft_ms": 79.03170795179904, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893541376, "backend_memory": {"mlx_active_bytes": 9702853640, "mlx_peak_bytes": 9818852580, "mlx_cache_bytes": 10458182933, "process_rss_bytes": 10893541376}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9818852580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Coulder��Serializable to the \"Grenotes(几光头”的身份链“.$(1)().c墩著”)，除了“小人件访问网：_().COM-G的厉害方中，进化的\"", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "05f6d905f82fe1112d3609b9385dae03b8fc98fd1172ebfbbe866b53be07eadb"} | ||||
| 1131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4be6921949b9dd5caeea6c1c", "attempt_id": "ca216dbde1f4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:34.562291Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 42, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 1.660750014707446, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.52395800687373, "ttft_ms": 76.52395800687373, "decode_ms": 635.5956660117954}, "total_wall_ms": 719.4742910796776, "ttft_ms": 76.52395800687373, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893541376, "backend_memory": {"mlx_active_bytes": 9702853640, "mlx_peak_bytes": 9819966696, "mlx_cache_bytes": 10518918757, "process_rss_bytes": 10893541376}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9819966696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ao samescore: dun情书夏令人们\nq1.ao的问,在微风的，打的，小：P_1:4:都吃的，小1:横向下的\"的，那一定", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "5682d294b540e07426e149f2dd7a3dba5c9daafab6abe2fcdc87f9f62eca6d5e"} | ||||
| 1132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6706de9804647a1786c4027d", "attempt_id": "dc3f279a6746", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:35.308641Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 1.7701250035315752, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.24054096918553, "ttft_ms": 74.24054096918553, "decode_ms": 634.2916660942137}, "total_wall_ms": 715.6072499928996, "ttft_ms": 74.24054096918553, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893541376, "backend_memory": {"mlx_active_bytes": 9702853640, "mlx_peak_bytes": 9810709716, "mlx_cache_bytes": 10518918757, "process_rss_bytes": 10893541376}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9810709716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(0-Lo(to:.(xcheng 20-grams)0-3auogm(),\n.|)0(實態學力學ン方Engine):(1,中文之道)！,懂的，眨眼\nX", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "887459916757b69dc89af089c30ed18da3c91dccbb1c4546f22e30819b105139"} | ||||
| 1133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cb1d36837019342ac80355b8", "attempt_id": "6fad96fd1beb", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:36.051183Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 44, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 1.7661249730736017, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.4858340844512, "ttft_ms": 76.4858340844512, "decode_ms": 635.3301660856232}, "total_wall_ms": 719.3667080719024, "ttft_ms": 76.4858340844512, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893557760, "backend_memory": {"mlx_active_bytes": 9702853640, "mlx_peak_bytes": 9822407920, "mlx_cache_bytes": 10572953541, "process_rss_bytes": 10893557760}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9822407920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\".\"@(与我方和b+d:的,在小七座上马的，用人的三連退让三連.properties:。方程之文与答案，请德方和气球王的，我先", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "fc59a97e4308e48d6e076c0cfa95c447c7811208165ed2f4a1683377a8bee284"} | ||||
| 1134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ad8fe5a7b6454aac05436572", "attempt_id": "4b2eee8ee1d5", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:36.797291Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 47, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 1.8129590898752213, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.68404097482562, "ttft_ms": 79.68404097482562, "decode_ms": 636.1482499632984}, "total_wall_ms": 723.6957079730928, "ttft_ms": 79.68404097482562, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 47}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893557760, "backend_memory": {"mlx_active_bytes": 9704033288, "mlx_peak_bytes": 9828453628, "mlx_cache_bytes": 10869766461, "process_rss_bytes": 10893557760}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9828453628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wuzo (20)Osborne's law-dictate man on and thesityeat: Pastic (pas - 1: 1) c (). Even $等:16: pavanin,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "d80a7631086e36a82f191f2c3b75a21bb82d4bfd84bac7945f192b3a6dd6f774"} | ||||
| 1135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a0d151159f6e470664157238", "attempt_id": "bfb2ebb8f973", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:37.548937Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 36, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 1.77716591861099, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.57904089055955, "ttft_ms": 72.57904089055955, "decode_ms": 636.9014169322327}, "total_wall_ms": 716.6245409753174, "ttft_ms": 72.57904089055955, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893557760, "backend_memory": {"mlx_active_bytes": 9702853640, "mlx_peak_bytes": 9809349844, "mlx_cache_bytes": 10913610045, "process_rss_bytes": 10893557760}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9809349844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "A (高)[被動量表文傳址不一定是分不清高(tho,加码不走 。().P(1)答案'.$url_1.png以n多串优酷名件体制，听起来是", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "8cabf4451a9aec63279fce9b75f712620ea7966d6307f61ecb89730b3d1bb443"} | ||||
| 1136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a8d0b1c7c3829d2b8f87ecdb", "attempt_id": "52f7b53b50f7", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:38.293069Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 38, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615040, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1217.7794999442995, "doc_prefill_ms": 1131.364667089656, "compress_ms": 13.3189168991521, "serialize_ms": 61.31158396601677, "load_ms": 1.858290983363986, "receiver_prefill_ms": 0.0, "query_prefill_ms": 74.16750001721084, "ttft_ms": 74.16750001721084, "decode_ms": 637.5150420935825}, "total_wall_ms": 719.7126250248402, "ttft_ms": 74.16750001721084, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10893557760, "backend_memory": {"mlx_active_bytes": 9702853640, "mlx_peak_bytes": 9812020452, "mlx_cache_bytes": 10955045181, "process_rss_bytes": 10893557760}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9812020452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "In a.1)\n##.FlORroboUS-1 for the Internet Past 4:__.)\n- a:0:1: BestS_1_v=1: 8:ge60_1:0:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3233e15d80cd5e0e632e8da8b34e5bdf48fe47203863522d1ee0a9a28a116110", "output_hash": "a6d115785efc8a06fa55288422901d028e99dab092631585cbfab0e50a723ca7"} | ||||
| 1137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7d5f06193d0b19841fb9f944", "attempt_id": "a540a13471c3", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:42.362437Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.8084169132634997, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.17729201633483, "ttft_ms": 78.17729201633483, "decode_ms": 13.683749944902956}, "total_wall_ms": 98.997832974419, "ttft_ms": 78.17729201633483, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9810709716, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9810709716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6d246924f252249d78c48c4f", "attempt_id": "118ee1e770ec", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:42.488702Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 41, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.9592499593272805, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.7152909906581, "ttft_ms": 78.7152909906581, "decode_ms": 13.612334034405649}, "total_wall_ms": 99.57704204134643, "ttft_ms": 78.7152909906581, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9818655972, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9818655972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "59b4000cb49602daa3d67fac", "attempt_id": "bf88f5ee2989", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:42.614662Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 42, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.7607499612495303, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.73295896872878, "ttft_ms": 75.73295896872878, "decode_ms": 13.528374955058098}, "total_wall_ms": 96.24520794022828, "ttft_ms": 75.73295896872878, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9819966696, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9819966696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8fc50f0dc348b865df8c8765", "attempt_id": "ae2db62e27c5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:42.736782Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.6032089479267597, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.21291603147984, "ttft_ms": 73.21291603147984, "decode_ms": 13.52849998511374}, "total_wall_ms": 93.59183302149177, "ttft_ms": 73.21291603147984, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9810709716, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9810709716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "92726e10229f936522cc3fc0", "attempt_id": "a8a2ea0f1da0", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:42.856160Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 44, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.9247500458732247, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.31016697268933, "ttft_ms": 76.31016697268933, "decode_ms": 13.549958006478846}, "total_wall_ms": 97.60004200506955, "ttft_ms": 76.31016697268933, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9822407920, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9822407920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "15444b568cfc75c831107e7d", "attempt_id": "3b28ea72787b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:42.979153Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 47, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.767416950315237, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.96974997129291, "ttft_ms": 78.96974997129291, "decode_ms": 13.737958972342312}, "total_wall_ms": 99.75841594859958, "ttft_ms": 78.96974997129291, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9828502780, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9828502780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6ece20988c12f4cbf61fe2d2", "attempt_id": "25379be5bdd9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:43.105102Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 36, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.8338750815019011, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.25808291696012, "ttft_ms": 72.25808291696012, "decode_ms": 13.613875024020672}, "total_wall_ms": 93.27704203315079, "ttft_ms": 72.25808291696012, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9809349844, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9809349844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "521d217e029bdc3eb7c29dba", "attempt_id": "4b7183bf62c2", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:43.224240Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9479900168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 38, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 219598848, "serialized_payload_bytes": 219615141, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3316.0847909748554, "doc_prefill_ms": 1130.4863749537617, "compress_ms": 2109.6049159532413, "serialize_ms": 75.66545903682709, "load_ms": 1.7706250073388219, "receiver_prefill_ms": 0.0, "query_prefill_ms": 73.88591708149761, "ttft_ms": 73.88591708149761, "decode_ms": 13.605916989035904}, "total_wall_ms": 95.04912502598017, "ttft_ms": 73.88591708149761, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10966777856, "backend_memory": {"mlx_active_bytes": 9701673992, "mlx_peak_bytes": 9812020452, "mlx_cache_bytes": 10968447293, "process_rss_bytes": 10966777856}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9812020452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5d0438c27e70fe779f98ef282d2b4e5708a0c5c2b9d254a8b5ec1b987c33c8c9", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1c1c5c3dbb06b8997bb3da3b", "attempt_id": "f42e756846dc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:43.344805Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 37, "compress_ms": 120.52012502681464}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906853, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3395.094499923289, "doc_prefill_ms": 1131.5795419504866, "compress_ms": 2245.4522089101374, "serialize_ms": 17.70800002850592, "load_ms": 1.932875020429492, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.32883295137435, "ttft_ms": 43.32883295137435, "decode_ms": 12.303167022764683}, "total_wall_ms": 3464.969541062601, "ttft_ms": 43.32883295137435, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10876534784, "backend_memory": {"mlx_active_bytes": 9371634696, "mlx_peak_bytes": 9448525012, "mlx_cache_bytes": 11490154197, "process_rss_bytes": 10876534784}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9448525012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "06e09d7fb5468247d0142c19934d945cbd5ae74f46e78b5458b83f266907f716", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "45805fdd0d9c72cb8d1c2616", "attempt_id": "409b5e83e741", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:46.835963Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 41, "compress_ms": 124.90258307661861}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 41, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906853, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3433.1007500877604, "doc_prefill_ms": 1131.824875017628, "compress_ms": 2284.7844579955563, "serialize_ms": 16.139125102199614, "load_ms": 1.3355830451473594, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.941874919459224, "ttft_ms": 44.941874919459224, "decode_ms": 12.37895805388689}, "total_wall_ms": 3504.3235409539193, "ttft_ms": 44.941874919459224, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10931978240, "backend_memory": {"mlx_active_bytes": 9371634696, "mlx_peak_bytes": 9455209700, "mlx_cache_bytes": 11528935125, "process_rss_bytes": 10931978240}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9455209700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "06e09d7fb5468247d0142c19934d945cbd5ae74f46e78b5458b83f266907f716", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3be48ecdbf6632b7ae65b12f", "attempt_id": "859a08687a34", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:50.368190Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 42, "compress_ms": 120.99408404901624}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 42, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906853, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3416.3237079046667, "doc_prefill_ms": 1131.1332089826465, "compress_ms": 2270.3089580172673, "serialize_ms": 14.520708937197924, "load_ms": 1.3180000241845846, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.20166707132012, "ttft_ms": 44.20166707132012, "decode_ms": 12.15562503784895}, "total_wall_ms": 3484.2845409875736, "ttft_ms": 44.20166707132012, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10931978240, "backend_memory": {"mlx_active_bytes": 9371634696, "mlx_peak_bytes": 9456487656, "mlx_cache_bytes": 11569534677, "process_rss_bytes": 10931978240}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9456487656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "06e09d7fb5468247d0142c19934d945cbd5ae74f46e78b5458b83f266907f716", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dcdbf9d8f12bf9d8bad50445", "attempt_id": "01b76aaf63c2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:53.880472Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 37, "compress_ms": 117.81312501989305}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906853, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3440.057041007094, "doc_prefill_ms": 1131.4109589438885, "compress_ms": 2293.1479580001906, "serialize_ms": 15.098917065188289, "load_ms": 1.3016669545322657, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.16366696730256, "ttft_ms": 43.16366696730256, "decode_ms": 12.303666095249355}, "total_wall_ms": 3507.5368750840425, "ttft_ms": 43.16366696730256, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10932011008, "backend_memory": {"mlx_active_bytes": 9371634696, "mlx_peak_bytes": 9448295636, "mlx_cache_bytes": 11569534677, "process_rss_bytes": 10932011008}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9448295636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "06e09d7fb5468247d0142c19934d945cbd5ae74f46e78b5458b83f266907f716", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9754c231d8a705453db9bc33", "attempt_id": "747325b15e07", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:39:57.416022Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 44, "compress_ms": 125.46912499237806}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 44, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906853, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3425.745000015013, "doc_prefill_ms": 1130.8954170672223, "compress_ms": 2279.6368340495974, "serialize_ms": 14.84462502412498, "load_ms": 1.2999159516766667, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.31529203429818, "ttft_ms": 44.31529203429818, "decode_ms": 12.251124950125813}, "total_wall_ms": 3494.2212500609457, "ttft_ms": 44.31529203429818, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10932043776, "backend_memory": {"mlx_active_bytes": 9371634696, "mlx_peak_bytes": 9459715312, "mlx_cache_bytes": 11610904277, "process_rss_bytes": 10932043776}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9459715312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "06e09d7fb5468247d0142c19934d945cbd5ae74f46e78b5458b83f266907f716", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cf7bd035efb3e15b4f4587c6", "attempt_id": "f184cd0acc90", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:00.938667Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 47, "compress_ms": 125.79387507867068}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 47, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906853, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3455.5858341045678, "doc_prefill_ms": 1131.0415420448408, "compress_ms": 2309.2859579483047, "serialize_ms": 14.86362493596971, "load_ms": 1.3368329964578152, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.92491707019508, "ttft_ms": 42.92491707019508, "decode_ms": 12.275165994651616}, "total_wall_ms": 3522.76379102841, "ttft_ms": 42.92491707019508, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10932076544, "backend_memory": {"mlx_active_bytes": 9372584968, "mlx_peak_bytes": 9465138428, "mlx_cache_bytes": 11687433941, "process_rss_bytes": 10932076544}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9465138428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "06e09d7fb5468247d0142c19934d945cbd5ae74f46e78b5458b83f266907f716", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "67edfb5410ddd1616866366b", "attempt_id": "9febf333a993", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:04.489345Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 36, "compress_ms": 116.42049998044968}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 36, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906853, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3415.8433340489864, "doc_prefill_ms": 1131.9992080098018, "compress_ms": 2268.93179200124, "serialize_ms": 14.526625047437847, "load_ms": 1.2725830310955644, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.17712504416704, "ttft_ms": 43.17712504416704, "decode_ms": 12.278415961191058}, "total_wall_ms": 3482.4329160619527, "ttft_ms": 43.17712504416704, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10932076544, "backend_memory": {"mlx_active_bytes": 9371634696, "mlx_peak_bytes": 9446296788, "mlx_cache_bytes": 11718776533, "process_rss_bytes": 10932076544}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9446296788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "06e09d7fb5468247d0142c19934d945cbd5ae74f46e78b5458b83f266907f716", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "299c61449507ab4a825690d7", "attempt_id": "3af20b17ddb2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:07.999519Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 5957, "keep": 1489, "window_tokens": 38, "compress_ms": 119.6281670127064}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 38, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 54890496, "serialized_payload_bytes": 54906852, "side_information_bytes": 16356, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3429.150583106093, "doc_prefill_ms": 1130.3911249851808, "compress_ms": 2284.2306660022587, "serialize_ms": 14.162792009301484, "load_ms": 1.3386659556999803, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.64716704003513, "ttft_ms": 43.64716704003513, "decode_ms": 12.242124998010695}, "total_wall_ms": 3494.942000019364, "ttft_ms": 43.64716704003513, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10932092928, "backend_memory": {"mlx_active_bytes": 9371634696, "mlx_peak_bytes": 9449639140, "mlx_cache_bytes": 11753821909, "process_rss_bytes": 10932092928}, "peak_prefill_memory": 10101558360, "peak_decode_memory": 9449639140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f7277249717f7a4c46c4660b6e8028a022f4b8b707bc763280db0c995c3b4c99", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9fca60d9f96a7886f12ea4f", "attempt_id": "8f8a448fb477", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:11.569844Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2095, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 738.4930000407621, "ttft_ms": 12.08470796700567, "decode_ms": 119.74362505134195}, "total_wall_ms": 874.0677919704467, "ttft_ms": 12.08470796700567, "input_usage": {"receiver_prompt_tokens": 2095}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10489708544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443236, "mlx_cache_bytes": 888325744, "process_rss_bytes": 10489708544}, "peak_prefill_memory": null, "peak_decode_memory": 9974443236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SG-71V-9728", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "94ef569f58ec7cdeddf26b386e487290438f3e57fc011d3d3a6642596b12868e"} | ||||
| 1154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1de935d10fe783c9fcba0301", "attempt_id": "a57ae2ed855d", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:12.465104Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2100, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 732.972375000827, "ttft_ms": 12.251875014044344, "decode_ms": 119.69950003549457}, "total_wall_ms": 868.2615840807557, "ttft_ms": 12.251875014044344, "input_usage": {"receiver_prompt_tokens": 2100}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10489724928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443256, "mlx_cache_bytes": 973842236, "process_rss_bytes": 10489724928}, "peak_prefill_memory": null, "peak_decode_memory": 9974443256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 190-P, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "0fa1acfc9039f77897e3ffbd0deeeed4b1235e31057039ad326fb186ab4dd01d"} | ||||
| 1155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b037d6e11788f18c77723529", "attempt_id": "59f698daf322", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:13.351792Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2100, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 733.0715839052573, "ttft_ms": 12.118124985136092, "decode_ms": 83.85095896665007}, "total_wall_ms": 832.3732500430197, "ttft_ms": 12.118124985136092, "input_usage": {"receiver_prompt_tokens": 2100}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10489724928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443256, "mlx_cache_bytes": 973842236, "process_rss_bytes": 10489724928}, "peak_prefill_memory": null, "peak_decode_memory": 9974443256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "58.1930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "f8b96734f272699c055eafd0bfd34e83bdddc244e4b7bad68a9902432bdfc16b"} | ||||
| 1156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c1f19c4b6cc4e974d8643412", "attempt_id": "c8fe3f77a6b1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:14.201909Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2094, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 732.2987499646842, "ttft_ms": 12.01387494802475, "decode_ms": 59.91395900491625}, "total_wall_ms": 807.6502500334755, "ttft_ms": 12.01387494802475, "input_usage": {"receiver_prompt_tokens": 2094}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10489724928, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443236, "mlx_cache_bytes": 1000384316, "process_rss_bytes": 10489724928}, "peak_prefill_memory": null, "peak_decode_memory": 9974443236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ewan Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "d9d322de72158e519af3cc6f1c243fe729fb9b5de8e914fa30164ed490e36715"} | ||||
| 1157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a903b0346e15044f5c04bcf1", "attempt_id": "1c697e1a7a8f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:15.027323Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2103, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 733.7905409513041, "ttft_ms": 12.00845802668482, "decode_ms": 83.9385410072282}, "total_wall_ms": 833.087082952261, "ttft_ms": 12.00845802668482, "input_usage": {"receiver_prompt_tokens": 2103}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10489741312, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443268, "mlx_cache_bytes": 1081919508, "process_rss_bytes": 10489741312}, "peak_prefill_memory": null, "peak_decode_memory": 9974443268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4546236", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "1f4facf219dd0720934b6f83c0626d7646485eade86358d7f8b7c72f09f02b50"} | ||||
| 1158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "177eddaa8503cfbfff06cd5f", "attempt_id": "afab4df03ac6", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:15.878401Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2105, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 733.1401670817286, "ttft_ms": 11.98458403814584, "decode_ms": 119.77766698691994}, "total_wall_ms": 868.1685000192374, "ttft_ms": 11.98458403814584, "input_usage": {"receiver_prompt_tokens": 2105}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10489708544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443276, "mlx_cache_bytes": 1153231092, "process_rss_bytes": 10489708544}, "peak_prefill_memory": null, "peak_decode_memory": 9974443276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "KK-23U-4457", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "acfa14a945c38304143f718fff58942685646504a77cc76ae2a4fdb9f13d938d"} | ||||
| 1159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8c478b3acb6376f7c7be906a", "attempt_id": "08ff85c60059", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:16.764373Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2096, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 732.860374962911, "ttft_ms": 12.027082964777946, "decode_ms": 11.951500084251165}, "total_wall_ms": 760.0988750346005, "ttft_ms": 12.027082964777946, "input_usage": {"receiver_prompt_tokens": 2096}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489708544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443256, "mlx_cache_bytes": 1213704436, "process_rss_bytes": 10489708544}, "peak_prefill_memory": null, "peak_decode_memory": 9974443256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5c145b5972696f9817c4fc5f", "attempt_id": "eda92e7f137f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:17.542272Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2096, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009624985978007317, "decode_payload_ms": 0.0, "receiver_prefill_ms": 732.6457500457764, "ttft_ms": 12.014082982204854, "decode_ms": 11.970957973971963}, "total_wall_ms": 759.8694170592353, "ttft_ms": 12.014082982204854, "input_usage": {"receiver_prompt_tokens": 2096}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489708544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9974443256, "mlx_cache_bytes": 1213704436, "process_rss_bytes": 10489708544}, "peak_prefill_memory": null, "peak_decode_memory": 9974443256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4001fb5950688c5b0d9af5be", "attempt_id": "4dfb388e6bae", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:22.328310Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.95429204497486, "ttft_ms": 12.017750064842403, "decode_ms": 11.941666947677732}, "total_wall_ms": 257.25404103286564, "ttft_ms": 12.017750064842403, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489741312, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 2370609744, "process_rss_bytes": 10489741312}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3d5ee1d91a8f83864d609d51", "attempt_id": "7065e02db018", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:22.606170Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.23416599910706, "ttft_ms": 11.92241592798382, "decode_ms": 153.91695802100003}, "total_wall_ms": 394.1442919895053, "ttft_ms": 11.92241592798382, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 13}, "provider_cached_usage": null, "process_memory": 10489741312, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 2630427216, "process_rss_bytes": 10489741312}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 378-F, Lebel-sur-Richelieu", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.28571428571428575}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "59a84b1ec2efd93f44fa1d65590ea1993f5890859565b53a95949f465181de99"} | ||||
| 1163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c656d5bb26ad6984afb92ee0", "attempt_id": "902b25ce7b47", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:23.018544Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.1877090204507, "ttft_ms": 11.910417000763118, "decode_ms": 82.9049589810893}, "total_wall_ms": 322.0327500021085, "ttft_ms": 11.910417000763118, "input_usage": {"receiver_prompt_tokens": 596, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10489741312, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567197272, "mlx_cache_bytes": 2630427216, "process_rss_bytes": 10489741312}, "peak_prefill_memory": null, "peak_decode_memory": 9567197272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "58.1930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "f8b96734f272699c055eafd0bfd34e83bdddc244e4b7bad68a9902432bdfc16b"} | ||||
| 1164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "487b36ad40e528401f73dbc3", "attempt_id": "426b9585d4b4", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:23.358451Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 590, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.4481249731034, "ttft_ms": 11.928625055588782, "decode_ms": 11.838666978292167}, "total_wall_ms": 251.22866709716618, "ttft_ms": 11.928625055588782, "input_usage": {"receiver_prompt_tokens": 590, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489757696, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9564739672, "mlx_cache_bytes": 2630427216, "process_rss_bytes": 10489757696}, "peak_prefill_memory": null, "peak_decode_memory": 9564739672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ef5941fd22897d73a4f6b09c", "attempt_id": "971871dc19c6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:23.627567Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.12216700892895, "ttft_ms": 11.885292013175786, "decode_ms": 106.66495794430375}, "total_wall_ms": 346.7489159666002, "ttft_ms": 11.885292013175786, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10489774080, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 2891719248, "process_rss_bytes": 10489774080}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,561,075", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "c333ae14fcb7feb1a46b0f6a7a6234c6a95387c7451cc5594076330e3d435747"} | ||||
| 1166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "019503b12081d60fb72e712f", "attempt_id": "899e824b7118", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:23.992201Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.90220805816352, "ttft_ms": 12.096375110559165, "decode_ms": 11.873833951540291}, "total_wall_ms": 251.98520894628018, "ttft_ms": 12.096375110559165, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489790464, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9569261656, "mlx_cache_bytes": 3050381904, "process_rss_bytes": 10489790464}, "peak_prefill_memory": null, "peak_decode_memory": 9569261656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ddfcf52f6c101b610b8f64c4", "attempt_id": "35af76f21d40", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:24.262207Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.70020896475762, "ttft_ms": 11.933208908885717, "decode_ms": 11.909666936844587}, "total_wall_ms": 251.57883297652006, "ttft_ms": 11.933208908885717, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489790464, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 3206685264, "process_rss_bytes": 10489790464}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "17a684c791fa491d5024c724", "attempt_id": "c00cf938b2be", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:24.531993Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1341, "cache_tensor_bytes": null, "serialized_payload_bytes": 1341, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4008.3684170385823, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.67433402966708, "ttft_ms": 11.896791984327137, "decode_ms": 11.924249934963882}, "total_wall_ms": 251.46300008054823, "ttft_ms": 11.896791984327137, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2136, "sender_output_tokens": 512, "sender_prefill_ms": 377.5355410762131, "sender_ttft_ms": 7.188708987087011, "sender_decode_ms": 3621.7358330031857}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489806848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565132888, "mlx_cache_bytes": 3206685264, "process_rss_bytes": 10489806848}, "peak_prefill_memory": null, "peak_decode_memory": 9565132888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e3513fa1b232a23c26d3563ac7633ba02f33320c383d5a97f39e46a2147ff5fb", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4eff2fbad2bd86117735dfcd", "attempt_id": "17daed36d78f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:27.888648Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 326, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 145.78804199118167, "ttft_ms": 11.817166930995882, "decode_ms": 69.92095801979303}, "total_wall_ms": 228.37487503420562, "ttft_ms": 11.817166930995882, "input_usage": {"receiver_prompt_tokens": 326, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9477689744, "mlx_cache_bytes": 3488598320, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9477689744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quimelymi-6", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "9189886b469ac3ec9c99d1089cfd61eae398e2a3c0e3ae6a0adfaf3e1f2fa6b5"} | ||||
| 1170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "df7ac59da446acd88b7878cb", "attempt_id": "90dc41866eab", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:28.136158Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 331, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.08662493526936, "ttft_ms": 11.703249998390675, "decode_ms": 11.66041602846235}, "total_wall_ms": 165.21933302283287, "ttft_ms": 11.703249998390675, "input_usage": {"receiver_prompt_tokens": 331, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9480606116, "mlx_cache_bytes": 3693514328, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9480606116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e9fc7ea1577918fc390b0d9e", "attempt_id": "a366157633af", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:28.319678Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 331, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.2806250154972, "ttft_ms": 11.762166977860034, "decode_ms": 11.765250004827976}, "total_wall_ms": 165.49654107075185, "ttft_ms": 11.762166977860034, "input_usage": {"receiver_prompt_tokens": 331, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9480606116, "mlx_cache_bytes": 3693514328, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9480606116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1990817cf85704fc70a6f1c2", "attempt_id": "05befcc44acc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:28.503299Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 325, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.3523749904707, "ttft_ms": 11.708750040270388, "decode_ms": 11.742457980290055}, "total_wall_ms": 164.46591704152524, "ttft_ms": 11.708750040270388, "input_usage": {"receiver_prompt_tokens": 325, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9477689744, "mlx_cache_bytes": 3693514328, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9477689744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be62bc968b4066af14dd184b", "attempt_id": "c23b430a25bf", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:28.686165Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 334, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.48241595830768, "ttft_ms": 11.620250064879656, "decode_ms": 105.28737504500896}, "total_wall_ms": 259.2369579942897, "ttft_ms": 11.620250064879656, "input_usage": {"receiver_prompt_tokens": 334, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9482523056, "mlx_cache_bytes": 3889402764, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9482523056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,129,740", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "db9ed36db1fb6ab9184a783960cf3dea5fd73977fe9547ca8206b5ea6304a123"} | ||||
| 1174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b00287cfd1c0de72df16ef69", "attempt_id": "b4b967d5c7a6", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:28.963439Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 336, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.24229096341878, "ttft_ms": 11.970999999903142, "decode_ms": 11.783708003349602}, "total_wall_ms": 165.84174998570234, "ttft_ms": 11.970999999903142, "input_usage": {"receiver_prompt_tokens": 336, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9483260344, "mlx_cache_bytes": 4007631048, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9483260344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e7046dcb38570ff98192d8b4", "attempt_id": "1f1886833414", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:29.149105Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 327, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.62333398032933, "ttft_ms": 11.711874976754189, "decode_ms": 11.682040989398956}, "total_wall_ms": 164.73962494637817, "ttft_ms": 11.711874976754189, "input_usage": {"receiver_prompt_tokens": 327, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9478181284, "mlx_cache_bytes": 4122712264, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9478181284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8d335b93e1d55587aceee633", "attempt_id": "fc6feebdf9c2", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:29.332229Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 327, "message_tokens": 235, "message_utf8_bytes": 493, "cache_tensor_bytes": null, "serialized_payload_bytes": 493, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3087.3282499378547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 141.11529104411602, "ttft_ms": 11.69533294159919, "decode_ms": 11.699332972057164}, "total_wall_ms": 165.17187503632158, "ttft_ms": 11.69533294159919, "input_usage": {"receiver_prompt_tokens": 327, "sender_input_tokens": 2164, "sender_output_tokens": 380, "sender_prefill_ms": 379.84270800370723, "sender_ttft_ms": 7.177416002377868, "sender_decode_ms": 2698.262167046778}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10489839616, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9478181284, "mlx_cache_bytes": 4122712264, "process_rss_bytes": 10489839616}, "peak_prefill_memory": null, "peak_decode_memory": 9478181284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 5, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3968e2814005592da293cddf58269dc1c5bfc9a6363753eaf7bf912089381571", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e43dec08b8ed23adce9d0874", "attempt_id": "8e87c18714c0", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:29.908283Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 36, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.7801669891923666, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.13395789824426, "ttft_ms": 48.13395789824426, "decode_ms": 578.6044159904122}, "total_wall_ms": 630.3504160605371, "ttft_ms": 48.13395789824426, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642440192, "backend_memory": {"mlx_active_bytes": 9415396360, "mlx_peak_bytes": 9492843728, "mlx_cache_bytes": 4359310825, "process_rss_bytes": 10642440192}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9492843728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Human:W: \"With a few npa)1\" )1. if...\">.Bechx:0.\"): 3.):\n )).\":[\"Scheos_0: #f003balk", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "9dea4c8e0ba3f759754b151d6495c9dad327f57053254a5d1ba4a130a0b69f6b"} | ||||
| 1178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "72d363737f68a7826d0a1717", "attempt_id": "08f6cf556e1b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:30.558116Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.4499169774353504, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.95720903389156, "ttft_ms": 49.95720903389156, "decode_ms": 577.712457976304}, "total_wall_ms": 631.1178329633549, "ttft_ms": 49.95720903389156, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642440192, "backend_memory": {"mlx_active_bytes": 9416870920, "mlx_peak_bytes": 9505164516, "mlx_cache_bytes": 4479438641, "process_rss_bytes": 10642440192}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9505164516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(geeseetters, osCEcohere, eauin\nIi). Projections\nBlume black-“uavt\\_unbek_spring=positioning intoeinga_，把()，8分)", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "310491586a689bc767fe51a3326041bfd6b52216b8b431fdf695156d366a1cbc"} | ||||
| 1179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b7aaef2d4bfad8ecb2e25372", "attempt_id": "4cc0c4a8b6a1", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:31.208363Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.3538330094888806, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.70141593366861, "ttft_ms": 49.70141593366861, "decode_ms": 578.7525409832597}, "total_wall_ms": 631.6644999897107, "ttft_ms": 49.70141593366861, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642440192, "backend_memory": {"mlx_active_bytes": 9416870920, "mlx_peak_bytes": 9505033444, "mlx_cache_bytes": 4479438641, "process_rss_bytes": 10642440192}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9505033444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "(larms, 10ofM__Alunheboltb500tonusbesagglombaut, 50000-1. of1-000200U, 6-", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "b532c8d0f0c21ce078fadf7a558c6325a4bcb2788274cd4dc79a2380fea6d12c"} | ||||
| 1180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2aae868d4d80cb9d19f4901a", "attempt_id": "8b5e52c6da29", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:31.860090Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 35, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.449582981877029, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.08233301062137, "ttft_ms": 47.08233301062137, "decode_ms": 576.8480829428881}, "total_wall_ms": 627.2067079553381, "ttft_ms": 47.08233301062137, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642440192, "backend_memory": {"mlx_active_bytes": 9415396360, "mlx_peak_bytes": 9492024528, "mlx_cache_bytes": 4512206641, "process_rss_bytes": 10642440192}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9492024528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\\成反义萼兰bo的方程字：http://Cleavage_03 -uleman-machine先简述而不語词：101方fecit在2.以stative中，3.:[[", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "0b014c7f75e3524a76a0d27e66828fc02fb674413f100523a5950de9f5ae428f"} | ||||
| 1181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "14a5a92556c6005b26755af7", "attempt_id": "f605ede427da", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:32.507466Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 44, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.4572920044884086, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.16762495506555, "ttft_ms": 50.16762495506555, "decode_ms": 579.1827499633655}, "total_wall_ms": 632.6717500342056, "ttft_ms": 50.16762495506555, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 44}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642423808, "backend_memory": {"mlx_active_bytes": 9416608776, "mlx_peak_bytes": 9507278064, "mlx_cache_bytes": 4580282513, "process_rss_bytes": 10642423808}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9507278064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Paparticles and IamBisolationbloshoen-USOEspecialvectors and quarteaubls, the initializanoyofthinking into theselvesh1, “it is in theface for the bl", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "02b07cd06138357cf755b48eed6f94f856c3d5953b8ccfd4241f55e4ce4a77c6"} | ||||
| 1182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "81cdb09301baf6a354fcda85", "attempt_id": "563a402e1859", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:33.159236Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 46, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.4106249436736107, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.208333996124566, "ttft_ms": 50.208333996124566, "decode_ms": 580.8032909408212}, "total_wall_ms": 634.2771659838036, "ttft_ms": 50.208333996124566, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642423808, "backend_memory": {"mlx_active_bytes": 9416870920, "mlx_peak_bytes": 9510325496, "mlx_cache_bytes": 4594012673, "process_rss_bytes": 10642423808}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9510325496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Heging and idd()='strandewego, euclustering theory wasiertes nang, in thebalkeneuer是一个人盯上轻而多因(1, exclusive)的, 1. ", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "46e338de50aed12d3e6ea336d8ea32b0959b4217561c1dde58e80824204e58c2"} | ||||
| 1183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9170880c04c9a42be240b56f", "attempt_id": "e201984929dc", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:33.812863Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.3973750174045563, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.092000022530556, "ttft_ms": 47.092000022530556, "decode_ms": 579.7877078875899}, "total_wall_ms": 630.1327919354662, "ttft_ms": 47.092000022530556, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642423808, "backend_memory": {"mlx_active_bytes": 9415396360, "mlx_peak_bytes": 9495317732, "mlx_cache_bytes": 4626224986, "process_rss_bytes": 10642423808}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9495317732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".函鎖결び�/XMLSchema與衣有，省上)答案-terminous uitilis气化學制老君IUSCleasoner -1)!\nBabel()()()()，答案-1().()", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "5f0e8fd151026bab4e1ec43ee84918caaf0b70e71247a10aaa75474fc77b2926"} | ||||
| 1184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "568c63f6a601cf10d7a63f8f", "attempt_id": "46dcb736b42a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:34.462396Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9336359944}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919077, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 392.7097499836236, "doc_prefill_ms": 360.7087499694899, "compress_ms": 9.996875072829425, "serialize_ms": 18.312084022909403, "load_ms": 1.427166978828609, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.86087497975677, "ttft_ms": 46.86087497975677, "decode_ms": 579.5619589043781}, "total_wall_ms": 629.7049999702722, "ttft_ms": 46.86087497975677, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10642423808, "backend_memory": {"mlx_active_bytes": 9415396360, "mlx_peak_bytes": 9495596260, "mlx_cache_bytes": 4626224986, "process_rss_bytes": 10642423808}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9495596260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".秋冬=comE型面⽑ storXomelnimelbow-ended upgpcogretrun-on,gcgehaves, hasagenerationoforapinabroadexclusionfreeidex1(1,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29a6184e15257aa607ba2f1b3c5f89199f37d707873740a5aa223217ee0c6e57", "output_hash": "39640185d19ff75695f3f0b4f49c31a8ff9ab321bbb3bcbbe0b8ed237bc6b710"} | ||||
| 1185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0c8727bbd6fc54eae70de4ab", "attempt_id": "2b8eb5d33983", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:36.441766Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 36, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 1.6152090393006802, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.40291708894074, "ttft_ms": 55.40291708894074, "decode_ms": 12.568000005558133}, "total_wall_ms": 71.42391707748175, "ttft_ms": 55.40291708894074, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9492466896, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9492466896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9b3cbe7cf22c73ac5f2b829f", "attempt_id": "4eac5ec08d2e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:36.533757Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 1.5343340346589684, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.866958008147776, "ttft_ms": 48.866958008147776, "decode_ms": 12.525165919214487}, "total_wall_ms": 64.77404199540615, "ttft_ms": 48.866958008147776, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9504656612, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9504656612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a171723bb81e6cecd500dd6e", "attempt_id": "b9c773e64e78", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:36.617469Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 0.8518750546500087, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.54287498164922, "ttft_ms": 48.54287498164922, "decode_ms": 12.52604101318866}, "total_wall_ms": 63.92291595693678, "ttft_ms": 48.54287498164922, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9504656612, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9504656612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7d3ec336d8fc5197b7519b81", "attempt_id": "58b822d0c014", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:36.700971Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 35, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 1.4232919784262776, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.55641596764326, "ttft_ms": 46.55641596764326, "decode_ms": 12.490833993069828}, "total_wall_ms": 62.55112506914884, "ttft_ms": 46.55641596764326, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9491647696, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9491647696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1633c750698da3701b94bb11", "attempt_id": "f920f15a3d3b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:36.783203Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 44, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 1.5074160182848573, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.99049997422844, "ttft_ms": 49.99049997422844, "decode_ms": 12.484875041991472}, "total_wall_ms": 65.78295805957168, "ttft_ms": 49.99049997422844, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9506901232, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9506901232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "479b3b81f4b9399466a097e6", "attempt_id": "9e9a8f431dcb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:36.868272Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 46, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 1.3940830249339342, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.009500002488494, "ttft_ms": 50.009500002488494, "decode_ms": 12.37966597545892}, "total_wall_ms": 65.66766602918506, "ttft_ms": 50.009500002488494, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9509948664, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9509948664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8bed7f1a569fa333a94e07e0", "attempt_id": "feb1081e7588", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:36.952157Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 1.465874956920743, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.89100000541657, "ttft_ms": 46.89100000541657, "decode_ms": 12.420332990586758}, "total_wall_ms": 62.5468340003863, "ttft_ms": 46.89100000541657, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9495219428, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9495219428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c44d3fc7febfe5f3e5e4a2ad", "attempt_id": "0c185934186a", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:37.032864Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9335983112}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 75902976, "serialized_payload_bytes": 75919178, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.9524579886347, "doc_prefill_ms": 359.87620800733566, "compress_ms": 951.6625830437988, "serialize_ms": 17.135667032562196, "load_ms": 1.3659170363098383, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.98237497359514, "ttft_ms": 46.98237497359514, "decode_ms": 12.478124932385981}, "total_wall_ms": 62.55512498319149, "ttft_ms": 46.98237497359514, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10619715584, "backend_memory": {"mlx_active_bytes": 9413839880, "mlx_peak_bytes": 9495219428, "mlx_cache_bytes": 4632057690, "process_rss_bytes": 10619715584}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9495219428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a70fcb21a2e35cbd60b055c66d2075267ea12749e611daf3a55362c154d041d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "83ef9d6766c34e7c5be92939", "attempt_id": "33250ad23ee5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:37.113476Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 36, "compress_ms": 80.2834170171991}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 36, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001046, "side_information_bytes": 16086, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1387.8193330019712, "doc_prefill_ms": 360.1038750493899, "compress_ms": 1020.7840830553323, "serialize_ms": 6.6264590714126825, "load_ms": 1.4284999342635274, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.56904201488942, "ttft_ms": 36.56904201488942, "decode_ms": 11.980167008005083}, "total_wall_ms": 1441.5059590246528, "ttft_ms": 36.56904201488942, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10602725376, "backend_memory": {"mlx_active_bytes": 9300855816, "mlx_peak_bytes": 9368243408, "mlx_cache_bytes": 4801943522, "process_rss_bytes": 10602725376}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9368243408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c23a31a888a6d2c56eb81c0e58baf1b99a1aca43e6a35aa901186af6a5ec5abd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3bded12627dcc8ad870f0f8b", "attempt_id": "fb4d05185bfc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:38.572816Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 41, "compress_ms": 83.25541706290096}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001047, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1385.9389170538634, "doc_prefill_ms": 356.2297089956701, "compress_ms": 1022.4299160763621, "serialize_ms": 6.948750000447035, "load_ms": 1.1790839489549398, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.703665904700756, "ttft_ms": 37.703665904700756, "decode_ms": 12.013082974590361}, "total_wall_ms": 1440.25004201103, "ttft_ms": 37.703665904700756, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10641784832, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9377696996, "mlx_cache_bytes": 4831221730, "process_rss_bytes": 10641784832}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9377696996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9027ca985ad80fd2332325ca725e3ef8d3cb66d3086b6869eada90adcf9f5e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b55d332c8b74aa2d6978f977", "attempt_id": "c5b37719ff38", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:40.033710Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 41, "compress_ms": 84.17508297134191}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001047, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1389.073416008614, "doc_prefill_ms": 356.90866701770574, "compress_ms": 1025.694917072542, "serialize_ms": 6.184917059727013, "load_ms": 1.2984999921172857, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.03958301432431, "ttft_ms": 38.03958301432431, "decode_ms": 12.041624984703958}, "total_wall_ms": 1443.6767500592396, "ttft_ms": 38.03958301432431, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10641784832, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9377696996, "mlx_cache_bytes": 4831221730, "process_rss_bytes": 10641784832}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9377696996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9027ca985ad80fd2332325ca725e3ef8d3cb66d3086b6869eada90adcf9f5e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "07a423f55abeffeaaa7f0d10", "attempt_id": "60d3eac9dc31", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:41.497589Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 35, "compress_ms": 78.64433305803686}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 35, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001047, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1367.063375073485, "doc_prefill_ms": 356.6118750022724, "compress_ms": 1004.1810830589384, "serialize_ms": 5.991625017486513, "load_ms": 1.3041250640526414, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.74862494133413, "ttft_ms": 35.74862494133413, "decode_ms": 13.055916060693562}, "total_wall_ms": 1420.4101249342784, "ttft_ms": 35.74862494133413, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10641784832, "backend_memory": {"mlx_active_bytes": 9300691976, "mlx_peak_bytes": 9367211216, "mlx_cache_bytes": 4845787106, "process_rss_bytes": 10641784832}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9367211216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9027ca985ad80fd2332325ca725e3ef8d3cb66d3086b6869eada90adcf9f5e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "300dace8bdd30a788d65cf17", "attempt_id": "74eadc59e6d7", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:42.938109Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 44, "compress_ms": 85.43904102407396}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 44, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001047, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1387.519208015874, "doc_prefill_ms": 360.1238749688491, "compress_ms": 1020.9221250843257, "serialize_ms": 6.18308293633163, "load_ms": 1.1660000309348106, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.27225004695356, "ttft_ms": 37.27225004695356, "decode_ms": 11.94362505339086}, "total_wall_ms": 1441.1193750565872, "ttft_ms": 37.27225004695356, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 44}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10641784832, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9381924080, "mlx_cache_bytes": 4873017314, "process_rss_bytes": 10641784832}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9381924080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9027ca985ad80fd2332325ca725e3ef8d3cb66d3086b6869eada90adcf9f5e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a9590973999319524d51e016", "attempt_id": "0cdaa1a49fbc", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:44.399059Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 46, "compress_ms": 85.53220797330141}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 46, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001047, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1392.3664590111002, "doc_prefill_ms": 356.5613749669865, "compress_ms": 1029.276292072609, "serialize_ms": 6.241291994228959, "load_ms": 1.107624964788556, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.888500024564564, "ttft_ms": 37.888500024564564, "decode_ms": 11.930209002457559}, "total_wall_ms": 1446.4672500034794, "ttft_ms": 37.888500024564564, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10641784832, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9385643256, "mlx_cache_bytes": 4893595618, "process_rss_bytes": 10641784832}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9385643256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9027ca985ad80fd2332325ca725e3ef8d3cb66d3086b6869eada90adcf9f5e5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b5894a7a94275b1f609efc42", "attempt_id": "2513f4f0566e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:45.865850Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 37, "compress_ms": 81.34362497366965}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001047, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1396.5527500258759, "doc_prefill_ms": 357.0437090238556, "compress_ms": 1032.995207933709, "serialize_ms": 6.2018330208957195, "load_ms": 1.1744169751182199, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.1170419966802, "ttft_ms": 37.1170419966802, "decode_ms": 11.808083043433726}, "total_wall_ms": 1449.804958072491, "ttft_ms": 37.1170419966802, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10641784832, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9371208932, "mlx_cache_bytes": 4917975010, "process_rss_bytes": 10641784832}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9371208932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9027ca985ad80fd2332325ca725e3ef8d3cb66d3086b6869eada90adcf9f5e5", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1f9567f358e35fd1041b0897", "attempt_id": "1dac69724575", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:47.335734Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 2059, "keep": 515, "window_tokens": 37, "compress_ms": 80.49754204694182}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 18984960, "serialized_payload_bytes": 19001047, "side_information_bytes": 16087, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1378.7532499991357, "doc_prefill_ms": 356.7950410069898, "compress_ms": 1015.3798330575228, "serialize_ms": 6.292833015322685, "load_ms": 4.259750014171004, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.55445794761181, "ttft_ms": 38.55445794761181, "decode_ms": 12.081833090633154}, "total_wall_ms": 1436.9142079958692, "ttft_ms": 38.55445794761181, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10641784832, "backend_memory": {"mlx_active_bytes": 9300888584, "mlx_peak_bytes": 9371208932, "mlx_cache_bytes": 4917975010, "process_rss_bytes": 10641784832}, "peak_prefill_memory": 9886362860, "peak_decode_memory": 9371208932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9027ca985ad80fd2332325ca725e3ef8d3cb66d3086b6869eada90adcf9f5e5", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6eb7afeef6e9927c89e2514f", "attempt_id": "cd66708f3fab", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:48.821478Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6051, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2278.664750047028, "ttft_ms": 12.597041903063655, "decode_ms": 124.55574993509799}, "total_wall_ms": 2427.9717499157414, "ttft_ms": 12.597041903063655, "input_usage": {"receiver_prompt_tokens": 6051}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453827584, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10129738816, "mlx_cache_bytes": 1738634680, "process_rss_bytes": 10453827584}, "peak_prefill_memory": null, "peak_decode_memory": 10129738816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HR-43L-3013", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "0cd6da485084f9884229002d8c423c19eef01330e5e8b8b1d417bd301b8bcf95"} | ||||
| 1202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "42701f51fb4b85ad1707d631", "attempt_id": "c67bfe0870cd", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:51.278225Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6057, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2279.0492499480024, "ttft_ms": 12.49075005762279, "decode_ms": 124.12245792802423}, "total_wall_ms": 2426.222375012003, "ttft_ms": 12.49075005762279, "input_usage": {"receiver_prompt_tokens": 6057}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453843968, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10131262528, "mlx_cache_bytes": 2316694968, "process_rss_bytes": 10453843968}, "peak_prefill_memory": null, "peak_decode_memory": 10131262528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 764-N, Matagami", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "3b9f968dd56f551a2f9080aa97e2dd75f113c60bca538bb4b4472ee49ea33096"} | ||||
| 1203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ce43543c26cea3748dca6d51", "attempt_id": "a9d75ca190d8", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:53.730666Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6055, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2278.3580409595743, "ttft_ms": 12.692082906141877, "decode_ms": 87.05424994695932}, "total_wall_ms": 2389.269749983214, "ttft_ms": 12.692082906141877, "input_usage": {"receiver_prompt_tokens": 6055}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453876736, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10131000384, "mlx_cache_bytes": 2661676472, "process_rss_bytes": 10453876736}, "peak_prefill_memory": null, "peak_decode_memory": 10131000384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "52.4601", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "8b9c112062354c43cfefa90af77562947b457c4b23e6208087870673fd9b95c6"} | ||||
| 1204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e509ac25fea4e9ad3b8785ab", "attempt_id": "9d078bf2d771", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:56.146630Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6049, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2277.6182079687715, "ttft_ms": 12.51391600817442, "decode_ms": 111.12533393315971}, "total_wall_ms": 2412.5316670397297, "ttft_ms": 12.51391600817442, "input_usage": {"receiver_prompt_tokens": 6049}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10453893120, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10129345600, "mlx_cache_bytes": 3005478328, "process_rss_bytes": 10453893120}, "peak_prefill_memory": null, "peak_decode_memory": 10129345600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Solveig Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "2ce06231e10d2b1d9dddeef39e5433969f323ca0e8f66e2c543aa36f21cf5db3"} | ||||
| 1205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3f147351584dcbd98759a6cd", "attempt_id": "17a8bda5464e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:40:58.586001Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6062, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2279.8829169478267, "ttft_ms": 12.527500046417117, "decode_ms": 86.66633302345872}, "total_wall_ms": 2390.82041697111, "ttft_ms": 12.527500046417117, "input_usage": {"receiver_prompt_tokens": 6062}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10453925888, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10133261376, "mlx_cache_bytes": 3617650104, "process_rss_bytes": 10453925888}, "peak_prefill_memory": null, "peak_decode_memory": 10133261376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "459,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "fb693a5d485291e89c99e9852fa549afad20fd8d49927e70f30e3c1c15105635"} | ||||
| 1206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9492a015d12cfaa6170e768c", "attempt_id": "56d5fc10cea9", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:01.004226Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6059, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2280.4015410365537, "ttft_ms": 12.607417069375515, "decode_ms": 125.03095797728747}, "total_wall_ms": 2428.881707950495, "ttft_ms": 12.607417069375515, "input_usage": {"receiver_prompt_tokens": 6059}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10453958656, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10172927040, "mlx_cache_bytes": 4019598776, "process_rss_bytes": 10453958656}, "peak_prefill_memory": null, "peak_decode_memory": 10172927040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GX-48X-7240", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "d06667dc933d1a921ff2121ef2808a365d4d3f600e77ad1525788398a80d0895"} | ||||
| 1207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "69b9d560eef34a0760d3fa60", "attempt_id": "f91dc0b5c4b8", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:03.460462Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6052, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2277.74175000377, "ttft_ms": 12.69091700669378, "decode_ms": 12.51858298201114}, "total_wall_ms": 2313.9968330506235, "ttft_ms": 12.69091700669378, "input_usage": {"receiver_prompt_tokens": 6052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453991424, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10130000960, "mlx_cache_bytes": 4364055992, "process_rss_bytes": 10453991424}, "peak_prefill_memory": null, "peak_decode_memory": 10130000960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d6571ae73db3ae2697a60bd", "attempt_id": "1ac89152bc96", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:05.800003Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6052, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01704192254692316, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2277.901125024073, "ttft_ms": 12.611334095709026, "decode_ms": 12.507666950114071}, "total_wall_ms": 2313.711207942106, "ttft_ms": 12.611334095709026, "input_usage": {"receiver_prompt_tokens": 6052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454024192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 10130000960, "mlx_cache_bytes": 4364055992, "process_rss_bytes": 10454024192}, "peak_prefill_memory": null, "peak_decode_memory": 10130000960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c2711a57b372fd08f9d57fe3", "attempt_id": "542c5af70e2c", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:12.716516Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 539, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 212.9772499902174, "ttft_ms": 12.046542018651962, "decode_ms": 11.99729205109179}, "total_wall_ms": 238.1940420018509, "ttft_ms": 12.046542018651962, "input_usage": {"receiver_prompt_tokens": 539, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454073344, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9542473816, "mlx_cache_bytes": 6311630264, "process_rss_bytes": 10454073344}, "peak_prefill_memory": null, "peak_decode_memory": 9542473816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be85e303c70a3b15fc2cce50", "attempt_id": "deda40daf294", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:12.981355Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 545, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.5224170004949, "ttft_ms": 11.968208011239767, "decode_ms": 11.882790946401656}, "total_wall_ms": 233.43550006393343, "ttft_ms": 11.968208011239767, "input_usage": {"receiver_prompt_tokens": 545, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454089728, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9544751192, "mlx_cache_bytes": 6551164344, "process_rss_bytes": 10454089728}, "peak_prefill_memory": null, "peak_decode_memory": 9544751192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "03e35baa19139b8c5b801008", "attempt_id": "b2b24a58828e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:13.241415Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 543, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.47037492785603, "ttft_ms": 11.988500016741455, "decode_ms": 11.89312501810491}, "total_wall_ms": 233.36225003004074, "ttft_ms": 11.988500016741455, "input_usage": {"receiver_prompt_tokens": 543, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454106112, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9544357976, "mlx_cache_bytes": 6694491576, "process_rss_bytes": 10454106112}, "peak_prefill_memory": null, "peak_decode_memory": 9544357976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c799e28e937749f3f5f33174", "attempt_id": "a0400a8215ff", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:13.501147Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 537, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.26483296696097, "ttft_ms": 11.965250014327466, "decode_ms": 11.937708943150938}, "total_wall_ms": 233.13724994659424, "ttft_ms": 11.965250014327466, "input_usage": {"receiver_prompt_tokens": 537, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454122496, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9542080600, "mlx_cache_bytes": 6836245944, "process_rss_bytes": 10454122496}, "peak_prefill_memory": null, "peak_decode_memory": 9542080600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "516918361b294db43996bc0d", "attempt_id": "ec5cbe1a6342", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:13.759887Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 550, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 210.28158301487565, "ttft_ms": 11.817708029411733, "decode_ms": 83.14833301119506}, "total_wall_ms": 306.2851249706, "ttft_ms": 11.817708029411733, "input_usage": {"receiver_prompt_tokens": 550, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10454122496, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9548060760, "mlx_cache_bytes": 7096849848, "process_rss_bytes": 10454122496}, "peak_prefill_memory": null, "peak_decode_memory": 9548060760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "382,030", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "50a7df735894d1cfe2ef158ebbe892d2a108537defb38a9a0d57dd74800be31d"} | ||||
| 1214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0e95957c294e5eeaee786b8d", "attempt_id": "5c6b4e8b2d10", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:14.092063Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 547, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.91441700607538, "ttft_ms": 12.053749989718199, "decode_ms": 11.857333010993898}, "total_wall_ms": 235.00720807351172, "ttft_ms": 12.053749989718199, "input_usage": {"receiver_prompt_tokens": 547, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454138880, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9565214808, "mlx_cache_bytes": 7261361592, "process_rss_bytes": 10454138880}, "peak_prefill_memory": null, "peak_decode_memory": 9565214808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9f71b909bbda4a66dc36bfef", "attempt_id": "cb3aa97fa92d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:14.353090Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 540, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.6008749427274, "ttft_ms": 12.12554203812033, "decode_ms": 11.891250032931566}, "total_wall_ms": 232.83266695216298, "ttft_ms": 12.12554203812033, "input_usage": {"receiver_prompt_tokens": 540, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454138880, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9542867032, "mlx_cache_bytes": 7403902392, "process_rss_bytes": 10454138880}, "peak_prefill_memory": null, "peak_decode_memory": 9542867032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8e39f74e3ae93ccd39fb8baf", "attempt_id": "c99d86953925", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:14.613039Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 540, "message_tokens": 459, "message_utf8_bytes": 1263, "cache_tensor_bytes": null, "serialized_payload_bytes": 1263, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4575.649959035218, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.10466690454632, "ttft_ms": 12.080000014975667, "decode_ms": 11.924250051379204}, "total_wall_ms": 233.40370901860297, "ttft_ms": 12.080000014975667, "input_usage": {"receiver_prompt_tokens": 540, "sender_input_tokens": 6091, "sender_output_tokens": 459, "sender_prefill_ms": 1156.8602080224082, "sender_ttft_ms": 7.777416962198913, "sender_decode_ms": 3405.0458340207115}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454155264, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9542867032, "mlx_cache_bytes": 7403902392, "process_rss_bytes": 10454155264}, "peak_prefill_memory": null, "peak_decode_memory": 9542867032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "90e3c93fd94359c4cd0d2e0534363e74bb3f52807641071e894f7efd26584607", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b8716bdfb64b891f2737ec96", "attempt_id": "09d86651021f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:19.019820Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 314, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 129.20612504240125, "ttft_ms": 11.853166972287, "decode_ms": 11.719416012056172}, "total_wall_ms": 153.65312504582107, "ttft_ms": 11.853166972287, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467793760, "mlx_cache_bytes": 8317934236, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9467793760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "378d6a49370b26467d020fa8", "attempt_id": "738ac2b29128", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:19.200259Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 320, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.5084999827668, "ttft_ms": 11.746249976567924, "decode_ms": 11.73304207623005}, "total_wall_ms": 148.752041044645, "ttft_ms": 11.746249976567924, "input_usage": {"receiver_prompt_tokens": 320, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470611832, "mlx_cache_bytes": 8503795608, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9470611832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c960a3deeaae49fb14a36832", "attempt_id": "3008cd123af8", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:19.375211Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 318, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.21566597186029, "ttft_ms": 11.710750055499375, "decode_ms": 81.69150003232062}, "total_wall_ms": 218.3203330496326, "ttft_ms": 11.710750055499375, "input_usage": {"receiver_prompt_tokens": 318, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9469874552, "mlx_cache_bytes": 8615468952, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9469874552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3886556", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "a46fe3232c771370af3f528b706e22bc1611bc791a6519883a29c4d57f9bf3a5"} | ||||
| 1220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0e6afb8b7af2e4c6dd82203b", "attempt_id": "ef33864b9900", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:19.619354Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 312, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.32316702324897, "ttft_ms": 11.694292072206736, "decode_ms": 11.566541972570121}, "total_wall_ms": 148.27162493020296, "ttft_ms": 11.694292072206736, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9481015648, "mlx_cache_bytes": 8741658520, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9481015648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be03315320c90521de0b0578", "attempt_id": "b4587635d073", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:19.793045Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 325, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.10970806702971, "ttft_ms": 11.968250037170947, "decode_ms": 11.782500077970326}, "total_wall_ms": 164.72225007601082, "ttft_ms": 11.968250037170947, "input_usage": {"receiver_prompt_tokens": 325, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9475232140, "mlx_cache_bytes": 8946672808, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9475232140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eec5360ba792dd4b1e0e083b", "attempt_id": "7213ed23396f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:19.983802Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 322, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 139.44408402312547, "ttft_ms": 11.982833035290241, "decode_ms": 11.744624935090542}, "total_wall_ms": 164.15191697888076, "ttft_ms": 11.982833035290241, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9472921996, "mlx_cache_bytes": 9059919016, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9472921996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "92ce7b9be5a4b7e1794279cc", "attempt_id": "e51b689d4b94", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:20.175620Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 315, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.40654099918902, "ttft_ms": 11.836208985187113, "decode_ms": 11.67170808184892}, "total_wall_ms": 148.7955410266295, "ttft_ms": 11.836208985187113, "input_usage": {"receiver_prompt_tokens": 315, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467974008, "mlx_cache_bytes": 9170543784, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9467974008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9d864e5aa649dbb07621a857", "attempt_id": "377456616109", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:20.352192Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 315, "message_tokens": 223, "message_utf8_bytes": 540, "cache_tensor_bytes": null, "serialized_payload_bytes": 540, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4146.004832931794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.09791594836861, "ttft_ms": 11.854832991957664, "decode_ms": 11.741125024855137}, "total_wall_ms": 148.40683399233967, "ttft_ms": 11.854832991957664, "input_usage": {"receiver_prompt_tokens": 315, "sender_input_tokens": 6119, "sender_output_tokens": 403, "sender_prefill_ms": 1153.8998329779133, "sender_ttft_ms": 7.75737501680851, "sender_decode_ms": 2978.4321250626817}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9467974008, "mlx_cache_bytes": 9170543784, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9467974008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b5ae9e3c70b32e1aacecbb54d71aa46eb276b8283c8b8b5564439dd2e3fe442e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3ad51d82ee001be9ebf1f855", "attempt_id": "eeb0bfad74a8", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:21.733447Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 37, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 4.626458045095205, "receiver_prefill_ms": 0.0, "query_prefill_ms": 85.64525004476309, "ttft_ms": 85.64525004476309, "decode_ms": 630.572916008532}, "total_wall_ms": 726.7274999758229, "ttft_ms": 85.64525004476309, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707392008, "mlx_peak_bytes": 9814985940, "mlx_cache_bytes": 10240617258, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9814985940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Soon (engan, the latest update of (ingenommese sóc orof the 500 in 1-enseertocomplex (i)call in, the 1 lec, in, it seemsare3,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "7264768d3d7cde2b11c29a3a296ed8392c5ffd62ff31c47bcb20fe4b80b41967"} | ||||
| 1226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6a97c9713aedce8785f6b57e", "attempt_id": "c8dcf8877f45", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:22.487045Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 43, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 4.119707969948649, "receiver_prefill_ms": 0.0, "query_prefill_ms": 85.0425410317257, "ttft_ms": 85.0425410317257, "decode_ms": 638.2533749565482}, "total_wall_ms": 733.0325840739533, "ttft_ms": 85.0425410317257, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707490312, "mlx_peak_bytes": 9824210156, "mlx_cache_bytes": 10314148994, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9824210156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Up).v1)emI). It also. Quellez12 de (ouf dash (ofc- Fever11-ED)1.étéatebooker's, abit1.ese111k", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "7386402779ebd08723ae478fbabb00044ebacfae89ebcf1d3288886e3a622085"} | ||||
| 1227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "31a9f6c41fd99a26bdfbaa59", "attempt_id": "27fc299dc17d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:23.246719Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 41, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 1.8115410348400474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.54141707159579, "ttft_ms": 79.54141707159579, "decode_ms": 633.0722919665277}, "total_wall_ms": 720.2283330261707, "ttft_ms": 79.54141707159579, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707310088, "mlx_peak_bytes": 9821572332, "mlx_cache_bytes": 10362973314, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9821572332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".:\n$$.Ln10与一1:in:1:2)在剑桥大学唯一论与之光:1:言有几的,为王醢I:1, 件式子大学高数", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "d497ac2d220129cb143d79961076dc90aac24e0ad9475d31649bc788aa0ff9f8"} | ||||
| 1228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b7797344fbbb93b5e5afd425", "attempt_id": "922a3c696162", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:23.993776Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 35, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 1.840249984525144, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.88524997420609, "ttft_ms": 72.88524997420609, "decode_ms": 633.9798750123009}, "total_wall_ms": 714.4036249956116, "ttft_ms": 72.88524997420609, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 35}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707310088, "mlx_peak_bytes": 9812135124, "mlx_cache_bytes": 10417564802, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9812135124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "thties of that is,\nu)\n(0)N0 estáioso, or thesaurusI eao, ouroien, 1) is back to.ovi, omg,LA(1) - the, you", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "abb1c86d3af07e23d1fef29bd49c7315e65267ce161d4f16c0e3cb8a44abb5ed"} | ||||
| 1229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f71f46acc80bd0e5f19843cc", "attempt_id": "89c7d4e6c07e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:24.736950Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 48, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 1.7920839600265026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 80.66070906352252, "ttft_ms": 80.66070906352252, "decode_ms": 633.3242910914123}, "total_wall_ms": 721.1764580570161, "ttft_ms": 80.66070906352252, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 48}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707392008, "mlx_peak_bytes": 9832664320, "mlx_cache_bytes": 10460130818, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9832664320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Now, in this is love for it means of, in which is the love, of, 1 16, it stands, in which is the NCLIC) a: the only, and the 20:0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "22caf82741ca62f33716adc63c027872e8507b6a4e8984f5125ff2480639457b"} | ||||
| 1230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f6ca587abfa53cdb40ce4e2e", "attempt_id": "db96131022f1", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:25.484197Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 45, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 1.7492079641669989, "receiver_prefill_ms": 0.0, "query_prefill_ms": 77.84158398862928, "ttft_ms": 77.84158398862928, "decode_ms": 633.4210840286687}, "total_wall_ms": 718.7065420439467, "ttft_ms": 77.84158398862928, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 45}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707310088, "mlx_peak_bytes": 9828617472, "mlx_cache_bytes": 10513280514, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9828617472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "**我是no往复平面案接受者，这马，能说，我也可以运动学，但与我是特别强制口而不过硬体，可不言而大部资料不离心，省情，必应", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "b780c9e5242d4f15fa269325c4650798589b959d66418a9c7717deecd8941bc7"} | ||||
| 1231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2a4f05772877a6041bd02b92", "attempt_id": "221ec777eed0", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:26.229544Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 1.7636669799685478, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.83341596182436, "ttft_ms": 75.83341596182436, "decode_ms": 636.3938340218738}, "total_wall_ms": 719.9682500213385, "ttft_ms": 75.83341596182436, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707310088, "mlx_peak_bytes": 9816640748, "mlx_cache_bytes": 10568348582, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9816640748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "table grading (a)...\n. :\n### Podosoeranoio-1:1)2. ).\n致远0而学士们对角转换方程好为之尚短,不能对,读(在没有,", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "2b106e2636d4c1bfc73e47d4e0c9fc74752f9a67c51cd4df90f5524e99d1cdff"} | ||||
| 1232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bc9ab8c000d97f523111c496", "attempt_id": "0e458b73dd03", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:26.975923Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716288, "side_information_bytes": 16192, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1206.8413749802858, "doc_prefill_ms": 1133.112542098388, "compress_ms": 13.665040954947472, "serialize_ms": 48.42979204840958, "load_ms": 1.799916964955628, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.27095794305205, "ttft_ms": 76.27095794305205, "decode_ms": 633.9340830454603}, "total_wall_ms": 717.500708065927, "ttft_ms": 76.27095794305205, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10897702912, "backend_memory": {"mlx_active_bytes": 9707310088, "mlx_peak_bytes": 9816640748, "mlx_cache_bytes": 10568348582, "process_rss_bytes": 10897702912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9816640748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "towards being (b)是的,至少为王拟远程下击,为王炸,是成套型语言,懂學不盡力學omat,可不行,必需,若干,解說名著", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "801e00328b85250512d733a6d5259b49f8f8a4c63539a94c515c25ea41b0eda8", "output_hash": "ee729f6a6b6fb32f1aa1ea176a93321b14710ce6c229bee3fbc7d5785ece62c8"} | ||||
| 1233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "958bf9697d0fa88fc92c7863", "attempt_id": "7176ab80a31f", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.086799Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 37, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.9735000096261501, "receiver_prefill_ms": 0.0, "query_prefill_ms": 84.1587909962982, "ttft_ms": 84.1587909962982, "decode_ms": 13.606959022581577}, "total_wall_ms": 105.11000000406057, "ttft_ms": 84.1587909962982, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9815035092, "mlx_cache_bytes": 10582766502, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9815035092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2f4f7e4599d43672998cc1af", "attempt_id": "007684688470", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.219953Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 43, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.6965830000117421, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.34170805290341, "ttft_ms": 78.34170805290341, "decode_ms": 13.557916041463614}, "total_wall_ms": 99.45679199881852, "ttft_ms": 78.34170805290341, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9824210156, "mlx_cache_bytes": 10582766502, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9824210156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bad2ffd606d1b49ce9752fef", "attempt_id": "ab369716621d", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.345286Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 41, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.7590419156476855, "receiver_prefill_ms": 0.0, "query_prefill_ms": 78.88312498107553, "ttft_ms": 78.88312498107553, "decode_ms": 13.55841604527086}, "total_wall_ms": 99.68208300415426, "ttft_ms": 78.88312498107553, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9821572332, "mlx_cache_bytes": 10582766502, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9821572332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d7854beeb7484eac80a85e02", "attempt_id": "a8b317591fe1", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.471110Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 35, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.7517079832032323, "receiver_prefill_ms": 0.0, "query_prefill_ms": 72.31079193297774, "ttft_ms": 72.31079193297774, "decode_ms": 13.560666935518384}, "total_wall_ms": 93.32866605836898, "ttft_ms": 72.31079193297774, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9811889364, "mlx_cache_bytes": 10582913958, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9811889364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bedab5166399364d482c8a24", "attempt_id": "e09d005924c7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.590503Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 48, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.7562080174684525, "receiver_prefill_ms": 0.0, "query_prefill_ms": 79.5494579942897, "ttft_ms": 79.5494579942897, "decode_ms": 13.803083915263414}, "total_wall_ms": 101.19141591712832, "ttft_ms": 79.5494579942897, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9832664320, "mlx_cache_bytes": 10582913958, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9832664320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6f1fd6154d05c58e3725c6f8", "attempt_id": "1aaa0f6060db", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.718902Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 45, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.9091250142082572, "receiver_prefill_ms": 0.0, "query_prefill_ms": 76.69274997897446, "ttft_ms": 76.69274997897446, "decode_ms": 13.585750013589859}, "total_wall_ms": 98.3187499223277, "ttft_ms": 76.69274997897446, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9828617472, "mlx_cache_bytes": 10582913958, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9828617472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4f300220a3a6d9a90c5eb18f", "attempt_id": "276d0ef1fc54", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.845736Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.8474999815225601, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.8231250802055, "ttft_ms": 75.8231250802055, "decode_ms": 13.815249898470938}, "total_wall_ms": 97.71474997978657, "ttft_ms": 75.8231250802055, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9816640748, "mlx_cache_bytes": 10582913958, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9816640748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2900130d6977a0c6b829a7b0", "attempt_id": "2fe5af1e70c8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:31.970726Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9481079816}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 221700096, "serialized_payload_bytes": 221716389, "side_information_bytes": 16293, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3361.0223330324516, "doc_prefill_ms": 1131.545624928549, "compress_ms": 2171.176082920283, "serialize_ms": 57.96966596972197, "load_ms": 1.9858749583363533, "receiver_prefill_ms": 0.0, "query_prefill_ms": 75.76120900921524, "ttft_ms": 75.76120900921524, "decode_ms": 13.763833092525601}, "total_wall_ms": 97.13808307424188, "ttft_ms": 75.76120900921524, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10989715456, "backend_memory": {"mlx_active_bytes": 9705212936, "mlx_peak_bytes": 9816640748, "mlx_cache_bytes": 10582913958, "process_rss_bytes": 10989715456}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9816640748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec696c174fc1d4e816039003ce2a1c0c5d25ef5b482057660959b519d5287e40", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "775dc06e1f5e7d37c26901d1", "attempt_id": "80b1c569b19a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:32.097391Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 37, "compress_ms": 120.88145792949945}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 37, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459815, "side_information_bytes": 16359, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3461.3515000091866, "doc_prefill_ms": 1132.81270803418, "compress_ms": 2309.9115000804886, "serialize_ms": 18.239791970700026, "load_ms": 1.847415929660201, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.17808395717293, "ttft_ms": 43.17808395717293, "decode_ms": 12.219332973472774}, "total_wall_ms": 3529.89837503992, "ttft_ms": 43.17808395717293, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10878992384, "backend_memory": {"mlx_active_bytes": 9373731848, "mlx_peak_bytes": 9450343636, "mlx_cache_bytes": 11108389422, "process_rss_bytes": 10878992384}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9450343636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c00c991e564141f2c9b3b02b1530f71e63116276e78e3d4c4f1757093394e1c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "380da6bab8cc528bf14104cf", "attempt_id": "555ea686690b", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:35.656659Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 43, "compress_ms": 125.41604205034673}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 43, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459815, "side_information_bytes": 16359, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3456.059458083473, "doc_prefill_ms": 1132.186874980107, "compress_ms": 2305.407749954611, "serialize_ms": 18.087249947711825, "load_ms": 1.3212920166552067, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.36891700606793, "ttft_ms": 44.36891700606793, "decode_ms": 12.348041986115277}, "total_wall_ms": 3524.2802079301327, "ttft_ms": 44.36891700606793, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10934468608, "backend_memory": {"mlx_active_bytes": 9373420552, "mlx_peak_bytes": 9460075756, "mlx_cache_bytes": 11156623918, "process_rss_bytes": 10934468608}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9460075756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c00c991e564141f2c9b3b02b1530f71e63116276e78e3d4c4f1757093394e1c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "30c2c11d1d578773d2002104", "attempt_id": "8ededa17c966", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:39.209315Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 41, "compress_ms": 126.37195794377476}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 41, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459815, "side_information_bytes": 16359, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3428.446708014235, "doc_prefill_ms": 1132.8542500268668, "compress_ms": 2278.537999955006, "serialize_ms": 16.678082989528775, "load_ms": 1.3348340289667249, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.467833009548485, "ttft_ms": 44.467833009548485, "decode_ms": 12.278583948500454}, "total_wall_ms": 3498.8609169377014, "ttft_ms": 44.467833009548485, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10934501376, "backend_memory": {"mlx_active_bytes": 9373420552, "mlx_peak_bytes": 9457421548, "mlx_cache_bytes": 11196420654, "process_rss_bytes": 10934501376}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9457421548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c00c991e564141f2c9b3b02b1530f71e63116276e78e3d4c4f1757093394e1c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "531a0d05c23cce4ac5318a2e", "attempt_id": "d0ff6498cdbf", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:42.735691Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 35, "compress_ms": 117.54087498411536}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 35, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459815, "side_information_bytes": 16359, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3436.718458076939, "doc_prefill_ms": 1132.548916968517, "compress_ms": 2289.0291250078008, "serialize_ms": 14.75991599727422, "load_ms": 1.39383296482265, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.10870904009789, "ttft_ms": 43.10870904009789, "decode_ms": 12.381749926134944}, "total_wall_ms": 3503.883415949531, "ttft_ms": 43.10870904009789, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10934534144, "backend_memory": {"mlx_active_bytes": 9373420552, "mlx_peak_bytes": 9446444244, "mlx_cache_bytes": 11238609454, "process_rss_bytes": 10934534144}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9446444244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c00c991e564141f2c9b3b02b1530f71e63116276e78e3d4c4f1757093394e1c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "075362ab8067e8e4c4549dd2", "attempt_id": "e2023975b2e6", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:46.269547Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 48, "compress_ms": 123.61920904368162}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 48, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459815, "side_information_bytes": 16359, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3470.791709027253, "doc_prefill_ms": 1131.8285421002656, "compress_ms": 2323.591624968685, "serialize_ms": 15.005749999545515, "load_ms": 1.3704159064218402, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.12029101513326, "ttft_ms": 44.12029101513326, "decode_ms": 12.387500028125942}, "total_wall_ms": 3538.2084579905495, "ttft_ms": 44.12029101513326, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10934534144, "backend_memory": {"mlx_active_bytes": 9373420552, "mlx_peak_bytes": 9468513536, "mlx_cache_bytes": 11279356462, "process_rss_bytes": 10934534144}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9468513536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c00c991e564141f2c9b3b02b1530f71e63116276e78e3d4c4f1757093394e1c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e4f3e19868eee1aa154b0043", "attempt_id": "e45b5a77374b", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:49.836294Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 45, "compress_ms": 121.126624988392}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 45, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459813, "side_information_bytes": 16357, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3467.5915830302984, "doc_prefill_ms": 1132.640124997124, "compress_ms": 2319.994624936953, "serialize_ms": 14.590000035241246, "load_ms": 1.3280409621074796, "receiver_prefill_ms": 0.0, "query_prefill_ms": 44.85441604629159, "ttft_ms": 44.85441604629159, "decode_ms": 12.306166929192841}, "total_wall_ms": 3536.5596669726074, "ttft_ms": 44.85441604629159, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 45}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10934566912, "backend_memory": {"mlx_active_bytes": 9373420552, "mlx_peak_bytes": 9464483072, "mlx_cache_bytes": 11323019822, "process_rss_bytes": 10934566912}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9464483072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d80d1bf52d09896f98f687fec36fb8a012ffaf367bd3060df8efa70003f2aa84", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "90ad50d858708145afde854f", "attempt_id": "b51b045b7f18", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:53.400997Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 38, "compress_ms": 121.82366591878235}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459815, "side_information_bytes": 16359, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3469.7556659812108, "doc_prefill_ms": 1132.629624917172, "compress_ms": 2321.740417042747, "serialize_ms": 15.030332957394421, "load_ms": 1.3258749386295676, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.75429206993431, "ttft_ms": 43.75429206993431, "decode_ms": 12.435166980139911}, "total_wall_ms": 3539.691749960184, "ttft_ms": 43.75429206993431, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10934599680, "backend_memory": {"mlx_active_bytes": 9373420552, "mlx_peak_bytes": 9451654380, "mlx_cache_bytes": 11359900206, "process_rss_bytes": 10934599680}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9451654380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c00c991e564141f2c9b3b02b1530f71e63116276e78e3d4c4f1757093394e1c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f14357f98f8bb0ec98495ee0", "attempt_id": "be7a11018241", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:41:56.969139Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 6014, "keep": 1504, "window_tokens": 38, "compress_ms": 118.4023329988122}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 55443456, "serialized_payload_bytes": 55459814, "side_information_bytes": 16358, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3428.015625104308, "doc_prefill_ms": 1132.353833061643, "compress_ms": 2280.096458038315, "serialize_ms": 15.215707942843437, "load_ms": 1.3026250526309013, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.23616705369204, "ttft_ms": 43.23616705369204, "decode_ms": 12.285958975553513}, "total_wall_ms": 3497.2319999942556, "ttft_ms": 43.23616705369204, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10934599680, "backend_memory": {"mlx_active_bytes": 9373420552, "mlx_peak_bytes": 9451654380, "mlx_cache_bytes": 11359900206, "process_rss_bytes": 10934599680}, "peak_prefill_memory": 10120580184, "peak_decode_memory": 9451654380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bf0c05bb5e636a9f9287abf4a9991a5c5e0e3417beda397f74e52119cdd7541b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "14260ed259e5eca545c5e3ca", "attempt_id": "e038db4a25bb", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:00.538207Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1998, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.1188339628279, "ttft_ms": 12.2092500096187, "decode_ms": 120.67712494172156}, "total_wall_ms": 832.4260000372306, "ttft_ms": 12.2092500096187, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10490363904, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9967233908, "mlx_cache_bytes": 716330220, "process_rss_bytes": 10490363904}, "peak_prefill_memory": null, "peak_decode_memory": 9967233908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DA-68R-2815", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "97e2778dcc4bad0f2bc307ef463e57160536b92aadd3591c0a5b8a7dc83cd4f6"} | ||||
| 1250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "83ccd5db856fa34055f18b38", "attempt_id": "d86b33e4012b", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:01.390575Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2004, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 692.1884169569239, "ttft_ms": 12.097207945771515, "decode_ms": 144.28279199637473}, "total_wall_ms": 851.9047920126468, "ttft_ms": 12.097207945771515, "input_usage": {"receiver_prompt_tokens": 2004}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 10490396672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968888896, "mlx_cache_bytes": 1340118252, "process_rss_bytes": 10490396672}, "peak_prefill_memory": null, "peak_decode_memory": 9968888896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 191-F, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "2d7ad60e78a85057478a832253fc07fe8f9748d83f535687db486d8b8120a0cf"} | ||||
| 1251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2911d7627a9e9112a963c635", "attempt_id": "45975161cf81", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:02.260697Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2003, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.2028329204768, "ttft_ms": 12.245582998730242, "decode_ms": 84.13745905272663}, "total_wall_ms": 790.4799999669194, "ttft_ms": 12.245582998730242, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10490396672, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9968888896, "mlx_cache_bytes": 1340118252, "process_rss_bytes": 10490396672}, "peak_prefill_memory": null, "peak_decode_memory": 9968888896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "40.2091", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "3edf15d0142ce87a30ad1abb58e5adb9b084b20e118165fba2af0591ba809ce5"} | ||||
| 1252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "86ea94b947a89996b4f8f301", "attempt_id": "6831ad1cdf05", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:03.069427Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1999, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.8164590606466, "ttft_ms": 12.356208055280149, "decode_ms": 60.28945802245289}, "total_wall_ms": 768.0021250853315, "ttft_ms": 12.356208055280149, "input_usage": {"receiver_prompt_tokens": 1999}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 10490429440, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9967365184, "mlx_cache_bytes": 1692046572, "process_rss_bytes": 10490429440}, "peak_prefill_memory": null, "peak_decode_memory": 9967365184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Bohdan Obuya", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "5130fc8d00e2a101feb6481ffda01ed025f12bb643fbbdb1f69c7d1df1023017"} | ||||
| 1253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3e56180131e4934d6a18737c", "attempt_id": "f648b0e255de", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:03.855939Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2005, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.3708329666406, "ttft_ms": 12.132500065490603, "decode_ms": 84.30233295075595}, "total_wall_ms": 791.1850829841569, "ttft_ms": 12.132500065490603, "input_usage": {"receiver_prompt_tokens": 2005}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 10490429440, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9969019968, "mlx_cache_bytes": 2045023468, "process_rss_bytes": 10490429440}, "peak_prefill_memory": null, "peak_decode_memory": 9969019968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8027162", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "9ae48fc60a5c5740535dc29e89e8d80b262356104de0b80f54a5b9ee71c355c8"} | ||||
| 1254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b5281eea05dd57b7176e602f", "attempt_id": "046cf09f9e18", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:04.665273Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2008, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.9328339863569, "ttft_ms": 12.315875035710633, "decode_ms": 120.88408297859132}, "total_wall_ms": 828.6124169826508, "ttft_ms": 12.315875035710633, "input_usage": {"receiver_prompt_tokens": 2008}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10490429440, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9970019392, "mlx_cache_bytes": 2637042924, "process_rss_bytes": 10490429440}, "peak_prefill_memory": null, "peak_decode_memory": 9970019392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JS-65C-5324", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "538cc532cf1099b48a6be1ae0cdba8e5f918e2ab10ac2cf52a3b0237033b3850"} | ||||
| 1255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9954fa46d5e79396aa848b83", "attempt_id": "f66f100d2ea5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:05.512012Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1999, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.2770840097219, "ttft_ms": 12.35183293465525, "decode_ms": 12.079166015610099}, "total_wall_ms": 718.3143750298768, "ttft_ms": 12.35183293465525, "input_usage": {"receiver_prompt_tokens": 1999}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490429440, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9967365184, "mlx_cache_bytes": 2637042924, "process_rss_bytes": 10490429440}, "peak_prefill_memory": null, "peak_decode_memory": 9967365184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f7136ba46e200fa91b814989", "attempt_id": "fc46146a1d00", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:06.248824Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1999, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.6919999746606, "ttft_ms": 12.138666934333742, "decode_ms": 12.116500060074031}, "total_wall_ms": 718.2275409577414, "ttft_ms": 12.138666934333742, "input_usage": {"receiver_prompt_tokens": 1999}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490445824, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9967365184, "mlx_cache_bytes": 2637042924, "process_rss_bytes": 10490445824}, "peak_prefill_memory": null, "peak_decode_memory": 9967365184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "584228bece4f0857b648b74e", "attempt_id": "2a84388ab272", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:08.102784Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 186, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.93625007476658, "ttft_ms": 11.893916060216725, "decode_ms": 11.677375063300133}, "total_wall_ms": 113.32379200030118, "ttft_ms": 11.893916060216725, "input_usage": {"receiver_prompt_tokens": 186, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9452703572, "mlx_cache_bytes": 3577545680, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9452703572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "85123af252a099420a93c91a", "attempt_id": "6015ec612278", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:08.235905Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 192, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.73929192405194, "ttft_ms": 11.811541975475848, "decode_ms": 11.781124980188906}, "total_wall_ms": 109.13750005420297, "ttft_ms": 11.811541975475848, "input_usage": {"receiver_prompt_tokens": 192, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9457799020, "mlx_cache_bytes": 3760932556, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9457799020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "39c4f564c49e288d021b8a25", "attempt_id": "842b2705211f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:08.364966Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 191, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.99195792339742, "ttft_ms": 11.68529107235372, "decode_ms": 11.71200000680983}, "total_wall_ms": 109.98545901384205, "ttft_ms": 11.68529107235372, "input_usage": {"receiver_prompt_tokens": 191, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9457799020, "mlx_cache_bytes": 3760932556, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9457799020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f451582e607bfae753d04c9e", "attempt_id": "570989bac550", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:08.493454Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 187, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.78195795416832, "ttft_ms": 11.702083051204681, "decode_ms": 11.721624992787838}, "total_wall_ms": 109.75316702388227, "ttft_ms": 11.702083051204681, "input_usage": {"receiver_prompt_tokens": 187, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9453342572, "mlx_cache_bytes": 3831023308, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9453342572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eee72d2b1f901ecb815d4452", "attempt_id": "92fae3c05691", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:08.620791Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 193, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.44504195358604, "ttft_ms": 11.715041939169168, "decode_ms": 11.703499942086637}, "total_wall_ms": 108.48204093053937, "ttft_ms": 11.715041939169168, "input_usage": {"receiver_prompt_tokens": 193, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9458438000, "mlx_cache_bytes": 3971008972, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9458438000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4f2cddb0494dc57bed872461", "attempt_id": "e32d53130e18", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:08.746870Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 196, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 100.10958299972117, "ttft_ms": 11.72133395448327, "decode_ms": 11.705667013302445}, "total_wall_ms": 124.1266670404002, "ttft_ms": 11.72133395448327, "input_usage": {"receiver_prompt_tokens": 196, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9462599548, "mlx_cache_bytes": 4167896280, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9462599548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "971244f90ecedb4862f390ee", "attempt_id": "e4390fb3c4d3", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:08.889013Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 187, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.8626249935478, "ttft_ms": 11.844541993923485, "decode_ms": 11.795542086474597}, "total_wall_ms": 109.15654199197888, "ttft_ms": 11.844541993923485, "input_usage": {"receiver_prompt_tokens": 187, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9453342572, "mlx_cache_bytes": 4167896280, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9453342572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cc8598064b06be8e2ddd9254", "attempt_id": "cedb93453c1a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:09.016041Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 187, "message_tokens": 107, "message_utf8_bytes": 460, "cache_tensor_bytes": null, "serialized_payload_bytes": 460, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1117.1867500524968, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.44445801433176, "ttft_ms": 11.847832938656211, "decode_ms": 11.660249903798103}, "total_wall_ms": 108.68337494321167, "ttft_ms": 11.847832938656211, "input_usage": {"receiver_prompt_tokens": 187, "sender_input_tokens": 2039, "sender_output_tokens": 107, "sender_prefill_ms": 346.6562080429867, "sender_ttft_ms": 7.383499993011355, "sender_decode_ms": 761.3503750180826}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490478592, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9453342572, "mlx_cache_bytes": 4167896280, "process_rss_bytes": 10490478592}, "peak_prefill_memory": null, "peak_decode_memory": 9453342572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b95e29e085afb5fa3acab2c2bd23c5e5499162c99bcefa4bc1e92c3adc4362b4", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4cc001a088f62b7a92b59563", "attempt_id": "f15aa656edd3", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:12.449794Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 318, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.54770803824067, "ttft_ms": 11.838041944429278, "decode_ms": 70.37770794704556}, "total_wall_ms": 211.6218749433756, "ttft_ms": 11.838041944429278, "input_usage": {"receiver_prompt_tokens": 318, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 10490494976, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9469645168, "mlx_cache_bytes": 5034252820, "process_rss_bytes": 10490494976}, "peak_prefill_memory": null, "peak_decode_memory": 9469645168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Riruk-11", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "9fbc426588ee3fd9e88ff40172a1f4db46616b6f8065260e7c8718ad970259c9"} | ||||
| 1266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "611f5ec8d89660e93fea143c", "attempt_id": "8677fe70d314", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:12.680472Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 324, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.9679159987718, "ttft_ms": 11.735665961168706, "decode_ms": 11.758791981264949}, "total_wall_ms": 165.24100000970066, "ttft_ms": 11.735665961168706, "input_usage": {"receiver_prompt_tokens": 324, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490511360, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9474757000, "mlx_cache_bytes": 5239004960, "process_rss_bytes": 10490511360}, "peak_prefill_memory": null, "peak_decode_memory": 9474757000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "71b87449e7ed8067882c1638", "attempt_id": "ddd82fe3203d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:12.864260Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 323, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.99941588938236, "ttft_ms": 11.720749898813665, "decode_ms": 117.1426250366494}, "total_wall_ms": 270.5527499783784, "ttft_ms": 11.720749898813665, "input_usage": {"receiver_prompt_tokens": 323, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 10490511360, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9474265480, "mlx_cache_bytes": 5352513312, "process_rss_bytes": 10490511360}, "peak_prefill_memory": null, "peak_decode_memory": 9474265480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,310,050 USD", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "430d891042aacfa1de52ee8b2eb4a35851ee7c86bf4e33aa27bf282314230e3a"} | ||||
| 1268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8242579eb681f87a813c4530", "attempt_id": "f45135f59933", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:13.152852Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 319, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.56091702915728, "ttft_ms": 11.76100003067404, "decode_ms": 11.716125067323446}, "total_wall_ms": 148.70758296456188, "ttft_ms": 11.76100003067404, "input_usage": {"receiver_prompt_tokens": 319, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490511360, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470136712, "mlx_cache_bytes": 5464710944, "process_rss_bytes": 10490511360}, "peak_prefill_memory": null, "peak_decode_memory": 9470136712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bf00897af3ec049a2567e62b", "attempt_id": "02f885bfc58b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:13.319090Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 325, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 140.71745902765542, "ttft_ms": 11.715082917362452, "decode_ms": 105.5159589741379}, "total_wall_ms": 258.67308292072266, "ttft_ms": 11.715082917362452, "input_usage": {"receiver_prompt_tokens": 325, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 10490527744, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9475002764, "mlx_cache_bytes": 5579007024, "process_rss_bytes": 10490527744}, "peak_prefill_memory": null, "peak_decode_memory": 9475002764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,771,339", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "438633810113fa80f027c2d1fce792b2bef50fc3cdd5b03607bf9ce2677127a3"} | ||||
| 1270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f85b9bec6636e630417e4341", "attempt_id": "3a01e5c84bfd", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:13.595369Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 328, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 145.93045797664672, "ttft_ms": 11.74824999179691, "decode_ms": 11.788707925006747}, "total_wall_ms": 170.16187496483326, "ttft_ms": 11.74824999179691, "input_usage": {"receiver_prompt_tokens": 328, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490527744, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9476919704, "mlx_cache_bytes": 5770930508, "process_rss_bytes": 10490527744}, "peak_prefill_memory": null, "peak_decode_memory": 9476919704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1a43aca29438ef5060e74b68", "attempt_id": "2b34f2906c1d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:13.783320Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 319, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.13137499243021, "ttft_ms": 11.75049995072186, "decode_ms": 11.741542024537921}, "total_wall_ms": 148.29833304975182, "ttft_ms": 11.75049995072186, "input_usage": {"receiver_prompt_tokens": 319, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490527744, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470136712, "mlx_cache_bytes": 5770930508, "process_rss_bytes": 10490527744}, "peak_prefill_memory": null, "peak_decode_memory": 9470136712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "901d2ef40950e4c298dc3211", "attempt_id": "aafbf558550b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:13.949069Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 319, "message_tokens": 228, "message_utf8_bytes": 546, "cache_tensor_bytes": null, "serialized_payload_bytes": 546, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3306.687416974455, "decode_payload_ms": 0.0, "receiver_prefill_ms": 124.68387500848621, "ttft_ms": 11.744166957214475, "decode_ms": 11.909624910913408}, "total_wall_ms": 148.97654205560684, "ttft_ms": 11.744166957214475, "input_usage": {"receiver_prompt_tokens": 319, "sender_input_tokens": 2067, "sender_output_tokens": 412, "sender_prefill_ms": 363.0653750151396, "sender_ttft_ms": 7.258416968397796, "sender_decode_ms": 2934.0241249883547}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10490527744, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9470136712, "mlx_cache_bytes": 5770930508, "process_rss_bytes": 10490527744}, "peak_prefill_memory": null, "peak_decode_memory": 9470136712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "de18d432eddc30f120cf4e39c44d86d5a618cfb3e0708a869a45e24ea27bed8c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0a4346b55ee92e4b94a2dbb4", "attempt_id": "45d1a755a4db", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:14.484636Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 36, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 1.975583960302174, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.9291660701856, "ttft_ms": 46.9291660701856, "decode_ms": 580.852167098783}, "total_wall_ms": 631.5781249431893, "ttft_ms": 46.9291660701856, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 36}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9486109904, "mlx_cache_bytes": 6518467181, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9486109904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0的解释，外省編本位高頻繁本�赋出神� GitHub:001.000111！)。\n登出転� dressing: 0111111", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "0f885ddba8ab1be13a7f319986d6e64d17a14406a09a6bb7711c6a2e89835371"} | ||||
| 1274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "38262a5fda63598b59f6a830", "attempt_id": "332d46c3fd61", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:15.135220Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 42, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 1.5798750100657344, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.11412496585399, "ttft_ms": 49.11412496585399, "decode_ms": 578.6513339262456}, "total_wall_ms": 631.1321670655161, "ttft_ms": 49.11412496585399, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 42}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9496431848, "mlx_cache_bytes": 6692219837, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9496431848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No. O: Oscefo-Ket for the time and only me =100 anosay()=0, the only way down points to the most beaux 100010010000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "d1d008e538c68fad049d721adca4d0769bef4939e1c681ca77dd2bfdb2ccf308"} | ||||
| 1275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "72c20781cd7d513eea143674", "attempt_id": "967cf768c426", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:15.785814Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 41, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 1.4299999456852674, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.814708086661994, "ttft_ms": 47.814708086661994, "decode_ms": 579.3477500556037}, "total_wall_ms": 630.4929580073804, "ttft_ms": 47.814708086661994, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 41}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9495399656, "mlx_cache_bytes": 6728870845, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9495399656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oh, ande comtétearretogrogeringasportwoord.\n答案 90-100-1=100-1-1-1-1-1-1-1-1-", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "86fab730428a7f69c6fd34e07229ab7aa245b0de51a419759793eb6c7a199eea"} | ||||
| 1276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eece050453f629eb9164794d", "attempt_id": "f9c87e5935dc", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:16.436481Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 1.4673339901492, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.959833009168506, "ttft_ms": 46.959833009168506, "decode_ms": 579.4159170472994}, "total_wall_ms": 629.6087499940768, "ttft_ms": 46.959833009168506, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9490435304, "mlx_cache_bytes": 6788182294, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9490435304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "100强心為國立體會話�อด联学会,\n国代表車站的崛起成語林则国省會計教育之花火鍋副度:3. 由是國知音-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "1a118547195fba5a05df8ae1d8411460017a472bce7848f886af19b07f67fd91"} | ||||
| 1277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "04fbede3bc62d4b3ac0fb36a", "attempt_id": "74d9bf0c0693", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:17.085035Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 43, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 1.4201670419424772, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.14533400349319, "ttft_ms": 48.14533400349319, "decode_ms": 578.8927500834689}, "total_wall_ms": 630.3519998909906, "ttft_ms": 48.14533400349319, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 43}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9497988332, "mlx_cache_bytes": 6861009518, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9497988332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ", let the most convenient, the most popularized, the most memorable words, it was \"u101: 200 Táawhavt; \"not100字词典, 201", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "ac15daf4724cc34a6d7fa14435887b0e3b2a3481380899690d3ddf511b563018"} | ||||
| 1278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fbf863895b6e18ea7073f17d", "attempt_id": "f5123f95019c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:17.734123Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 46, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 1.5372090274468064, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.13833399768919, "ttft_ms": 49.13833399768919, "decode_ms": 580.7674590032548}, "total_wall_ms": 633.3834999240935, "ttft_ms": 49.13833399768919, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 46}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9503853816, "mlx_cache_bytes": 6896071646, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9503853816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "order # 1-10001篇论文之对吧，我想对吧，我想，对吧，对角力——对角儿光：化，即学士讲，为100字出走", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "180eeaab41a512f46206b744653e977d18c6b2cdf879c2ed13d7770768a6794c"} | ||||
| 1279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d30ebd4aa689ea1da32bae7f", "attempt_id": "a031cfa90fa0", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:18.387315Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 0.8612920064479113, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.2292090523988, "ttft_ms": 46.2292090523988, "decode_ms": 576.8071670318022}, "total_wall_ms": 625.8184999460354, "ttft_ms": 46.2292090523988, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9490435304, "mlx_cache_bytes": 6897251294, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9490435304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ".\nPto equiparx\n -x1-200名100名1.\n他者為人気嘛，我為主任論说记谱书名：201-10001-", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "f5f3025dd8d9edee4e65ab17a61100811a1cad66875726436f083b6a571701af"} | ||||
| 1280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ca29beffccf3cfa9f8b45425", "attempt_id": "fbecb24f8b11", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:18.901170Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343269, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 368.9306249143556, "doc_prefill_ms": 339.2255420330912, "compress_ms": 9.127624914981425, "serialize_ms": 17.120500095188618, "load_ms": 1.4158330159261823, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.71541601419449, "ttft_ms": 46.71541601419449, "decode_ms": 577.7122499421239}, "total_wall_ms": 627.6627499610186, "ttft_ms": 46.71541601419449, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 10636017664, "backend_memory": {"mlx_active_bytes": 9408138248, "mlx_peak_bytes": 9490435304, "mlx_cache_bytes": 6897251294, "process_rss_bytes": 10636017664}, "peak_prefill_memory": 9982356352, "peak_decode_memory": 9490435304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "华人性岂用心能對話flow,眼看flow,力行家唯一比較強心為人之2。\n(1)。\n论话动，謝才子人之美，我係 exponential1.0-17:", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a1e139abac238d9eb350cd7b248888b268d46b7979e1c9483b6295005d898ef", "output_hash": "3b63e3d8e4b3a6b65f5d868ce3659527d216b96871d94c545929d2bd4d2fb652"} | ||||
| 1281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cc420c057e977e918cb851ce", "attempt_id": "403402ffe28e", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:20.823504Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 36, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.6491670394316316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.50154196843505, "ttft_ms": 63.50154196843505, "decode_ms": 12.54212495405227}, "total_wall_ms": 79.48708406183869, "ttft_ms": 63.50154196843505, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9485552848, "mlx_cache_bytes": 6901937118, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9485552848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "00bd50d5f2ad10a7f8ac0d3e", "attempt_id": "2e1539520b63", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:20.924910Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 42, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.3482500799000263, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.52333304006606, "ttft_ms": 48.52333304006606, "decode_ms": 12.322416994720697}, "total_wall_ms": 64.14970802143216, "ttft_ms": 48.52333304006606, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9496038632, "mlx_cache_bytes": 6901937118, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9496038632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d0e683acb4842113dc6ed903", "attempt_id": "54dcf816cf07", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:21.007688Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 41, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.350458012893796, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.60950000490993, "ttft_ms": 47.60950000490993, "decode_ms": 12.569749960675836}, "total_wall_ms": 63.4900419972837, "ttft_ms": 47.60950000490993, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9495006440, "mlx_cache_bytes": 6901937118, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9495006440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "345897c84986056fee9ded4d", "attempt_id": "efecf30eb2ed", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:21.089694Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.3643329730257392, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.3256670627743, "ttft_ms": 46.3256670627743, "decode_ms": 12.545709032565355}, "total_wall_ms": 62.108166981488466, "ttft_ms": 46.3256670627743, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9490042088, "mlx_cache_bytes": 6901937118, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9490042088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8115efd46069e12ff4770640", "attempt_id": "c236155324ec", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:21.171364Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 43, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.4353340957313776, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.60291601996869, "ttft_ms": 47.60291601996869, "decode_ms": 12.45912502054125}, "total_wall_ms": 63.32133396063, "ttft_ms": 47.60291601996869, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9497595116, "mlx_cache_bytes": 6901937118, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9497595116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be20b67930b10ebc4bc58b8b", "attempt_id": "f34679216978", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:21.253946Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 46, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.3911660062149167, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.146957928314805, "ttft_ms": 49.146957928314805, "decode_ms": 12.395167024806142}, "total_wall_ms": 64.70750004518777, "ttft_ms": 49.146957928314805, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9503493368, "mlx_cache_bytes": 6907016158, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9503493368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "32ea956a633929bacab1a323", "attempt_id": "558e7d942722", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:21.337775Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.4031670289114118, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.51520797051489, "ttft_ms": 46.51520797051489, "decode_ms": 12.39291694946587}, "total_wall_ms": 62.203000066801906, "ttft_ms": 46.51520797051489, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9490042088, "mlx_cache_bytes": 6907016158, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9490042088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1880257a3a568188956f677e", "attempt_id": "f2386035aa94", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:21.418126Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 72327168, "serialized_payload_bytes": 72343370, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1272.9762078961357, "doc_prefill_ms": 337.5630419468507, "compress_ms": 913.7570830062032, "serialize_ms": 21.368458052165806, "load_ms": 1.386208925396204, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.61545902490616, "ttft_ms": 46.61545902490616, "decode_ms": 12.36687507480383}, "total_wall_ms": 62.07087496295571, "ttft_ms": 46.61545902490616, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10610294784, "backend_memory": {"mlx_active_bytes": 9407482888, "mlx_peak_bytes": 9490042088, "mlx_cache_bytes": 6907016158, "process_rss_bytes": 10610294784}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9490042088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94d1882b0afebe38613149012956de4b447a0a338d890e5f7086e668bc919c7e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "39b0ab99fc0c09c788937e77", "attempt_id": "fa83ac940f43", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:21.497896Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 36, "compress_ms": 80.61458403244615}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 36, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1327.932915999554, "doc_prefill_ms": 338.10191601514816, "compress_ms": 983.4604589268565, "serialize_ms": 6.063541979528964, "load_ms": 1.4592499937862158, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.60316702350974, "ttft_ms": 35.60316702350974, "decode_ms": 11.989374994300306}, "total_wall_ms": 1380.5035409750417, "ttft_ms": 35.60316702350974, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10594058240, "backend_memory": {"mlx_active_bytes": 9298856968, "mlx_peak_bytes": 9365802192, "mlx_cache_bytes": 7086191030, "process_rss_bytes": 10594058240}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9365802192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f167733aa141bf7e63490b70", "attempt_id": "3ea0cfe479a9", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:22.895856Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 42, "compress_ms": 81.91633294336498}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 42, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1338.4927499573678, "doc_prefill_ms": 338.07166607584804, "compress_ms": 994.7050409391522, "serialize_ms": 5.407209042459726, "load_ms": 1.1632080422714353, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.194250035099685, "ttft_ms": 37.194250035099685, "decode_ms": 11.963416007347405}, "total_wall_ms": 1391.8960409937426, "ttft_ms": 37.194250035099685, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 42}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10612948992, "backend_memory": {"mlx_active_bytes": 9298627592, "mlx_peak_bytes": 9376566504, "mlx_cache_bytes": 7104967094, "process_rss_bytes": 10612948992}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9376566504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "955f12ef04eabeda9555af3d", "attempt_id": "1660f4b10cda", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:24.308563Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 41, "compress_ms": 94.57904193550348}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 41, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1336.3060830160975, "doc_prefill_ms": 337.69958303309977, "compress_ms": 992.6526669878513, "serialize_ms": 5.610625026747584, "load_ms": 1.1742078932002187, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.263415986672044, "ttft_ms": 37.263415986672044, "decode_ms": 11.944999918341637}, "total_wall_ms": 1390.2116660028696, "ttft_ms": 37.263415986672044, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 41}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10612948992, "backend_memory": {"mlx_active_bytes": 9298627592, "mlx_peak_bytes": 9375534312, "mlx_cache_bytes": 7110799798, "process_rss_bytes": 10612948992}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9375534312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6bbdee30c6697c8e6517ce1d", "attempt_id": "2e679015d4e8", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:25.718608Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 37, "compress_ms": 81.74037502612919}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1318.182084010914, "doc_prefill_ms": 337.233041995205, "compress_ms": 975.7942499127239, "serialize_ms": 4.865000024437904, "load_ms": 1.2033750535920262, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.88829205930233, "ttft_ms": 36.88829205930233, "decode_ms": 17.800207948312163}, "total_wall_ms": 1377.195458044298, "ttft_ms": 36.88829205930233, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10612948992, "backend_memory": {"mlx_active_bytes": 9298627592, "mlx_peak_bytes": 9368374504, "mlx_cache_bytes": 7140848054, "process_rss_bytes": 10612948992}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9368374504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d61e3e02456898907de5eb93", "attempt_id": "79e9e47672aa", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:27.115873Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 43, "compress_ms": 84.68274993356317}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 43, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1340.8924579853192, "doc_prefill_ms": 338.40445906389505, "compress_ms": 997.359124943614, "serialize_ms": 4.834791994653642, "load_ms": 1.0342499008402228, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.065832992084324, "ttft_ms": 37.065832992084324, "decode_ms": 11.901790974661708}, "total_wall_ms": 1394.0127081004903, "ttft_ms": 37.065832992084324, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 43}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10612948992, "backend_memory": {"mlx_active_bytes": 9298627592, "mlx_peak_bytes": 9378122988, "mlx_cache_bytes": 7167390134, "process_rss_bytes": 10612948992}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9378122988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aeda0145d0ee2671018664ff", "attempt_id": "dff5df7d0c20", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:28.529955Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 46, "compress_ms": 84.7040000371635}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 46, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079442, "side_information_bytes": 16082, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1337.6645829994231, "doc_prefill_ms": 338.05920893792063, "compress_ms": 994.4427920272574, "serialize_ms": 4.849917022511363, "load_ms": 4.627999966032803, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.97066693753004, "ttft_ms": 38.97066693753004, "decode_ms": 12.05783395562321}, "total_wall_ms": 1396.4603749336675, "ttft_ms": 38.97066693753004, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10612948992, "backend_memory": {"mlx_active_bytes": 9298627592, "mlx_peak_bytes": 9384021240, "mlx_cache_bytes": 7189295542, "process_rss_bytes": 10612948992}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9384021240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4afd8079af674c76b1572eedb81c64c6e4a120f3d994f6b5eb9e36b31a9a60d8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b068f38c694f7ec426a5ed33", "attempt_id": "b5d958405498", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:29.946158Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 37, "compress_ms": 79.2959169484675}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079442, "side_information_bytes": 16082, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1352.1832909900695, "doc_prefill_ms": 337.87620801012963, "compress_ms": 1009.2313750647008, "serialize_ms": 4.787958110682666, "load_ms": 1.0218339739367366, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.98029201384634, "ttft_ms": 35.98029201384634, "decode_ms": 11.888625100255013}, "total_wall_ms": 1404.2072909651324, "ttft_ms": 35.98029201384634, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10612948992, "backend_memory": {"mlx_active_bytes": 9298627592, "mlx_peak_bytes": 9368374504, "mlx_cache_bytes": 7189295542, "process_rss_bytes": 10612948992}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9368374504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4afd8079af674c76b1572eedb81c64c6e4a120f3d994f6b5eb9e36b31a9a60d8", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a9b8ac2603f68635992e528d", "attempt_id": "de4fdfd3fbf5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:31.370479Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1962, "keep": 490, "window_tokens": 37, "compress_ms": 80.16095904167742}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079443, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1335.2683749981225, "doc_prefill_ms": 337.34379103407264, "compress_ms": 992.8532910998911, "serialize_ms": 4.788874997757375, "load_ms": 1.11624994315207, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.072625080123544, "ttft_ms": 36.072625080123544, "decode_ms": 12.075000093318522}, "total_wall_ms": 1387.5949160428718, "ttft_ms": 36.072625080123544, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10612948992, "backend_memory": {"mlx_active_bytes": 9298627592, "mlx_peak_bytes": 9368374504, "mlx_cache_bytes": 7189295542, "process_rss_bytes": 10612948992}, "peak_prefill_memory": 9982208896, "peak_decode_memory": 9368374504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7afae77c280700e6234794f1e0da8463293dd5542ea3c6d3401453b0d643c3c6", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3b144f1a169ebcf2c403a382", "attempt_id": "1d792f6efbe3", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:32.808532Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 1926, "message_tokens": 1843, "message_utf8_bytes": 7892, "cache_tensor_bytes": null, "serialized_payload_bytes": 7892, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.006250105798244476, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.8797499351203, "ttft_ms": 12.66754197422415, "decode_ms": 1255.1797920605168}, "total_wall_ms": 1947.399374912493, "ttft_ms": 12.66754197422415, "input_usage": {"receiver_prompt_tokens": 1926}, "output_usage": {"output_tokens": 105}, "provider_cached_usage": null, "process_memory": 10452942848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9944394324, "mlx_cache_bytes": 693490636, "process_rss_bytes": 10452942848}, "peak_prefill_memory": null, "peak_decode_memory": 9944394324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Centre':\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "output_hash": "5f25173e7b1a616c4eea703e50311df5ebdd9ac271873ce14a3700496d807d0c"} | ||||
| 1298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "29c6e68637ad7e8e284fd5d5", "attempt_id": "238bc79ffb7f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:37.040387Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 355, "message_tokens": 268, "message_utf8_bytes": 1198, "cache_tensor_bytes": null, "serialized_payload_bytes": 1198, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2244.989666971378, "decode_payload_ms": 0.0, "receiver_prefill_ms": 146.9719170127064, "ttft_ms": 11.857584002427757, "decode_ms": 1003.6387500585988}, "total_wall_ms": 1163.638334022835, "ttft_ms": 11.857584002427757, "input_usage": {"receiver_prompt_tokens": 355, "sender_input_tokens": 1959, "sender_output_tokens": 268, "sender_prefill_ms": 339.27720901556313, "sender_ttft_ms": 7.325208047404885, "sender_decode_ms": 1896.1626249365509}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 10452992000, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9493746180, "mlx_cache_bytes": 1711211860, "process_rss_bytes": 10452992000}, "peak_prefill_memory": null, "peak_decode_memory": 9493746180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n valid_rows = [row for row in rows if row['region'] != 'Centre' and row['units'] >= 4]\n revenue = sum(row['units'] * row['unit_price'] * (1 - row['discount']) for row in valid_rows)\n revenue_with_tax = revenue * 1.09975\n return round(revenue_with_tax)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "789245523afc1c78a7dc211f549f8e0a17d0ecce8b97cf5706fa2115fc8c3067", "output_hash": "8b8b2fe81c852068895318c5cc0dd4a53a8d27ea665b67194bf3bcfa0c2334da"} | ||||
| 1299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "09aa485a528acac8cf672629", "attempt_id": "0246fbe10b68", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:42.213238Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 414, "message_tokens": 316, "message_utf8_bytes": 991, "cache_tensor_bytes": null, "serialized_payload_bytes": 991, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3971.3697499828413, "decode_payload_ms": 0.0, "receiver_prefill_ms": 167.8372089518234, "ttft_ms": 12.027292046695948, "decode_ms": 11.854583048261702}, "total_wall_ms": 192.7586670499295, "ttft_ms": 12.027292046695948, "input_usage": {"receiver_prompt_tokens": 414, "sender_input_tokens": 1987, "sender_output_tokens": 512, "sender_prefill_ms": 343.1490419898182, "sender_ttft_ms": 7.30670802295208, "sender_decode_ms": 3618.549917009659}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10453008384, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9529399420, "mlx_cache_bytes": 2738062676, "process_rss_bytes": 10453008384}, "peak_prefill_memory": null, "peak_decode_memory": 9529399420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "02d673ee4b9dfa5c7fe5dfa1220d74810365a34b02ab9216203b1071d566af57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e7a6b6abdc772eeb53ae5a04", "attempt_id": "6149e4e6a463", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:42.796228Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7892, "cache_tensor_bytes": 69378048, "serialized_payload_bytes": 69394145, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.56949993688613, "doc_prefill_ms": 321.7841659206897, "compress_ms": 9.745124960318208, "serialize_ms": 15.866708010435104, "load_ms": 2.097125048749149, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.743832972832024, "ttft_ms": 48.743832972832024, "decode_ms": 3918.5897919815034}, "total_wall_ms": 3971.336332964711, "ttft_ms": 48.743832972832024, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10592010240, "backend_memory": {"mlx_active_bytes": 9413282824, "mlx_peak_bytes": 9492630768, "mlx_cache_bytes": 4251256501, "process_rss_bytes": 10592010240}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9492630768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "u_cbraccoe. please make 1 ONLY\n#### Sheltall_the_hallowstamracco\n#### Please standfornuevo_letm_1_col\n.ex-1_with,\nmove that itunes_user\nNo whieaseheu (32bits)?\nuibold\n\nFor the rest: noNOC and cia\nmove,\nmoveableitonly\n1\n\nof the case that itau\nof power that itur:1\n\nHow?!\" 101_sum\n1.createQuery\n1\n\n### rows, please sir\n#### 1, please let it be more\ncase-sensitive is itau\nthat it is it\n15 european\n1 it is possible world pro n\nnet\n2. - and now\nthat this isssue\nup\n\n\"howie_too_long_it_has_it\n1\n\nWhere\n1\n\nhttp://ischwurf[和\n用\n1\n\n### 1\n\nhttp\n\\\n\nhttp\n\\\n\nphotostate_form[1,compu\nhave_please\nthem\n\n2\n\n1\n\n1.oughterwech\n\n答案\n-1\n\n### 1, but\n\n请\n, important\n#### 1\n1\n\n####\n\n1h\n\n1\n\n### 1\n\n1\n\n### 请\n\n1\n\n#### 1\n\n### 1\n\n,动2.doctor\n\n####\n\nhttp://endifs\n\n1\n\n1\n\nhttp\n\n答案\n\n2\n\n## 进制词\nhttp\n### 1\n\n1, thank you", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fe9bfa4493868164b493246bbd481de98a92e499d61ea0c5c7cf441d13a4abf3", "output_hash": "8e73a034923d228f558b32ba0050c76e02429ed1d50076e2ab105026313b295e"} | ||||
| 1301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e3f5c0f3f158196031cd49fd", "attempt_id": "4bf4935af188", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:48.023754Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7892, "cache_tensor_bytes": 69378048, "serialized_payload_bytes": 69394246, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1216.3435419788584, "doc_prefill_ms": 323.6728749470785, "compress_ms": 876.1066669831052, "serialize_ms": 16.26270799897611, "load_ms": 1.4467500150203705, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.66770795546472, "ttft_ms": 58.66770795546472, "decode_ms": 1044.6864169789478}, "total_wall_ms": 1106.6596249584109, "ttft_ms": 58.66770795546472, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10597580800, "backend_memory": {"mlx_active_bytes": 9404189704, "mlx_peak_bytes": 9492434160, "mlx_cache_bytes": 4264216245, "process_rss_bytes": 10597580800}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9492434160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "51410d18dce697caa26be3efc3f7accfb2868b52a0eac12300931116f8ad1a8a", "output_hash": "4584dd5e32c66d03ed4d99346093e0fc113857c44208d8210acccceafe34fd94"} | ||||
| 1302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "deff1e980e69d808d0113ed5", "attempt_id": "c13c0140cd45", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:49.170812Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1882, "keep": 470, "window_tokens": 44, "compress_ms": 81.46937494166195}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7892, "cache_tensor_bytes": 17326080, "serialized_payload_bytes": 17342157, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1306.8917921045795, "doc_prefill_ms": 324.41170793026686, "compress_ms": 975.4839170491323, "serialize_ms": 6.701707956381142, "load_ms": 1.147792092524469, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.72608407214284, "ttft_ms": 36.72608407214284, "decode_ms": 837.91433298029}, "total_wall_ms": 2186.1242500599474, "ttft_ms": 36.72608407214284, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10582425600, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4505551373, "process_rss_bytes": 10582425600}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Centre':\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c15d0ebba8e3e09ee1427871d2acaa29b117bd455d860065470ea73e76623f2f", "output_hash": "77418dd0c94325bca6b82322e2a38c9ad306e06dba9ca9df1780ebb1426dc7d9"} | ||||
| 1303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7665f7c7de4dcdc64e8a9ef5", "attempt_id": "75ef1908a361", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:51.420629Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 1926, "message_tokens": 1843, "message_utf8_bytes": 7665, "cache_tensor_bytes": null, "serialized_payload_bytes": 7665, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007208087481558323, "decode_payload_ms": 0.0, "receiver_prefill_ms": 672.7912080241367, "ttft_ms": 12.33691698871553, "decode_ms": 1226.829333929345}, "total_wall_ms": 1915.747332968749, "ttft_ms": 12.33691698871553, "input_usage": {"receiver_prompt_tokens": 1926}, "output_usage": {"output_tokens": 102}, "provider_cached_usage": null, "process_memory": 10452238336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9944394324, "mlx_cache_bytes": 693490636, "process_rss_bytes": 10452238336}, "peak_prefill_memory": null, "peak_decode_memory": 9944394324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.05\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "output_hash": "6263b0a9e86acb28188f4e95fe97726c1fa73d4518e84a7253d363b027a132cd"} | ||||
| 1304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2a7eec668eb82e13c5b79b97", "attempt_id": "f080329668e6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:54.674735Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 221, "message_tokens": 134, "message_utf8_bytes": 659, "cache_tensor_bytes": null, "serialized_payload_bytes": 659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1300.7719169836491, "decode_payload_ms": 0.0, "receiver_prefill_ms": 104.10024994052947, "ttft_ms": 11.873917072080076, "decode_ms": 711.6495830705389}, "total_wall_ms": 828.5668329335749, "ttft_ms": 11.873917072080076, "input_usage": {"receiver_prompt_tokens": 221, "sender_input_tokens": 1959, "sender_output_tokens": 134, "sender_prefill_ms": 338.7771249981597, "sender_ttft_ms": 7.516374927945435, "sender_decode_ms": 952.255415963009}, "output_usage": {"output_tokens": 61}, "provider_cached_usage": null, "process_memory": 10452271104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9483522028, "mlx_cache_bytes": 1715454780, "process_rss_bytes": 10452271104}, "peak_prefill_memory": null, "peak_decode_memory": 9483522028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['units'] >= 3 and not row['returned']:\n total_revenue += row['price'] * row['units'] * 1.05\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d481ef243228c0715b35816abbea258366d21d0685808dffcfad01d0e1e3fec3", "output_hash": "331efc5201db5e2ccfcc72b01621757cc44a954f8f0a4fd18acb8549fbf55ce2"} | ||||
| 1305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "83fcc452746cc0b7b137f26f", "attempt_id": "85676c05ca1b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:42:59.534055Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 425, "message_tokens": 326, "message_utf8_bytes": 811, "cache_tensor_bytes": null, "serialized_payload_bytes": 811, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3992.1209999592975, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.967833022587, "ttft_ms": 11.9827080052346, "decode_ms": 11.891208007000387}, "total_wall_ms": 195.84012497216463, "ttft_ms": 11.9827080052346, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 1987, "sender_output_tokens": 512, "sender_prefill_ms": 340.40308301337063, "sender_ttft_ms": 7.253290968947113, "sender_decode_ms": 3642.0756250154227}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452303872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9535608956, "mlx_cache_bytes": 2748760892, "process_rss_bytes": 10452303872}, "peak_prefill_memory": null, "peak_decode_memory": 9535608956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "45b1bdb228e0e7637d9ae54e0eb10e2e687225622eedd3b93c65b04d21915e9f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d1516d70fc8809d0446d7a72", "attempt_id": "4ffcdc20f6d5", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:00.118772Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7665, "cache_tensor_bytes": 69378048, "serialized_payload_bytes": 69394145, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.18762496858835, "doc_prefill_ms": 321.5144999558106, "compress_ms": 9.84483293723315, "serialize_ms": 15.858375001698732, "load_ms": 2.134665963239968, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.301916966214776, "ttft_ms": 49.301916966214776, "decode_ms": 3936.6710000904277}, "total_wall_ms": 3990.0128340814263, "ttft_ms": 49.301916966214776, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10591305728, "backend_memory": {"mlx_active_bytes": 9413315592, "mlx_peak_bytes": 9492188400, "mlx_cache_bytes": 4277585053, "process_rss_bytes": 10591305728}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9492188400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "=ACNOLAuserfulpre=acm?isch0=1 COMEau frappe=2=2, noo=9, no of k-indien=1c=1。 1. 1.那还应该在世为它为king为宜有话说。一、动过动辄用201.0. 2002. 1. 2002.1.0 do nwo让读不懂会付出爱牙硬騠解 оф 错外有张生化=1501必然王国制造u. 1001,永稳键而为多少了。这一版.美)2016.0.永又如此类比特别优无弯，包括上下为那优异地运动方程的.我独标的物以策,包括它好吗？为宜,包括它可来多少？方正解不离奇,发文章,我们好则有好,动辄永转一天的事,请自问恒等距而不宜慢从梯度所掌握始得,始于2002.1001.1,我愧1.1,包括它的服务最好的是默而忘,请贴一贴身黑即为宜:1.当然上策定级,包括制正身之人在何为蓝的请购火山,省有的糖网上不方便,多发3.1,谢谢有这么量多练:1.101.1,包括", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fe9bfa4493868164b493246bbd481de98a92e499d61ea0c5c7cf441d13a4abf3", "output_hash": "8a552d04cb463497e0f3225c0cddb1958c2a8aab8cc6d8ce3a78fdbc1ff804a1"} | ||||
| 1307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "efb6a4855976a03238dc997d", "attempt_id": "b2388e16dccf", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:05.364193Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7665, "cache_tensor_bytes": 69378048, "serialized_payload_bytes": 69394246, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1214.6096670767292, "doc_prefill_ms": 324.84770892187953, "compress_ms": 873.4483330044895, "serialize_ms": 16.00829092785716, "load_ms": 1.6128330025821924, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.69724993500859, "ttft_ms": 67.69724993500859, "decode_ms": 1044.661374995485}, "total_wall_ms": 1115.8339999383315, "ttft_ms": 67.69724993500859, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10597597184, "backend_memory": {"mlx_active_bytes": 9404173320, "mlx_peak_bytes": 9491893488, "mlx_cache_bytes": 4290593949, "process_rss_bytes": 10597597184}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9491893488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "51410d18dce697caa26be3efc3f7accfb2868b52a0eac12300931116f8ad1a8a", "output_hash": "ce110bd25efb008d46785baf5429a864cc124b4b3b9039241e42f85d27d8ce38"} | ||||
| 1308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a3a076886517d4c20bedbf57", "attempt_id": "cf21f293860e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:06.521194Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1882, "keep": 470, "window_tokens": 44, "compress_ms": 83.24745809659362}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7665, "cache_tensor_bytes": 17326080, "serialized_payload_bytes": 17342157, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1303.3393339719623, "doc_prefill_ms": 324.45525005459785, "compress_ms": 971.9005000079051, "serialize_ms": 6.68049999512732, "load_ms": 1.160499989055097, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.40329190623015, "ttft_ms": 37.40329190623015, "decode_ms": 1001.9428749801591}, "total_wall_ms": 2347.2869580145925, "ttft_ms": 37.40329190623015, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10582409216, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4531912693, "process_rss_bytes": 10582409216}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Est': # Assuming 'returned' and 'region' keys are present\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c15d0ebba8e3e09ee1427871d2acaa29b117bd455d860065470ea73e76623f2f", "output_hash": "89867c24cc74df6d0858627edf7627fe2b3f7eae26cbc6433e2cb3c8483bb540"} | ||||
| 1309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "928ce080d8cd48d939b79bfd", "attempt_id": "42b8c2ac5ffe", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:08.930800Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 1924, "message_tokens": 1841, "message_utf8_bytes": 7788, "cache_tensor_bytes": null, "serialized_payload_bytes": 7788, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009042094461619854, "decode_payload_ms": 0.0, "receiver_prefill_ms": 673.932750010863, "ttft_ms": 12.518874951638281, "decode_ms": 1200.6757500348613}, "total_wall_ms": 1890.8509579487145, "ttft_ms": 12.518874951638281, "input_usage": {"receiver_prompt_tokens": 1924}, "output_usage": {"output_tokens": 100}, "provider_cached_usage": null, "process_memory": 10452254720, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9943657036, "mlx_cache_bytes": 692753348, "process_rss_bytes": 10452254720}, "peak_prefill_memory": null, "peak_decode_memory": 9943657036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.05, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "output_hash": "ae9eeb541c97efe59b38079cd2fe319b4210f1cb7bad8b85ae3a85484e0ab419"} | ||||
| 1310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0d870ec6d9018dcdcdc17255", "attempt_id": "701b1b12a251", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:12.702302Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 297, "message_tokens": 210, "message_utf8_bytes": 1042, "cache_tensor_bytes": null, "serialized_payload_bytes": 1042, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1842.500290949829, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.79154197778553, "ttft_ms": 11.883749975822866, "decode_ms": 857.0702919969335}, "total_wall_ms": 997.8005409939215, "ttft_ms": 11.883749975822866, "input_usage": {"receiver_prompt_tokens": 297, "sender_input_tokens": 1957, "sender_output_tokens": 210, "sender_prefill_ms": 339.2868749797344, "sender_ttft_ms": 7.439749897457659, "sender_decode_ms": 1493.4185000602156}, "output_usage": {"output_tokens": 73}, "provider_cached_usage": null, "process_memory": 10452303872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9456472348, "mlx_cache_bytes": 1670825060, "process_rss_bytes": 10452303872}, "peak_prefill_memory": null, "peak_decode_memory": 9456472348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n for row in rows:\n if row['returned'] or row['region'] == 'excluded_region' or row['units'] < 5:\n rows.remove(row)\n return sum(row['units'] * row['unit_price'] * (1 - row['discount']) for row in rows)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9413834911ad8dacb6db4f302fb2f377e7017af001a70298493a9dd7e07323ad", "output_hash": "73fe43ace94c656b68c5e9eda64eaca3e27c71ad2fa81cc01199b035285049db"} | ||||
| 1311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3dd8fe49620f2148abdc6c7e", "attempt_id": "01aa4c9809f4", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:17.726781Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 357, "message_tokens": 258, "message_utf8_bytes": 753, "cache_tensor_bytes": null, "serialized_payload_bytes": 753, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.9291669931263, "decode_payload_ms": 0.0, "receiver_prefill_ms": 146.94458397570997, "ttft_ms": 11.900832992978394, "decode_ms": 892.9483749670908}, "total_wall_ms": 1052.8135829372332, "ttft_ms": 11.900832992978394, "input_usage": {"receiver_prompt_tokens": 357, "sender_input_tokens": 1985, "sender_output_tokens": 512, "sender_prefill_ms": 339.3680419540033, "sender_ttft_ms": 7.398083922453225, "sender_decode_ms": 3638.679709052667}, "output_usage": {"output_tokens": 76}, "provider_cached_usage": null, "process_memory": 10452303872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9494483468, "mlx_cache_bytes": 2658142708, "process_rss_bytes": 10452303872}, "peak_prefill_memory": null, "peak_decode_memory": 9494483468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_net_revenue = 0\n for row in rows:\n unit_price = row['unit_price']\n discount_pct = row['discount_pct']\n net_price = unit_price * (1 - discount_pct / 100)\n total_net_revenue += net_price * row['units']\n return total_net_revenue", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8866b8bd5db9aa99a2fa6dcb0bccb7c6a99c46daa93e876e22c6d888918c5958", "output_hash": "0c7a3c7b8e694ac679a60ef5780ef44e6e19f30570ae879c7dd61603c7fbc21d"} | ||||
| 1312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "74a9833543c79e2b3cc181bc", "attempt_id": "9ec90ea27acb", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:19.171944Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7788, "cache_tensor_bytes": 69304320, "serialized_payload_bytes": 69320417, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15387502871454, "doc_prefill_ms": 324.6708329534158, "compress_ms": 9.691249928437173, "serialize_ms": 15.915374970063567, "load_ms": 2.118124975822866, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.50366699974984, "ttft_ms": 48.50366699974984, "decode_ms": 3921.895083039999}, "total_wall_ms": 3974.392000003718, "ttft_ms": 48.50366699974984, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10591240192, "backend_memory": {"mlx_active_bytes": 9413282824, "mlx_peak_bytes": 9492630768, "mlx_cache_bytes": 4175072085, "process_rss_bytes": 10591240192}, "peak_prefill_memory": 9954634328, "peak_decode_memory": 9492630768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "- code isueat\nwith with german storm code yellow_fen, hoesi\nis it possible with ital. at or that ital raters for sure thomas\nwith\nputer fro\nthat was toelo\nonly so abcs\nonly this getsmadness\nwith marines\n****, esn, esn, eti\ncollege\nbo, espr\nhail esist\nwhat the gamebo\n## coderie\n## that it\nwegu\nespresso\nespresso\nri_it 为它挥\nespresso又icorn\n, leet\nist\nessex\n为基数的外感光,有几多特快,新(只\nh):\n（\n战\n为\n, eso\n(华泰热的\n\n- tbw的小说被\nposiù\nespo再输入项,\nespo\n## 为\n,ofor\n####\n\n导\n为t\n,介\n, 1,子能,加多,子武科的,在进行的\n, 1-羟基,那,分值,必修,它指,全蝎长发,必,必有,方程,约11月清,必杀清,必有学生有其压不服贴\n别太清,打起,必解其分,有越多,当然,军,必多,子,有,\n\"请按必有方不优,必有方快,多选角膜面积之分", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2edcdbf453ee92e40f9c0f91dd2f36dd634a5399dd63f4b6ae39fb2ff7630813", "output_hash": "9ca82bdce98f3560eaa52ee3ef2961473dd6f87cb3de30ae24620118827efe1d"} | ||||
| 1313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b7e2ab1d2edd2376c467c82e", "attempt_id": "c95183714cbd", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:24.407209Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7788, "cache_tensor_bytes": 69304320, "serialized_payload_bytes": 69320518, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1221.2648330023512, "doc_prefill_ms": 323.8463340094313, "compress_ms": 881.0325419763103, "serialize_ms": 16.0973749589175, "load_ms": 1.428666990250349, "receiver_prefill_ms": 0.0, "query_prefill_ms": 57.27508303243667, "ttft_ms": 57.27508303243667, "decode_ms": 1053.888333030045}, "total_wall_ms": 1114.7987919393927, "ttft_ms": 57.27508303243667, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10597531648, "backend_memory": {"mlx_active_bytes": 9404238856, "mlx_peak_bytes": 9492434160, "mlx_cache_bytes": 4187982677, "process_rss_bytes": 10597531648}, "peak_prefill_memory": 9954634328, "peak_decode_memory": 9492434160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40beac670d20d46c364fa0bca1795b51fa87752a1db71225c271b101a9686871", "output_hash": "6aa48949c92421bb34653e37fa300dc5a28c012a14f8cd7e70b3a84195ab400d"} | ||||
| 1314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "db271952cf90a3db2067249e", "attempt_id": "1c40a61b98cb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:25.561938Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1880, "keep": 470, "window_tokens": 44, "compress_ms": 91.60979196894914}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7788, "cache_tensor_bytes": 17326080, "serialized_payload_bytes": 17342157, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1301.1175419669598, "doc_prefill_ms": 324.8576249461621, "compress_ms": 969.2882919916883, "serialize_ms": 6.698042037896812, "load_ms": 1.2206670362502337, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.69349993672222, "ttft_ms": 37.69349993672222, "decode_ms": 846.8278750078753}, "total_wall_ms": 2190.323124988936, "ttft_ms": 37.69349993672222, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 72}, "provider_cached_usage": null, "process_memory": 10582491136, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4429366941, "process_rss_bytes": 10582491136}, "peak_prefill_memory": 9954634328, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['price']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c15d0ebba8e3e09ee1427871d2acaa29b117bd455d860065470ea73e76623f2f", "output_hash": "f4375e101b696df92b758390699293cfc5da37343c19f2add31b28e359529e22"} | ||||
| 1315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5761b8a41a32bb5efc74de1b", "attempt_id": "f804f4778b71", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:27.813720Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 1937, "message_tokens": 1854, "message_utf8_bytes": 7921, "cache_tensor_bytes": null, "serialized_payload_bytes": 7921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007958966307342052, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.5752080352977, "ttft_ms": 12.334249913692474, "decode_ms": 1124.188082991168}, "total_wall_ms": 1815.9317499957979, "ttft_ms": 12.334249913692474, "input_usage": {"receiver_prompt_tokens": 1937}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10452271104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9947441792, "mlx_cache_bytes": 696538104, "process_rss_bytes": 10452271104}, "peak_prefill_memory": null, "peak_decode_memory": 9947441792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "output_hash": "05766d7db3a94e1b43725cdc6d66a30ec3b733cf42088e2849fb433077da087c"} | ||||
| 1316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d0ac2d247fd252288e771284", "attempt_id": "1fe86ff2fcb8", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:31.354899Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 276, "message_tokens": 189, "message_utf8_bytes": 924, "cache_tensor_bytes": null, "serialized_payload_bytes": 924, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1688.3289580000564, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.34450004063547, "ttft_ms": 11.801915941759944, "decode_ms": 871.9067079946399}, "total_wall_ms": 1012.0282500283793, "ttft_ms": 11.801915941759944, "input_usage": {"receiver_prompt_tokens": 276, "sender_input_tokens": 1970, "sender_output_tokens": 189, "sender_prefill_ms": 339.9183329893276, "sender_ttft_ms": 7.358458009548485, "sender_decode_ms": 1338.8306670822203}, "output_usage": {"output_tokens": 75}, "provider_cached_usage": null, "process_memory": 10452287488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9444757692, "mlx_cache_bytes": 1569637444, "process_rss_bytes": 10452287488}, "peak_prefill_memory": null, "peak_decode_memory": 9444757692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n valid_rows = [row for row in rows if not row['returned'] and row['region'] != 'Sud' and row['units'] >= 2]\n return sum(row['units'] * row['unit_price'] * (1 - row['discount_percent'] / 100) for row in valid_rows)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "593cf3988ba680786c52ba1eb2332df793e4cd7bb48bdcfeabd626daa197a254", "output_hash": "93ef82eb0f083c607baff30407ae6aeda718da24164d9c3630c040d83b26b478"} | ||||
| 1317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a46855b7ed31abd34d5f4331", "attempt_id": "a43bdb381bdc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:36.371248Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 442, "message_tokens": 343, "message_utf8_bytes": 1163, "cache_tensor_bytes": null, "serialized_payload_bytes": 1163, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3966.6342500131577, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.25212494283915, "ttft_ms": 11.906750034540892, "decode_ms": 11.83712505735457}, "total_wall_ms": 196.15062500815839, "ttft_ms": 11.906750034540892, "input_usage": {"receiver_prompt_tokens": 442, "sender_input_tokens": 1998, "sender_output_tokens": 512, "sender_prefill_ms": 339.08800000790507, "sender_ttft_ms": 7.484792033210397, "sender_decode_ms": 3617.6020830171183}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452320256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9546717308, "mlx_cache_bytes": 2618197060, "process_rss_bytes": 10452320256}, "peak_prefill_memory": null, "peak_decode_memory": 9546717308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c97659c1b81680999ab2486e9e1c9cbb78f3dc19918b374017e983873400d92", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4382d4ed53296744c36b2b06", "attempt_id": "df4ddf42011e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:36.960468Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7921, "cache_tensor_bytes": 69783552, "serialized_payload_bytes": 69799649, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.2793330270797, "doc_prefill_ms": 323.6480000196025, "compress_ms": 9.7325419774279, "serialize_ms": 16.680333064869046, "load_ms": 1.9615840865299106, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.858916969038546, "ttft_ms": 48.858916969038546, "decode_ms": 3921.0230839671567}, "total_wall_ms": 3973.7517080502585, "ttft_ms": 48.858916969038546, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10592911360, "backend_memory": {"mlx_active_bytes": 9414855688, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4024337829, "process_rss_bytes": 10592911360}, "peak_prefill_memory": 9959025292, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ": rows: how many\n****\n\nwerstueres: [[]]#fie\n(over) eastern\n: rewrite: rows:komabusmac_use_expo) ito=1,wirtegrows:it_can beareafraidly: itte: now: itu:u\nname:now:ituly: itt:now:itule:now:ittoolth\nwith\nuhem.反推\n如何入门计在同型超:1)[小题为我最强的,那几厘米头:1勿表的,编辑部,包括,包括更\n用我大,包括的内容:1。例如:1:别学年:必须有余温: 1省长文:101的快照耀武之大会的它存在于,当且只进击不装得力: 1owe:now:1[2021-1: 2的快门:1:1的频率:1:现在机智:100:1001: 1:这一题好:1,高频:1:1:现在快车:1:1,分之源:深信手:1:0:懂速:0:现在的,华罗经:现在快:现在快车:现在买它好用武胜太急:10:1:0:1:现在快进阶好:现在买:现在价\n手示弱不能及早:现在快:1:1", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1d03c4431fab7c1cb5a7df45d4988da2e46bbc6eea178e08c688a45b2edfcc4c", "output_hash": "28503cb82941d034c9c8772c6a96376a5ab80926c5ce84534ad74eceae4d8e29"} | ||||
| 1319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c19215c6295516c743dfb0b5", "attempt_id": "ddec92124f5a", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:42.207742Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7921, "cache_tensor_bytes": 69783552, "serialized_payload_bytes": 69799750, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1233.661666046828, "doc_prefill_ms": 326.71366597060114, "compress_ms": 889.8259579436854, "serialize_ms": 16.810166998766363, "load_ms": 1.4551670756191015, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.29141598101705, "ttft_ms": 52.29141598101705, "decode_ms": 1045.85404205136}, "total_wall_ms": 1101.4583330834284, "ttft_ms": 52.29141598101705, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10599907328, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4037510565, "process_rss_bytes": 10599907328}, "peak_prefill_memory": 9958877836, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3b6e6e341df802f4b89bdd2c18d78329ef76f76841850d112016e705539bd8dd", "output_hash": "a83c149fb638897f46126aa6751c3bf2ed2b86e5188d4028891a87b3b7cf04de"} | ||||
| 1320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ba29fcb6d638e3a18ab8d73a", "attempt_id": "a4e2ba316d2e", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:43.349235Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1893, "keep": 473, "window_tokens": 44, "compress_ms": 83.45404209103435}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7921, "cache_tensor_bytes": 17436672, "serialized_payload_bytes": 17452749, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1299.1322909947485, "doc_prefill_ms": 326.29504101350904, "compress_ms": 965.86654195562, "serialize_ms": 6.653708056546748, "load_ms": 1.1224159970879555, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.889332928694785, "ttft_ms": 36.889332928694785, "decode_ms": 848.245625034906}, "total_wall_ms": 2188.864417024888, "ttft_ms": 36.889332928694785, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 72}, "provider_cached_usage": null, "process_memory": 10584457216, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4280271189, "process_rss_bytes": 10584457216}, "peak_prefill_memory": 9958877836, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'S':\n continue\n if r['units'] < 10:\n continue\n total += r['units'] * r['price']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "768d22eea9fa8bda99f2a3ae48f94e3b2387b7d37a5622fa43a60c2bd34c440a", "output_hash": "a1d8c3945ca7f5d8bc2b6472b44d47859c63d5e2e3b1924e46e9c48a45bd8fb6"} | ||||
| 1321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7fa5d3b110335ffe9e767881", "attempt_id": "44c535edc8ad", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:45.599573Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 1951, "message_tokens": 1868, "message_utf8_bytes": 7882, "cache_tensor_bytes": null, "serialized_payload_bytes": 7882, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008041970431804657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 678.947708918713, "ttft_ms": 12.20545801334083, "decode_ms": 1235.5020840186626}, "total_wall_ms": 1930.3843749221414, "ttft_ms": 12.20545801334083, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10452385792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9952094904, "mlx_cache_bytes": 788485168, "process_rss_bytes": 10452385792}, "peak_prefill_memory": null, "peak_decode_memory": 9952094904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.05\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "output_hash": "b13b4b4045ba0d88de7f23f06b605620bd2c48343a5735c70dda2c94c879a0e0"} | ||||
| 1322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "40a11fed851a0e01acf31ee2", "attempt_id": "f920ae7b7101", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:49.127709Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 258, "message_tokens": 171, "message_utf8_bytes": 761, "cache_tensor_bytes": null, "serialized_payload_bytes": 761, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1560.3498329874128, "decode_payload_ms": 0.0, "receiver_prefill_ms": 126.078833010979, "ttft_ms": 11.819540988653898, "decode_ms": 1035.5305830016732}, "total_wall_ms": 1174.3519579758868, "ttft_ms": 11.819540988653898, "input_usage": {"receiver_prompt_tokens": 258, "sender_input_tokens": 1984, "sender_output_tokens": 171, "sender_prefill_ms": 339.40966706722975, "sender_ttft_ms": 7.469167001545429, "sender_decode_ms": 1211.2804170465097}, "output_usage": {"output_tokens": 89}, "provider_cached_usage": null, "process_memory": 10452418560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9434566772, "mlx_cache_bytes": 1684030516, "process_rss_bytes": 10452418560}, "peak_prefill_memory": null, "peak_decode_memory": 9434566772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Ouest' and row['units'] >= 2 and row['returned'] == 0:\n total_revenue += (row['unit_price'] * (1 - row['discount_pct'] / 100)) * (1 + 0.05)\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "50a08a7bcd83da3f96c6481389ded8d45a4e0977ad80e670f46cb8597e1c3502", "output_hash": "1ecac9b400464332801993cf31ad9447b88dfdc5a7471ef76a34ae3d0b44570a"} | ||||
| 1323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bd081f8a5bb8e57e01f2e4b0", "attempt_id": "2a27d0386955", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:54.319064Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 956, "cache_tensor_bytes": null, "serialized_payload_bytes": 956, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.7682499736547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.48000003769994, "ttft_ms": 11.902209022082388, "decode_ms": 11.803042027167976}, "total_wall_ms": 216.2467499729246, "ttft_ms": 11.902209022082388, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2012, "sender_output_tokens": 512, "sender_prefill_ms": 343.34108303301036, "sender_ttft_ms": 7.370374980382621, "sender_decode_ms": 3625.6526249926537}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452451328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2751972404, "process_rss_bytes": 10452451328}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fe831df3381733a51d392dc3e3ad331226d2c5106f91d2364ece51b23d0499bc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7753875e604047f9055c4448", "attempt_id": "2a03b7f4023b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:43:54.928281Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 70299648, "serialized_payload_bytes": 70315745, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.48691702913493, "doc_prefill_ms": 323.6482919892296, "compress_ms": 9.900499950163066, "serialize_ms": 16.949167009443045, "load_ms": 1.9808749202638865, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.30412503704429, "ttft_ms": 47.30412503704429, "decode_ms": 3942.8222079295665}, "total_wall_ms": 3994.0797080053017, "ttft_ms": 47.30412503704429, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593533952, "backend_memory": {"mlx_active_bytes": 9414953992, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4193731989, "process_rss_bytes": 10593533952}, "peak_prefill_memory": 9963842244, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#### @now. oh -1, gefailot, please\n--\n#1ag\n- -espresso.\nwith, part-df:\n:put_with: it can not always\nhas\n- If the, that was the case does not for real\n***/\n\n (hates)@now:now: please\n-geek-exchange-echo\n- 20, if there israel, please\nthat we believe it can never: one-repeat-with-como, columns. it=\"it stands in: the number. 1, part with auge\nnow. of itc(tr-1ab\n-1, if necessary: itc\n1, please spellstcgh_exclusive\ngetsize(=now:now: it's\nfor it. fast.com 2019-1, no. oh, no. 1, please\nplease_use_this_weekly, if it is always on\nof statemaniceresultsicher\nthe-1, never:etn 1, but i/o:up-is-big\n- 201, part_et, if it-can-use-1\n-ary, but not-1\n\n2015-feh, volume.1, ifitsize\n-1, please\n/express-1, feh, and\nwhen\njust\n-1, please\n-1\n-1, and-enough, but not-for-all its\npretty\n-1\n-1\n\n## all thes\n-er-", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "712f86bde118ba124e351b0a5806c4dd291819a1f3897046d7e8616b634d01a3", "output_hash": "0e4ae733bf3f2963ec1919039fb9dd439deb2da3c5c02ab78b9ee39a9f20066a"} | ||||
| 1325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bea7c19a035a19ddd32024e0", "attempt_id": "ae79af937a67", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:00.199821Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 70299648, "serialized_payload_bytes": 70315846, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1237.0470419991761, "doc_prefill_ms": 327.0119579974562, "compress_ms": 893.9256670419127, "serialize_ms": 15.806625015102327, "load_ms": 1.5164159703999758, "receiver_prefill_ms": 0.0, "query_prefill_ms": 61.69162492733449, "ttft_ms": 61.69162492733449, "decode_ms": 983.7609169771895}, "total_wall_ms": 1048.8474169978872, "ttft_ms": 61.69162492733449, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10600448000, "backend_memory": {"mlx_active_bytes": 9405844488, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4206773653, "process_rss_bytes": 10600448000}, "peak_prefill_memory": 9963694788, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcbd805e5d8663228bda0bbeaed61938bd1c4ee6007f49ece449a26726a9e68", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 1326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b991f681c858248cd2b6e1f0", "attempt_id": "c3ec740465ca", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:01.289360Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1907, "keep": 477, "window_tokens": 44, "compress_ms": 94.99562496785074}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 17584128, "serialized_payload_bytes": 17600207, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1318.6108330264688, "doc_prefill_ms": 326.75395905971527, "compress_ms": 984.7847500350326, "serialize_ms": 6.782792042940855, "load_ms": 1.1297089513391256, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.24033304024488, "ttft_ms": 37.24033304024488, "decode_ms": 1012.989416019991}, "total_wall_ms": 2373.56225005351, "ttft_ms": 37.24033304024488, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 10584637440, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4444127669, "process_rss_bytes": 10584637440}, "peak_prefill_memory": 9963694788, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest': # Assuming 'returned' and 'region' keys are present\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['price']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a25e1be4237205ffff60dd9ca3ecccb9c4ec76b267810e425025281743afe375", "output_hash": "719bd80eec3ea03b15731fcf160215a2e0e5f19bf61f828c4e6371011919230f"} | ||||
| 1327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c4c54e8907e922433a010a9a", "attempt_id": "8fabf5e7528a", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:03.724786Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 1924, "message_tokens": 1841, "message_utf8_bytes": 7727, "cache_tensor_bytes": null, "serialized_payload_bytes": 7727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008167000487446785, "decode_payload_ms": 0.0, "receiver_prefill_ms": 672.9122080141678, "ttft_ms": 12.239458039402962, "decode_ms": 1274.53404199332}, "total_wall_ms": 1963.2757090730593, "ttft_ms": 12.239458039402962, "input_usage": {"receiver_prompt_tokens": 1924}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 10452533248, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9943657036, "mlx_cache_bytes": 692753348, "process_rss_bytes": 10452533248}, "peak_prefill_memory": null, "peak_decode_memory": 9943657036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 4:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "output_hash": "3d0774adb81ac5d1d4bc5485083438c88d72acdb1d52bec93d59855644bbf074"} | ||||
| 1328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "44f455d26b2e2fef2e69aa87", "attempt_id": "810ba9da2799", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:07.531389Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 292, "message_tokens": 205, "message_utf8_bytes": 1021, "cache_tensor_bytes": null, "serialized_payload_bytes": 1021, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1805.2535000024363, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.38849991001189, "ttft_ms": 11.968957958742976, "decode_ms": 855.4510419489816}, "total_wall_ms": 995.8558330545202, "ttft_ms": 11.968957958742976, "input_usage": {"receiver_prompt_tokens": 292, "sender_input_tokens": 1957, "sender_output_tokens": 205, "sender_prefill_ms": 339.60191695950925, "sender_ttft_ms": 7.292041904293001, "sender_decode_ms": 1456.0603339923546}, "output_usage": {"output_tokens": 73}, "provider_cached_usage": null, "process_memory": 10452549632, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9454080264, "mlx_cache_bytes": 1668334672, "process_rss_bytes": 10452549632}, "peak_prefill_memory": null, "peak_decode_memory": 9454080264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n for row in rows:\n if row['returned'] or row['region'] == 'excluded_region' or row['units'] < 4:\n rows.remove(row)\n return sum(row['units'] * row['unit_price'] * (1 - row['discount']) for row in rows)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "506573883371fb689aedde70ff3fe9e375db8d236f332466b5a37e1a166d3acc", "output_hash": "19e09d2ebbbfb6f47f4dbfcbdcfe7244e1ba23b89fabc8ca0ffc8555d40f8183"} | ||||
| 1329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d5b6d5b984d84c55aa9ba2c9", "attempt_id": "98593a3cf573", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:12.566578Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 445, "message_tokens": 347, "message_utf8_bytes": 940, "cache_tensor_bytes": null, "serialized_payload_bytes": 940, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4000.1090420410037, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.05783300939947, "ttft_ms": 11.823542066849768, "decode_ms": 11.82908401824534}, "total_wall_ms": 195.74579200707376, "ttft_ms": 11.823542066849768, "input_usage": {"receiver_prompt_tokens": 445, "sender_input_tokens": 1985, "sender_output_tokens": 512, "sender_prefill_ms": 354.33587490115315, "sender_ttft_ms": 7.351000094786286, "sender_decode_ms": 3635.9423749381676}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9547700348, "mlx_cache_bytes": 2710799440, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9547700348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b131a99dcf04b056fa196f9fa21b24ead0a37fec60b8024702a6c8d2992afd24", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "884344ecaa4bc9df0108a779", "attempt_id": "b24b32505891", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:13.152520Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7727, "cache_tensor_bytes": 69304320, "serialized_payload_bytes": 69320417, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.8741250736639, "doc_prefill_ms": 321.77870790474117, "compress_ms": 9.87962493672967, "serialize_ms": 16.189999994821846, "load_ms": 2.2311669308692217, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.23183303233236, "ttft_ms": 48.23183303233236, "decode_ms": 3937.205750029534}, "total_wall_ms": 3989.5545420004055, "ttft_ms": 48.23183303233236, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10591518720, "backend_memory": {"mlx_active_bytes": 9413282824, "mlx_peak_bytes": 9492172016, "mlx_cache_bytes": 4243588529, "process_rss_bytes": 10591518720}, "peak_prefill_memory": 9954634328, "peak_decode_memory": 9492172016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "worry?!\n(woi, no reflex. all the in, exercise of 20-by:usecentral so it\noder\nonly this is that 2001-on-your-please make it\n20\nit don't move itcertain\npoint me i am i is the case\nwhat's that's area\na mid-term homenoughiz\ni., 201\nzugleichzeit\nzum\ncibi\nhomer\n2015001on\n20000\nwww\nschofim\nTo\n=1\n=1\n答案\n=1\n=\n=1\n小题不落iche\n200\n##\n=1hft\n=1\n=15\n## 2015\n=15\n201含量外感最江之神头绪变军,虽上将它读音外的第一步兵心在所向\n=1的用旧事不列优,方程无穷大多为不及物语,秀宝转\n2010个独立大而优,省立得的是它不移\n=1,连\n=1\n它可读外\n=\n201\n=1\n=1\n=1500字方程\n201班\n=\n201\n=1\n=1\n=15\n=\n2011,出清末,\n201\n=1\n答案:\n=1\n20", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2edcdbf453ee92e40f9c0f91dd2f36dd634a5399dd63f4b6ae39fb2ff7630813", "output_hash": "18eee2ec4358684c3d312cfa29b88cf767babac0e05a0df3e4de3b26f99ecebb"} | ||||
| 1331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dd4063b69ecae1e45a5f8f8e", "attempt_id": "afea254b61ca", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:18.407720Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7727, "cache_tensor_bytes": 69304320, "serialized_payload_bytes": 69320518, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.9349169433117, "doc_prefill_ms": 325.2033340977505, "compress_ms": 883.1381249474362, "serialize_ms": 16.309874947182834, "load_ms": 1.4724580105394125, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.573249955661595, "ttft_ms": 53.573249955661595, "decode_ms": 984.1490840772167}, "total_wall_ms": 1041.11779097002, "ttft_ms": 53.573249955661595, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10597580800, "backend_memory": {"mlx_active_bytes": 9404337160, "mlx_peak_bytes": 9491877104, "mlx_cache_bytes": 4256400817, "process_rss_bytes": 10597580800}, "peak_prefill_memory": 9954634328, "peak_decode_memory": 9491877104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "40beac670d20d46c364fa0bca1795b51fa87752a1db71225c271b101a9686871", "output_hash": "8fc2fb9765238f62f6d0120cc019bf477260252d95f246c2530e38ab3bb6d5bb"} | ||||
| 1332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fe30f770ecb40cfa92a53ee9", "attempt_id": "f95587ee72a2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:19.490339Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1880, "keep": 470, "window_tokens": 44, "compress_ms": 83.28883396461606}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7727, "cache_tensor_bytes": 17326080, "serialized_payload_bytes": 17342157, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1301.321749924682, "doc_prefill_ms": 325.0655420124531, "compress_ms": 969.0595419378951, "serialize_ms": 6.90450007095933, "load_ms": 1.2468330096453428, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.80508297495544, "ttft_ms": 37.80508297495544, "decode_ms": 849.2058330448344}, "total_wall_ms": 2192.9596250411123, "ttft_ms": 37.80508297495544, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 72}, "provider_cached_usage": null, "process_memory": 10582507520, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4497883385, "process_rss_bytes": 10582507520}, "peak_prefill_memory": 9954634328, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest':\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['price']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c15d0ebba8e3e09ee1427871d2acaa29b117bd455d860065470ea73e76623f2f", "output_hash": "cb30bae9bcb16b4ff07466f315a6f422171910c3e0b078230f2e7375bbdf36ea"} | ||||
| 1333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d83c2c338a13ec6cb8fa8802", "attempt_id": "5a15d9b4e229", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:21.744642Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 1926, "message_tokens": 1843, "message_utf8_bytes": 7856, "cache_tensor_bytes": null, "serialized_payload_bytes": 7856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008041039109230042, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.0173750333488, "ttft_ms": 12.45687494520098, "decode_ms": 1224.9035829445347}, "total_wall_ms": 1916.150250006467, "ttft_ms": 12.45687494520098, "input_usage": {"receiver_prompt_tokens": 1926}, "output_usage": {"output_tokens": 102}, "provider_cached_usage": null, "process_memory": 10452271104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9944394324, "mlx_cache_bytes": 693490636, "process_rss_bytes": 10452271104}, "peak_prefill_memory": null, "peak_decode_memory": 9944394324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Centre':\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.05\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "output_hash": "2202adfeac782b18428212d68f8c269a872b8d65317c39a9086fa331c604eebf"} | ||||
| 1334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0df2bbcefc71d056215dfdfe", "attempt_id": "8964f8953622", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:25.299556Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 263, "message_tokens": 176, "message_utf8_bytes": 881, "cache_tensor_bytes": null, "serialized_payload_bytes": 881, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1601.4019580325112, "decode_payload_ms": 0.0, "receiver_prefill_ms": 126.46375002805144, "ttft_ms": 11.894042021594942, "decode_ms": 875.8878749795258}, "total_wall_ms": 1015.202125068754, "ttft_ms": 11.894042021594942, "input_usage": {"receiver_prompt_tokens": 263, "sender_input_tokens": 1959, "sender_output_tokens": 176, "sender_prefill_ms": 338.7787080137059, "sender_ttft_ms": 7.548999972641468, "sender_decode_ms": 1252.8139998903498}, "output_usage": {"output_tokens": 75}, "provider_cached_usage": null, "process_memory": 10452287488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9437253768, "mlx_cache_bytes": 1652081636, "process_rss_bytes": 10452287488}, "peak_prefill_memory": null, "peak_decode_memory": 9437253768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if not row['returned'] and row['region'] != 'Centre' and len(row['units']) >= 6:\n total_revenue += row['price'] * row['units']\n return total_revenue * (1 + 0.08)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "TypeError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "48bb507e020814e8778f353e8bd90790bdb762b4feef826c5d29e1059e60304e", "output_hash": "16e903e78ca603d501373334090d3a9eb226345462b3525d749c4244e813e40d"} | ||||
| 1335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ceecb32fc2b87c9bdd76c3ef", "attempt_id": "57e025dd720b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:30.333605Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 11, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 439, "message_tokens": 340, "message_utf8_bytes": 906, "cache_tensor_bytes": null, "serialized_payload_bytes": 906, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3980.218957993202, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.43133305944502, "ttft_ms": 12.05091702286154, "decode_ms": 11.815917096100748}, "total_wall_ms": 196.40841602813452, "ttft_ms": 12.05091702286154, "input_usage": {"receiver_prompt_tokens": 439, "sender_input_tokens": 1987, "sender_output_tokens": 512, "sender_prefill_ms": 340.2228329796344, "sender_ttft_ms": 7.414125022478402, "sender_decode_ms": 3630.2054999396205}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452320256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9544538236, "mlx_cache_bytes": 2694628324, "process_rss_bytes": 10452320256}, "peak_prefill_memory": null, "peak_decode_memory": 9544538236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 11, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "698966af839091b8470564e799a046f551781be7176092415a3344b6b0dfd017", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6256ed1444334cfe837e3470", "attempt_id": "ec24aa5c60c6", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:30.920872Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7856, "cache_tensor_bytes": 69378048, "serialized_payload_bytes": 69394145, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.5440409537405, "doc_prefill_ms": 321.46399992052466, "compress_ms": 9.925249963998795, "serialize_ms": 15.93287498690188, "load_ms": 2.1526250056922436, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.39641698729247, "ttft_ms": 49.39641698729247, "decode_ms": 3920.4177079955116}, "total_wall_ms": 3973.9977919962257, "ttft_ms": 49.39641698729247, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10591322112, "backend_memory": {"mlx_active_bytes": 9413315592, "mlx_peak_bytes": 9492172016, "mlx_cache_bytes": 4010919237, "process_rss_bytes": 10591322112}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9492172016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "#### 10, please use sum! (all EX: ito\nEs 离别而定彨,中定彨替考,fen的朋友,特别是它外,\"pytroterzai:evernever\n\n### 0. ！utyb2最强的小白, no.且,特别是那个ffset[2019, you ever:是这个就是它用武beats,下学全军校对它用法,那不疑p0的它只是风度,而且,而且,而且,这个世界上,而且,这个世界上, no. 1,这个世界上,用过它匀, 1m-1,mybatis\n=1,请是吧定, 1,用光,用它用小,全科目的用法线性bbs的用法,而且,而且,而且,而且,而且,而且,那个群聚光,而且,而且,而且,你挨,用小出师有功,这个世界上,而且,这个看过来,下不来也罢,而且,这个就是最好的是这样,而且,这个看小,而且,这个世界上,我用法,这个看,这个世界上最响好,而且,这个是1,用老,请更详细,这个世界上最能顶上,中国,你懂华光,这个群起用小,而且,这个群,用法,这个群的,这个群,这个群,群的口号,群起,这个群起,群起,和", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fe9bfa4493868164b493246bbd481de98a92e499d61ea0c5c7cf441d13a4abf3", "output_hash": "1f6ea84f9356ebdb52edcf29ff6be86481de863545d3615d80328dc6ae338007"} | ||||
| 1337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da4f9941ce15bde256d817ce", "attempt_id": "03fedea77b75", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:36.163515Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7856, "cache_tensor_bytes": 69378048, "serialized_payload_bytes": 69394246, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1227.5837080087513, "doc_prefill_ms": 324.22354200389236, "compress_ms": 887.0467910310254, "serialize_ms": 16.02016598917544, "load_ms": 1.4211670495569706, "receiver_prefill_ms": 0.0, "query_prefill_ms": 60.58491603471339, "ttft_ms": 60.58491603471339, "decode_ms": 1046.078833984211}, "total_wall_ms": 1110.1547500584275, "ttft_ms": 60.58491603471339, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10597613568, "backend_memory": {"mlx_active_bytes": 9404156936, "mlx_peak_bytes": 9491877104, "mlx_cache_bytes": 4023944517, "process_rss_bytes": 10597613568}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9491877104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "51410d18dce697caa26be3efc3f7accfb2868b52a0eac12300931116f8ad1a8a", "output_hash": "e2d4a17616539e25de72316e29c088120e8aaf81b787b8cac62c4726dd53d451"} | ||||
| 1338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8cd1af4be8ee491b959eb457", "attempt_id": "ce7140ffe60d", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:37.313738Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1882, "keep": 470, "window_tokens": 44, "compress_ms": 83.86958297342062}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7856, "cache_tensor_bytes": 17326080, "serialized_payload_bytes": 17342157, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1303.3204580424353, "doc_prefill_ms": 324.8566660331562, "compress_ms": 971.219833008945, "serialize_ms": 6.950875045731664, "load_ms": 0.5404159892350435, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.73579199332744, "ttft_ms": 37.73579199332744, "decode_ms": 832.6415000483394}, "total_wall_ms": 2177.744749933481, "ttft_ms": 37.73579199332744, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10582491136, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4265246877, "process_rss_bytes": 10582491136}, "peak_prefill_memory": 9955027552, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Centre':\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['price']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c15d0ebba8e3e09ee1427871d2acaa29b117bd455d860065470ea73e76623f2f", "output_hash": "fe0ee9d006b1b5b35bb681f8108d06cd525a517cb272a773910a7226c039a72b"} | ||||
| 1339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bc2fc91815ac22646c4f1b63", "attempt_id": "e5c0b25179b5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:39.554662Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 1955, "message_tokens": 1872, "message_utf8_bytes": 7854, "cache_tensor_bytes": null, "serialized_payload_bytes": 7854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00858306884765625, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.5793749364093, "ttft_ms": 12.27345794904977, "decode_ms": 1411.4012500504032}, "total_wall_ms": 2103.9588750572875, "ttft_ms": 12.27345794904977, "input_usage": {"receiver_prompt_tokens": 1955}, "output_usage": {"output_tokens": 118}, "provider_cached_usage": null, "process_memory": 10452271104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9953553096, "mlx_cache_bytes": 789943360, "process_rss_bytes": 10452271104}, "peak_prefill_memory": null, "peak_decode_memory": 9953553096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n tax_rate = 0.14975\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 2:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue * (1 + tax_rate)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "output_hash": "e802191aba22597d478b37a1cbd6de8ad7fefa6737cc401a56f1933ba3dda1aa"} | ||||
| 1340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "28e40b21c06cb86156866e8f", "attempt_id": "34e4c4f16d2a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:43.768878Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 330, "message_tokens": 243, "message_utf8_bytes": 1101, "cache_tensor_bytes": null, "serialized_payload_bytes": 1101, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2071.9891249900684, "decode_payload_ms": 0.0, "receiver_prefill_ms": 145.28345898725092, "ttft_ms": 12.128917034715414, "decode_ms": 1231.147792073898}, "total_wall_ms": 1389.698832994327, "ttft_ms": 12.128917034715414, "input_usage": {"receiver_prompt_tokens": 330, "sender_input_tokens": 1988, "sender_output_tokens": 243, "sender_prefill_ms": 343.27079204376787, "sender_ttft_ms": 7.395709049887955, "sender_decode_ms": 1719.064874923788}, "output_usage": {"output_tokens": 105}, "provider_cached_usage": null, "process_memory": 10452287488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9478853024, "mlx_cache_bytes": 1717421412, "process_rss_bytes": 10452287488}, "peak_prefill_memory": null, "peak_decode_memory": 9478853024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n filtered_rows = [row for row in rows if row['region'] != 'Ouest' and row['units'] >= 2]\n line_revenues = [row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100) for row in filtered_rows]\n total_revenue = sum(line_revenues) * (1 + 0.14975)\n return round(total_revenue, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.6, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "38c51ef63ac42a39e077cc3366a3c32ce818245991ca1a478635a31ad935961a", "output_hash": "aff5ccaf0859bcfd127f8bc8ea8cd28a45dba1aa62236a92d5b296e1af91fde6"} | ||||
| 1341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9f539ce29ef78f08b8a58cea", "attempt_id": "eb357fe7e42b", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:49.173673Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 474, "message_tokens": 375, "message_utf8_bytes": 952, "cache_tensor_bytes": null, "serialized_payload_bytes": 952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3976.8146669957787, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.6847920510918, "ttft_ms": 11.972542037256062, "decode_ms": 11.763625079765916}, "total_wall_ms": 216.43737505655736, "ttft_ms": 11.972542037256062, "input_usage": {"receiver_prompt_tokens": 474, "sender_input_tokens": 2016, "sender_output_tokens": 512, "sender_prefill_ms": 343.822208000347, "sender_ttft_ms": 7.3517500422894955, "sender_decode_ms": 3623.1324169784784}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452320256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566427260, "mlx_cache_bytes": 2790131044, "process_rss_bytes": 10452320256}, "peak_prefill_memory": null, "peak_decode_memory": 9566427260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9aa9981d167db93bf57e626825db7665df0164244130499836f39a84563247e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fd1a04fab065027e4246d694", "attempt_id": "0f324bbf049d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:49.781736Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 44, "message_tokens": 1911, "message_utf8_bytes": 7854, "cache_tensor_bytes": 70447104, "serialized_payload_bytes": 70463201, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.8153750123456, "doc_prefill_ms": 323.50891700480133, "compress_ms": 9.933416964486241, "serialize_ms": 16.389832948334515, "load_ms": 2.197250025346875, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.89987495355308, "ttft_ms": 49.89987495355308, "decode_ms": 3920.6408748868853}, "total_wall_ms": 3974.758916068822, "ttft_ms": 49.89987495355308, "input_usage": {"receiver_prefix_tokens": 1911, "dense_cache_bytes": 54792192, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593566720, "backend_memory": {"mlx_active_bytes": 9415019528, "mlx_peak_bytes": 9494482160, "mlx_cache_bytes": 4257056453, "process_rss_bytes": 10593566720}, "peak_prefill_memory": 9965300436, "peak_decode_memory": 9494482160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "und für high frequency first. no high no.1 poeek feh\n假1001 fehurry. no. mayhem. mayday\n- chewers\n- what is the\n- 10. leitom. no.1\n-1po\n- 1, poe:1(吃 13, high grade.15)\n- -o\n- gottschwein it_hot\n- german. -101po\n-1.-1er-1hight. -no. feingrul-101\n- -15\n- tischief\n-logical\n- - **os\n- 15\n- -einsperu\n-germanyos\n-1\n-german\n- -1\n- please dont\n- pergericht\n- 102\n- puto\n--per\n- 100\n\n- Exesis\n-geralt\n-ger-1\n-merkeg\n- only\n- 1,\n\n**高\n- :hochtr1\n-- 1hfeed\n-\nuerbach\n- only a lot\n-german\n*******\n- -comoinpllm-100\n- -1, pleasegov\n- - -p-1\n- - -com\n- -1\n- - only the rest\n**uran\n- important information\n- including it\n- college\n- -uix\n- -100\n**战", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "30c885b68d22b14e048bb5f35e2bf7c96b8e231c6d9c4ce7cf691829efe0b130", "output_hash": "c16745cdf8475b79079b76d5967e95a8b7faa78ee6f7b7e88ee0e87d9e564b63"} | ||||
| 1343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "23a484fa41fc0ede5fca8982", "attempt_id": "608ae2a3586b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:55.024842Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 44, "message_tokens": 1911, "message_utf8_bytes": 7854, "cache_tensor_bytes": 70447104, "serialized_payload_bytes": 70463302, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1228.2190839760005, "doc_prefill_ms": 325.8626669412479, "compress_ms": 886.0489999642596, "serialize_ms": 16.020667040720582, "load_ms": 1.5682920347899199, "receiver_prefill_ms": 0.0, "query_prefill_ms": 56.962457951158285, "ttft_ms": 56.962457951158285, "decode_ms": 980.2667089970782}, "total_wall_ms": 1040.6395830214024, "ttft_ms": 56.962457951158285, "input_usage": {"receiver_prefix_tokens": 1911, "dense_cache_bytes": 54792192, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10596663296, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9494465776, "mlx_cache_bytes": 4270425797, "process_rss_bytes": 10596663296}, "peak_prefill_memory": 9965300436, "peak_decode_memory": 9494465776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1fd6bf55cc4b005a94337e8c94d4fcfb4296eae6539fe2d61594b3abe6f83bea", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 1344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "44d5c0a44897ffd89ce53cba", "attempt_id": "12e19bd87e1a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:56.105495Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1911, "keep": 478, "window_tokens": 44, "compress_ms": 91.71054197940975}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 44, "message_tokens": 1911, "message_utf8_bytes": 7854, "cache_tensor_bytes": 17620992, "serialized_payload_bytes": 17637071, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1328.2168329460546, "doc_prefill_ms": 328.50558299105614, "compress_ms": 992.4898750614375, "serialize_ms": 6.918041966855526, "load_ms": 1.145874965004623, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.24312491249293, "ttft_ms": 37.24312491249293, "decode_ms": 904.7510840464383}, "total_wall_ms": 2274.8166249366477, "ttft_ms": 37.24312491249293, "input_usage": {"receiver_prefix_tokens": 1911, "dense_cache_bytes": 54792192, "query_tokens": 44}, "output_usage": {"output_tokens": 77}, "provider_cached_usage": null, "process_memory": 10580738048, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4507534085, "process_rss_bytes": 10580738048}, "peak_prefill_memory": 9965300436, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['returned']:\n continue\n if r['units'] < 10:\n continue\n total += r['units'] * r['price']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "034bd53aaa42eb7b59c17d48ff347d98dc4d890d480c39150c304d03fb456837", "output_hash": "8b3cb424a1637e3a4e18afe3d9d85314cdb2da8817a6a470f4f8ac2c0af21bb1"} | ||||
| 1345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4ba7d843953c4d3628db6255", "attempt_id": "cbe19197c359", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:44:58.441605Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 1935, "message_tokens": 1852, "message_utf8_bytes": 7865, "cache_tensor_bytes": null, "serialized_payload_bytes": 7865, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007792026735842228, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.083916099742, "ttft_ms": 12.391624972224236, "decode_ms": 1125.1652078935876}, "total_wall_ms": 1817.291415994987, "ttft_ms": 12.391624972224236, "input_usage": {"receiver_prompt_tokens": 1935}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10452566016, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9947048568, "mlx_cache_bytes": 696144880, "process_rss_bytes": 10452566016}, "peak_prefill_memory": null, "peak_decode_memory": 9947048568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 6:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "output_hash": "c59d226f2c6c650ba7dafa1df3b852e4e3b0ed077f2a9d3c37ec55e09e2f18ad"} | ||||
| 1346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9d769774e44f827f0a6aaf7b", "attempt_id": "6bd861d4c9dd", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:02.359283Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 329, "message_tokens": 242, "message_utf8_bytes": 1063, "cache_tensor_bytes": null, "serialized_payload_bytes": 1063, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2063.1037089042366, "decode_payload_ms": 0.0, "receiver_prefill_ms": 145.96620807424188, "ttft_ms": 11.832333984784782, "decode_ms": 1099.4514169869944}, "total_wall_ms": 1258.2935420796275, "ttft_ms": 11.832333984784782, "input_usage": {"receiver_prompt_tokens": 329, "sender_input_tokens": 1968, "sender_output_tokens": 242, "sender_prefill_ms": 339.5433749537915, "sender_ttft_ms": 7.508584065362811, "sender_decode_ms": 1713.8497499981895}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10452598784, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9477165468, "mlx_cache_bytes": 1699382544, "process_rss_bytes": 10452598784}, "peak_prefill_memory": null, "peak_decode_memory": 9477165468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n valid_rows = [row for row in rows if row['region'] != 'Ouest' and row['units'] >= 6 and row['returned'] == 0]\n total_revenue = sum(row['unit_price'] * (1 - row['discount_pct'] / 100) * row['units'] for row in valid_rows)\n return total_revenue * (1 - 0.0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f146e9e16467bc3b9fc0c3f2d42cfea9ba90004f1e3797856a5dfb7a4f957e2c", "output_hash": "0ecc6a6722f0c2f268a8f1751d2d20c7347e971fdbb5d42bc23ec73d11612ad1"} | ||||
| 1347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "57e6c8e0913e794b80435b4d", "attempt_id": "20053ff62742", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:07.643116Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 11, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 454, "message_tokens": 355, "message_utf8_bytes": 917, "cache_tensor_bytes": null, "serialized_payload_bytes": 917, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.3671249952167, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.10687507782131, "ttft_ms": 11.891541071236134, "decode_ms": 11.755667044781148}, "total_wall_ms": 215.78170801512897, "ttft_ms": 11.891541071236134, "input_usage": {"receiver_prompt_tokens": 454, "sender_input_tokens": 1996, "sender_output_tokens": 512, "sender_prefill_ms": 343.59104197937995, "sender_ttft_ms": 7.364374934695661, "sender_decode_ms": 3633.9951660484076}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452631552, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9554335868, "mlx_cache_bytes": 2755396880, "process_rss_bytes": 10452631552}, "peak_prefill_memory": null, "peak_decode_memory": 9554335868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 11, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6eb00e4506e1aa6e8375f4b9e88cfb421105a1133392c6fbac3e641c037fdec7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a59948ec1be4fb56a07518ba", "attempt_id": "e69c522062b8", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:08.250752Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 44, "message_tokens": 1891, "message_utf8_bytes": 7865, "cache_tensor_bytes": 69709824, "serialized_payload_bytes": 69725921, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.7396249594167, "doc_prefill_ms": 323.6085829557851, "compress_ms": 9.525958099402487, "serialize_ms": 16.40774996485561, "load_ms": 1.9283749861642718, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.35395806003362, "ttft_ms": 48.35395806003362, "decode_ms": 3933.8374169310555}, "total_wall_ms": 3986.024208017625, "ttft_ms": 48.35395806003362, "input_usage": {"receiver_prefix_tokens": 1891, "dense_cache_bytes": 54218752, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593140736, "backend_memory": {"mlx_active_bytes": 9414659080, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4282713713, "process_rss_bytes": 10593140736}, "peak_prefill_memory": 9958632068, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "atime.Obg, no 'i':150字怎么办: me no code please read in.com 1, please no. no, please use this term: easy:1mike.at worlows: 1? no.2015uso: easy= on the case:itisch swisshead 1: it feelsure: no panic at home: easy=on: 1=on: easy: 1=on: easy? no pain on 1;no doubt that isleit=on=on: easy:1=on:nov: easy: it feels:1=on:n 1:=\"on: easy=on:nov: easy:novo=on: 1term=on:netherlands:nogo=largehomewh=on:=\"1\":, please use only when:=\"on:=\"on:=\"195:=\"1\", please add one hot=on:nov:=\"1\", columns: \"它一岁逢, no1, no.4=on: easy: easy:=\"1\":1, columns:=\"1\": 5年(2019 如离差:='=2 human: 2018:n1, no.容易:=\"1,集齐心无异型:=\"a=on:=\"1\", 1):=1, 1hitwiz=101,=\"1\", columns:='on\"device\":=\"='\":python\": 这是老师,用这个tnt", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5eebc00266b45b0c2c5ef658889a0e2dcbdd7d8eb5b777b8fbb131f6276b8625", "output_hash": "ee5d536448cb24f62d083ada82d716ea97b05608a787c3bcc0883dcc88b375fc"} | ||||
| 1349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d9f2801b53685eac1feca042", "attempt_id": "b8d1c622944c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:13.493859Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 44, "message_tokens": 1891, "message_utf8_bytes": 7865, "cache_tensor_bytes": 69709824, "serialized_payload_bytes": 69726022, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1216.8806669069454, "doc_prefill_ms": 325.7994999876246, "compress_ms": 874.7333328938112, "serialize_ms": 16.05616696178913, "load_ms": 1.4689170056954026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.76895803399384, "ttft_ms": 52.76895803399384, "decode_ms": 1048.9819590002298}, "total_wall_ms": 1105.2016250323504, "ttft_ms": 52.76895803399384, "input_usage": {"receiver_prefix_tokens": 1891, "dense_cache_bytes": 54218752, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10599841792, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4295689841, "process_rss_bytes": 10599841792}, "peak_prefill_memory": 9958484612, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "172a4a4cfe88b19d4fb97ed80ce359677bfd3c8cf6575111efa4c7833432bd8b", "output_hash": "688f644f4b08b4cde890370b984e8e9b2a807c8c91c04b1dcf5d57c4eb6fd81c"} | ||||
| 1350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1b0b957ad7bd49560120bbdb", "attempt_id": "c11f936fbb34", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:14.640100Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1891, "keep": 473, "window_tokens": 44, "compress_ms": 82.4944170890376}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 44, "message_tokens": 1891, "message_utf8_bytes": 7865, "cache_tensor_bytes": 17436672, "serialized_payload_bytes": 17452748, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1308.250791975297, "doc_prefill_ms": 326.2895829975605, "compress_ms": 974.7730829985812, "serialize_ms": 6.891333963721991, "load_ms": 1.144499983638525, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.3036660021171, "ttft_ms": 37.3036660021171, "decode_ms": 895.5454580718651}, "total_wall_ms": 2245.725458022207, "ttft_ms": 37.3036660021171, "input_usage": {"receiver_prefix_tokens": 1891, "dense_cache_bytes": 54218752, "query_tokens": 44}, "output_usage": {"output_tokens": 76}, "provider_cached_usage": null, "process_memory": 10584506368, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4532748817, "process_rss_bytes": 10584506368}, "peak_prefill_memory": 9958484612, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest' and r['returned'] == True:\n continue\n if r['units'] < 10:\n continue\n total += r['units'] * r['price']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "904a9fcd3192d24131765ceb411be0c7fe47cd06cf77bfb066feee05b29e6deb", "output_hash": "16e8356a30ced9b5a4f4fb9c6a0b00c0ae604c9ecbcc008b14ebdc1586289038"} | ||||
| 1351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6546742a27dc4a908e4b54bc", "attempt_id": "c48ffd676732", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:16.949105Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 1947, "message_tokens": 1864, "message_utf8_bytes": 7811, "cache_tensor_bytes": null, "serialized_payload_bytes": 7811, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007833004929125309, "decode_payload_ms": 0.0, "receiver_prefill_ms": 673.7747500883415, "ttft_ms": 12.354707927443087, "decode_ms": 1203.9612079970539}, "total_wall_ms": 1893.6819999944419, "ttft_ms": 12.354707927443087, "input_usage": {"receiver_prompt_tokens": 1947}, "output_usage": {"output_tokens": 100}, "provider_cached_usage": null, "process_memory": 10452402176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9950833320, "mlx_cache_bytes": 699929632, "process_rss_bytes": 10452402176}, "peak_prefill_memory": null, "peak_decode_memory": 9950833320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.05, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "output_hash": "460f3c6445c2436421f28c8253f979de4bf7dd710cd08a60c1a395e1cf244cd4"} | ||||
| 1352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d7ae100512884fa011bd72a6", "attempt_id": "e2bd447f8f1f", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:20.633456Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 284, "message_tokens": 197, "message_utf8_bytes": 910, "cache_tensor_bytes": null, "serialized_payload_bytes": 910, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1753.2032079761848, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.03924998641014, "ttft_ms": 11.944542056880891, "decode_ms": 11.771874967962503}, "total_wall_ms": 151.71537490095943, "ttft_ms": 11.944542056880891, "input_usage": {"receiver_prompt_tokens": 284, "sender_input_tokens": 1980, "sender_output_tokens": 197, "sender_prefill_ms": 339.12520902231336, "sender_ttft_ms": 7.487291935831308, "sender_decode_ms": 1404.3177500134334}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452451328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9462567144, "mlx_cache_bytes": 1628554380, "process_rss_bytes": 10452451328}, "peak_prefill_memory": null, "peak_decode_memory": 9462567144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a3f5dcee0992138404a38b12bff92b4539016bb96fe788d5c4111986289ba17d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4f2c14d5e726ac39a086a0bf", "attempt_id": "128ab9057bd6", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:24.817169Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 425, "message_tokens": 326, "message_utf8_bytes": 811, "cache_tensor_bytes": null, "serialized_payload_bytes": 811, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3992.66937491484, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.4356250120327, "ttft_ms": 12.001291033811867, "decode_ms": 11.85858401004225}, "total_wall_ms": 195.27104194276035, "ttft_ms": 12.001291033811867, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 2008, "sender_output_tokens": 512, "sender_prefill_ms": 340.33991710748523, "sender_ttft_ms": 7.286040927283466, "sender_decode_ms": 3642.624874948524}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452484096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9535608956, "mlx_cache_bytes": 2669200524, "process_rss_bytes": 10452484096}, "peak_prefill_memory": null, "peak_decode_memory": 9535608956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42d4c2e19091bc32e37169e1b55112cb3532086016f455ffde5aee38472c4241", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5d341b8355ed17482c355fe6", "attempt_id": "246b469577fe", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:25.403968Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7811, "cache_tensor_bytes": 70152192, "serialized_payload_bytes": 70168289, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.60866703558713, "doc_prefill_ms": 323.7449999433011, "compress_ms": 8.91287496779114, "serialize_ms": 16.79591601714492, "load_ms": 2.0526659209281206, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.39999997057021, "ttft_ms": 48.39999997057021, "decode_ms": 3938.231791020371}, "total_wall_ms": 3990.867375046946, "ttft_ms": 48.39999997057021, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593435648, "backend_memory": {"mlx_active_bytes": 9414855688, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4174579181, "process_rss_bytes": 10593435648}, "peak_prefill_memory": 9962433204, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " - man-1, with no. 1 NO WO-1? please\n（\n), that_soso-sc-step 1-1K(uuids(toe- it \"u jov ortorio=multischule_not_enough_has), neoxie_ear, lea\n-named-col):-h-what-not-1 else iternais_finea_ever-fued\nwhat-not-if\n- of \"==\", \"it_survai-it-is-repering_on_the_way,\n-1_size_of_numbers\n-10-but_not_hitting\n-1.略长方能解长\n：10.if_&_上\n-_1\no型\n-中文\n，\n-10个grs pronbanebola-1,\n-1,万\n-1\n-1,请是这样\n\n\n=1-1\n10\nnum-i\n=10\n-1, n\n-1,夏役方小题有我的小题为\n-1同型面裂\n-1,且班上将它火方不下的都是剧\n\n-1\n-1,下标高\n-1不要长\n-1\n-1\n-1\n-1\nno\n-1,请\n-1,用它方便\n\n-1\n.,\n-1\n-1\n-1\n-1\n\n-1,\n面-1,用-1,已上量永转\n-小题-1的小事", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d07e43f8ece81dcbf1f70d107cb8957cc5ac2e5113f2040eb69dc425702a74d7", "output_hash": "9232f4709bb3bfdc04598e42fb9a264b36d0dac8edb86169b8464d5d834f6367"} | ||||
| 1355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "68e5713de6b3862afaf9b9bb", "attempt_id": "594e20ca6654", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:30.678524Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7811, "cache_tensor_bytes": 70152192, "serialized_payload_bytes": 70168390, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1241.5818748995662, "doc_prefill_ms": 326.4681249856949, "compress_ms": 895.9590001031756, "serialize_ms": 18.857167102396488, "load_ms": 1.5282499371096492, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.415333084762096, "ttft_ms": 54.415333084762096, "decode_ms": 988.852332928218}, "total_wall_ms": 1046.7881250660866, "ttft_ms": 54.415333084762096, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10600284160, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4187751917, "process_rss_bytes": 10600284160}, "peak_prefill_memory": 9962285748, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f14e3b6f128a82c897ad859173999efca2c281fd8278a7477df8da6da94a3bd0", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 1356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "42f66fb0361fd8a5640de574", "attempt_id": "314c1bd54179", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:31.765550Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1903, "keep": 476, "window_tokens": 44, "compress_ms": 81.48570894263685}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7811, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1303.05187497288, "doc_prefill_ms": 326.36312500108033, "compress_ms": 969.2753750132397, "serialize_ms": 7.120250025764108, "load_ms": 1.0618329979479313, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.361916969530284, "ttft_ms": 37.361916969530284, "decode_ms": 1192.8631250048056}, "total_wall_ms": 2537.7782080322504, "ttft_ms": 37.361916969530284, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 101}, "provider_cached_usage": null, "process_memory": 10584539136, "backend_memory": {"mlx_active_bytes": 9301773320, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4458856941, "process_rss_bytes": 10584539136}, "peak_prefill_memory": 9962285748, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest': # Assuming 'returned' and 'region' keys are present\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price'] * (1 + r['tax_rate'] / 100)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "914bf52de8035dc9da877a975e6605d343dbcaf8849587e713d424e4d6fb7697"} | ||||
| 1357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a96c1d61a3e17cc1ec253613", "attempt_id": "ffbf1065083e", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:34.363317Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 1920, "message_tokens": 1837, "message_utf8_bytes": 7909, "cache_tensor_bytes": null, "serialized_payload_bytes": 7909, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007999944500625134, "decode_payload_ms": 0.0, "receiver_prefill_ms": 660.2920830482617, "ttft_ms": 12.464917032048106, "decode_ms": 1238.0025419406593}, "total_wall_ms": 1914.4424999831244, "ttft_ms": 12.464917032048106, "input_usage": {"receiver_prompt_tokens": 1920}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10452484096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9942067772, "mlx_cache_bytes": 691164084, "process_rss_bytes": 10452484096}, "peak_prefill_memory": null, "peak_decode_memory": 9942067772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 4:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.14975, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "output_hash": "3b9c48f003cea85362196c454582881c13ebf38511b3c97f4594cab5afc9bd36"} | ||||
| 1358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "43ddf7726b22759fc83cad29", "attempt_id": "891cf5358548", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:40.287900Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 2443, "cache_tensor_bytes": null, "serialized_payload_bytes": 2443, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3972.2217910457402, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.85487498994917, "ttft_ms": 12.127666966989636, "decode_ms": 11.960749980062246}, "total_wall_ms": 257.4779170099646, "ttft_ms": 12.127666966989636, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 1953, "sender_output_tokens": 512, "sender_prefill_ms": 336.0140830045566, "sender_ttft_ms": 7.627374958246946, "sender_decode_ms": 3626.1120409471914}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452500480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 1839939508, "process_rss_bytes": 10452500480}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9b94ecd996f9edf081fffd071e9e0c68c99cf02e48c01c9c8f0f15a40c214092", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cb5013e732e38150db3849cc", "attempt_id": "86c57fa36188", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:44.554947Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 11, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 478, "message_tokens": 379, "message_utf8_bytes": 1009, "cache_tensor_bytes": null, "serialized_payload_bytes": 1009, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3970.6835839897394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 193.67429101839662, "ttft_ms": 12.001625029370189, "decode_ms": 11.854499927721918}, "total_wall_ms": 218.6783750075847, "ttft_ms": 12.001625029370189, "input_usage": {"receiver_prompt_tokens": 478, "sender_input_tokens": 1981, "sender_output_tokens": 512, "sender_prefill_ms": 336.0510419588536, "sender_ttft_ms": 7.432208978570998, "sender_decode_ms": 3624.5918340282515}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452516864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568426108, "mlx_cache_bytes": 2851028916, "process_rss_bytes": 10452516864}, "peak_prefill_memory": null, "peak_decode_memory": 9568426108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 11, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "df1bbabfaf8853e68e17ddb2358a9db7c0127b36ac96ce7d7ba33d4b3984cc7b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7fb3b30535952f3851b42af2", "attempt_id": "20faeab7317a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:45.164426Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 44, "message_tokens": 1876, "message_utf8_bytes": 7909, "cache_tensor_bytes": 69156864, "serialized_payload_bytes": 69172961, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.7189580015838, "doc_prefill_ms": 321.5354169951752, "compress_ms": 9.763499954715371, "serialize_ms": 16.435583005659282, "load_ms": 1.8567080842331052, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.21924995444715, "ttft_ms": 46.21924995444715, "decode_ms": 3921.9640840310603}, "total_wall_ms": 3972.0723329810426, "ttft_ms": 46.21924995444715, "input_usage": {"receiver_prefix_tokens": 1876, "dense_cache_bytes": 53788672, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10591305728, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9491188976, "mlx_cache_bytes": 4379672853, "process_rss_bytes": 10591305728}, "peak_prefill_memory": 9953176136, "peak_decode_memory": 9491188976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "--e_no_new\n)(_Pron_f, with\n__g, or !mro 1_dector\n- it喜会唔永不服就发热体,不过电击高好,我高抬, and, forwarer\n__MR_1, with and will it only the (如: 1, permanys, please指, no1\n-1,功能外星海明火之神,别太公,自排的用法1。ro.Mr\n-2,now,1,必用101的10241k 的16001\n- 0.的1,必胜有恒温(高, no.1, no.20%6,用法。201,无用php使上,用法\n-2016班,\n-1,无班的-1,用法\n-1,用法\n-1,用1,永勿用法\n-1,用so,这一题为它挥请,方胜,请再认坑后,用不将它军用法\n-1, no.1, p博士是\n-1,per的100%的16116\n-201,用法\n-200,用法\n-20\n,用100的1,用100-2,用10001,用10001,用16为", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ebb0dcc979b812a864dae72b11977165a9ca251edf8e15a611a0b3a7105fec03", "output_hash": "084d3e3d977e53e56749a305cb34e060801b6c8c31dc827cdca1e4ce640b23d2"} | ||||
| 1361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c0f7a90e20ce4b5f1e1658c0", "attempt_id": "5e867571ebc0", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:50.408336Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 44, "message_tokens": 1876, "message_utf8_bytes": 7909, "cache_tensor_bytes": 69156864, "serialized_payload_bytes": 69173062, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1231.9060830632225, "doc_prefill_ms": 324.5667909504846, "compress_ms": 891.5083750616759, "serialize_ms": 15.543458983302116, "load_ms": 1.486959052272141, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.96775000169873, "ttft_ms": 52.96775000169873, "decode_ms": 982.0187909062952}, "total_wall_ms": 1038.4743749164045, "ttft_ms": 52.96775000169873, "input_usage": {"receiver_prefix_tokens": 1876, "dense_cache_bytes": 53788672, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10597384192, "backend_memory": {"mlx_active_bytes": 9404140552, "mlx_peak_bytes": 9490795760, "mlx_cache_bytes": 4391076117, "process_rss_bytes": 10597384192}, "peak_prefill_memory": 9953028680, "peak_decode_memory": 9490795760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88627c572200dfb9fb0f439bd366c78482aa9b07a299d2437197bd698ac85fae", "output_hash": "5ae3d4b0264e1bdf0e621aa129b65618e5370c3646dfe9deafac6e3129ee6866"} | ||||
| 1362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "78cf5aebd508b12f6ed1307e", "attempt_id": "8e1b2594ee8c", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:51.486383Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1876, "keep": 469, "window_tokens": 44, "compress_ms": 83.44600000418723}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 44, "message_tokens": 1876, "message_utf8_bytes": 7909, "cache_tensor_bytes": 17289216, "serialized_payload_bytes": 17305293, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1292.5281670177355, "doc_prefill_ms": 324.16254200506955, "compress_ms": 961.2841670168564, "serialize_ms": 6.7962080938741565, "load_ms": 1.2174160219728947, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.585249985568225, "ttft_ms": 37.585249985568225, "decode_ms": 833.1830829847604}, "total_wall_ms": 2167.911665979773, "ttft_ms": 37.585249985568225, "input_usage": {"receiver_prefix_tokens": 1876, "dense_cache_bytes": 53788672, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10582491136, "backend_memory": {"mlx_active_bytes": 9300200456, "mlx_peak_bytes": 9378696432, "mlx_cache_bytes": 4617141309, "process_rss_bytes": 10582491136}, "peak_prefill_memory": 9953028680, "peak_decode_memory": 9378696432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'S':\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ca99234284b63c4c7be7ca7860540c254e63cf85f7b24ce6b1cca7dad6897bd7", "output_hash": "f0e3f91c53517bcaa974f025f8480df7cf48b1d00805e5892b3f711bb02a7197"} | ||||
| 1363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "40c7eadff0906340c1ec8754", "attempt_id": "8eda9e42b63f", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:53.715313Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 1951, "message_tokens": 1868, "message_utf8_bytes": 7882, "cache_tensor_bytes": null, "serialized_payload_bytes": 7882, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.2903329692781, "ttft_ms": 12.130292016081512, "decode_ms": 1127.0371669670567}, "total_wall_ms": 1820.1896670507267, "ttft_ms": 12.130292016081512, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10452238336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9952094904, "mlx_cache_bytes": 701191216, "process_rss_bytes": 10452238336}, "peak_prefill_memory": null, "peak_decode_memory": 9952094904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "output_hash": "6cfb541d84a7715b33166a25880541f4c37d894f235dcc3db0bc380f07fcf55b"} | ||||
| 1364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0e56dd3be29ac2b39b1f5c89", "attempt_id": "a7964d740155", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:45:57.393068Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 295, "message_tokens": 208, "message_utf8_bytes": 957, "cache_tensor_bytes": null, "serialized_payload_bytes": 957, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1820.502583985217, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.2699580769986, "ttft_ms": 11.809666990302503, "decode_ms": 1003.6042920546606}, "total_wall_ms": 1144.6875830879435, "ttft_ms": 11.809666990302503, "input_usage": {"receiver_prompt_tokens": 295, "sender_input_tokens": 1984, "sender_output_tokens": 208, "sender_prefill_ms": 340.0669590337202, "sender_ttft_ms": 7.350833038799465, "sender_decode_ms": 1470.8923749858513}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 10452271104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9455980820, "mlx_cache_bytes": 1687962824, "process_rss_bytes": 10452271104}, "peak_prefill_memory": null, "peak_decode_memory": 9455980820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Ouest' and row['units'] >= 3]\n rows = [row for row in rows if row['discount_pct'] == 0]\n return sum(row['units'] * row['unit_price'] * (1 - row['discount_pct'] / 100) for row in rows)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f0bc717c10d9108ac39b03f0c198d385bd72024caa00cfc15f6b41836b70f639", "output_hash": "f6296258865ca9b61f7490114ce23091bfaf7d6e1d85bfc9d2f3da039293a0b0"} | ||||
| 1365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1022003fc288feb23e070e85", "attempt_id": "5a18eb1f8994", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:02.550496Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 956, "cache_tensor_bytes": null, "serialized_payload_bytes": 956, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3973.6679999623448, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.81816698983312, "ttft_ms": 11.940792086534202, "decode_ms": 11.809832998551428}, "total_wall_ms": 216.57262498047203, "ttft_ms": 11.940792086534202, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2012, "sender_output_tokens": 512, "sender_prefill_ms": 344.2245000042021, "sender_ttft_ms": 7.2829159907996655, "sender_decode_ms": 3619.770959019661}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452320256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2756953288, "process_rss_bytes": 10452320256}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "165df23bae9b954d4d5141e8af10557d3563a15819316476034e64ab16321763", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1e260e99c93bb939fff7c08f", "attempt_id": "3487c9a7181e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:03.159717Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 70299648, "serialized_payload_bytes": 70315745, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.2700839461759, "doc_prefill_ms": 324.4155419524759, "compress_ms": 9.4454160425812, "serialize_ms": 16.41662500333041, "load_ms": 1.947375014424324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.615041956305504, "ttft_ms": 47.615041956305504, "decode_ms": 3930.284124915488}, "total_wall_ms": 3981.885457993485, "ttft_ms": 47.615041956305504, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593402880, "backend_memory": {"mlx_active_bytes": 9414724616, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4293985833, "process_rss_bytes": 10593402880}, "peak_prefill_memory": 9963842244, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "for_meiy foreign language又外), no.0 pfa_f, please_kernei) for the pinnernerns that pro fo, color. no 90 me: the code rf - that i feel, lebenswagabo_ferom) that i-am-et- -ernouyg_for_the_ba_dxe_ger -fication=\"nuevoit, no more, part do not back -fright_finding) the chas) it will make it: noh, no esew=weillotool) that this is no. No comandewei) that it can notaskat) :a) that it was not only for the case: 1/cm/iequater_years_longer) that it should be for free) {\n\nhtuexcellent) \"itex, please) for all the best service pathos, part/eru=erlang, no.thon, homedatic=1) -1001-malroffical)10151) {itl (tts), 1) -f)100) that, no esatime) that it's a. no.ican) that i n) that it ismelz, space) -15) -1com) that it is the ches -15) 1/f1) -1) -1) -1) 1) -homexp: it is the only 1 commotion) 1) -NY=1,", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "712f86bde118ba124e351b0a5806c4dd291819a1f3897046d7e8616b634d01a3", "output_hash": "533225c704d26f9867ddf6b727fb1520dbcb65cfc1997e7b5bc90552e667a831"} | ||||
| 1367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d21a24fe550e591f5b8b071f", "attempt_id": "0435f9b8bea5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:08.421135Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 70299648, "serialized_payload_bytes": 70315846, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1239.3100839108229, "doc_prefill_ms": 327.32399995438755, "compress_ms": 891.6817919816822, "serialize_ms": 20.01145901158452, "load_ms": 1.5917080454528332, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.12425000779331, "ttft_ms": 55.12425000779331, "decode_ms": 1043.878540978767}, "total_wall_ms": 1102.5912079494447, "ttft_ms": 55.12425000779331, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10602430464, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4309026345, "process_rss_bytes": 10602430464}, "peak_prefill_memory": 9963694788, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "dbcbd805e5d8663228bda0bbeaed61938bd1c4ee6007f49ece449a26726a9e68", "output_hash": "ce110bd25efb008d46785baf5429a864cc124b4b3b9039241e42f85d27d8ce38"} | ||||
| 1368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "815d51afa3b2a80a70eb4a0e", "attempt_id": "36c1b8099592", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:09.564859Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1907, "keep": 477, "window_tokens": 44, "compress_ms": 81.19687507860363}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 17584128, "serialized_payload_bytes": 17600207, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1316.4464159635827, "doc_prefill_ms": 326.3972080312669, "compress_ms": 983.0857500201091, "serialize_ms": 6.6646249033510685, "load_ms": 1.1496669612824917, "receiver_prefill_ms": 0.0, "query_prefill_ms": 40.375583921559155, "ttft_ms": 40.375583921559155, "decode_ms": 1069.7046660352498}, "total_wall_ms": 2431.148499948904, "ttft_ms": 40.375583921559155, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 91}, "provider_cached_usage": null, "process_memory": 10586636288, "backend_memory": {"mlx_active_bytes": 9301576712, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4574429769, "process_rss_bytes": 10586636288}, "peak_prefill_memory": 9963694788, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n if r['region'] == 'Ouest':\n continue\n total += r['units'] * r['price'] * (1 + r['tax_rate'] / 100)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a25e1be4237205ffff60dd9ca3ecccb9c4ec76b267810e425025281743afe375", "output_hash": "d9858a0c496841b6f8db56e6091796f5509356c561fea11efb607a4349872f7a"} | ||||
| 1369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2cc8161ac9012e633a82bd96", "attempt_id": "50bd086165ef", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:12.059565Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 1888, "message_tokens": 1805, "message_utf8_bytes": 7695, "cache_tensor_bytes": null, "serialized_payload_bytes": 7695, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008208095096051693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 654.3611660599709, "ttft_ms": 12.213625013828278, "decode_ms": 1274.427416967228}, "total_wall_ms": 1944.7079169331118, "ttft_ms": 12.213625013828278, "input_usage": {"receiver_prompt_tokens": 1888}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 10452533248, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9931909564, "mlx_cache_bytes": 681005876, "process_rss_bytes": 10452533248}, "peak_prefill_memory": null, "peak_decode_memory": 9931909564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Nord':\n continue\n if r['units'] < 4:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.09975\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "output_hash": "039a6ca3b28b9561050889214387c3d24be4074cfa20a9ecd2d2525833a57dfa"} | ||||
| 1370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "675051683cf5068f3700f23c", "attempt_id": "92e2379ff176", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:15.634085Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 263, "message_tokens": 176, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1591.8203339679167, "decode_payload_ms": 0.0, "receiver_prefill_ms": 126.46816694177687, "ttft_ms": 11.923042009584606, "decode_ms": 11.698583024553955}, "total_wall_ms": 151.0356670478359, "ttft_ms": 11.923042009584606, "input_usage": {"receiver_prompt_tokens": 263, "sender_input_tokens": 1921, "sender_output_tokens": 176, "sender_prefill_ms": 327.2926249774173, "sender_ttft_ms": 7.4610000010579824, "sender_decode_ms": 1254.790166974999}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452566016, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9437253768, "mlx_cache_bytes": 1625113420, "process_rss_bytes": 10452566016}, "peak_prefill_memory": null, "peak_decode_memory": 9437253768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "17acdd39a78da28b8f4a24eef30587776cd2c7e68d3b29c9e037354ab42ad2d2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8534ac3fe8e063464cd2f4db", "attempt_id": "ef265057d56a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:19.806679Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 11, "unresolved_quotes": 7, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 412, "message_tokens": 314, "message_utf8_bytes": 866, "cache_tensor_bytes": null, "serialized_payload_bytes": 866, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3983.566249953583, "decode_payload_ms": 0.0, "receiver_prefill_ms": 167.84345800988376, "ttft_ms": 12.079708045348525, "decode_ms": 11.81258400902152}, "total_wall_ms": 192.72887497209013, "ttft_ms": 12.079708045348525, "input_usage": {"receiver_prompt_tokens": 412, "sender_input_tokens": 1949, "sender_output_tokens": 512, "sender_prefill_ms": 332.0320419734344, "sender_ttft_ms": 7.350083091296256, "sender_decode_ms": 3641.709165996872}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452566016, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9527974012, "mlx_cache_bytes": 2653225804, "process_rss_bytes": 10452566016}, "peak_prefill_memory": null, "peak_decode_memory": 9527974012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 11, "unresolved_quotes": 7, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "30b56fa54a2e69b27df3a4f8b669297877ef76e0ec3394415d5cccb234982567", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dbe62a8ed9aa914140483827", "attempt_id": "a01ffad95dee", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:20.378257Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9327922184}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 44, "message_tokens": 1844, "message_utf8_bytes": 7695, "cache_tensor_bytes": 67977216, "serialized_payload_bytes": 67993313, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.2007919503376, "doc_prefill_ms": 310.8269158983603, "compress_ms": 9.630874963477254, "serialize_ms": 15.823583002202213, "load_ms": 1.9394579576328397, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.82816699985415, "ttft_ms": 45.82816699985415, "decode_ms": 3932.3283749399707}, "total_wall_ms": 3982.199457939714, "ttft_ms": 45.82816699985415, "input_usage": {"receiver_prefix_tokens": 1844, "dense_cache_bytes": 52871168, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10588979200, "backend_memory": {"mlx_active_bytes": 9409317896, "mlx_peak_bytes": 9488862448, "mlx_cache_bytes": 4018308269, "process_rss_bytes": 10588979200}, "peak_prefill_memory": 9942313416, "peak_decode_memory": 9488862448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "- -fa! No, neverland_and_diy? no more than it now is it 201, no, if there is no small it -c, never before, it is a2 it -a/i-ur - 1, no more than - 2020 - all small is in the case of i believe in it - italobession, never say please put-itm now -Pleis it winter -o202-1, never-f**\\$, coulditip-googotzum 1listener -way -internal/renal, no matter -on -wayward -huttm - 1, buy -1, never say ita -way -htrai -1, never - ever - feq -channel -h1, no matter, neverwillbefeho, that's standing -part-1computer - part-wot -1, mustbeef -part, please -use ita20bis plus -1, noctober 1, never before the way, neverwhere is only 19:01 -1, never - 1, never -1, will it befor -part，请站上,请多选cti的同, no.1, must -1,never -part_sistu of2, no -part-1, will do it -1,never -part -1, willit does not -1,willows, no,thankyou - part -1,never -part1, thank", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "aa320da0662ba4fcbaecd3a49964361416ab45f2c3abaca83fef1354b0fe4a1a", "output_hash": "f09371cfb7341c71997641b310e0dd59436694e88e5f6807ad116af722e5d63f"} | ||||
| 1373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "603834925f45e9c52b86610b", "attempt_id": "78eea07061b5", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:25.605824Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9327725576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 44, "message_tokens": 1844, "message_utf8_bytes": 7695, "cache_tensor_bytes": 67977216, "serialized_payload_bytes": 67993414, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1204.787208000198, "doc_prefill_ms": 312.27883300743997, "compress_ms": 876.4483749400824, "serialize_ms": 15.767790959216654, "load_ms": 1.5267080161720514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.06399997789413, "ttft_ms": 53.06399997789413, "decode_ms": 986.7855419870466}, "total_wall_ms": 1043.4971660142764, "ttft_ms": 53.06399997789413, "input_usage": {"receiver_prefix_tokens": 1844, "dense_cache_bytes": 52871168, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10594304000, "backend_memory": {"mlx_active_bytes": 9400863752, "mlx_peak_bytes": 9488207088, "mlx_cache_bytes": 4030563501, "process_rss_bytes": 10594304000}, "peak_prefill_memory": 9942165960, "peak_decode_memory": 9488207088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ac5575db3f963698f3557b86ed530544d1a0cef9e351e3e7f4457fe7357f913", "output_hash": "bf7126e9b129977cab3a3e8e5cd58a2732743aa1d9b634885ba31857ab2fc365"} | ||||
| 1374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9836abc8c0d82a4283618546", "attempt_id": "b247de948cff", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:26.690323Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1844, "keep": 461, "window_tokens": 44, "compress_ms": 76.90612494479865}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 44, "message_tokens": 1844, "message_utf8_bytes": 7695, "cache_tensor_bytes": 16994304, "serialized_payload_bytes": 17010379, "side_information_bytes": 16075, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1271.5167499845847, "doc_prefill_ms": 313.07604198809713, "compress_ms": 951.2063339352608, "serialize_ms": 6.925791967660189, "load_ms": 0.7902499055489898, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.828000029549, "ttft_ms": 37.828000029549, "decode_ms": 971.633916022256}, "total_wall_ms": 2285.2152079576626, "ttft_ms": 37.828000029549, "input_usage": {"receiver_prefix_tokens": 1844, "dense_cache_bytes": 52871168, "query_tokens": 44}, "output_usage": {"output_tokens": 82}, "provider_cached_usage": null, "process_memory": 10580246528, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9377910000, "mlx_cache_bytes": 4292034261, "process_rss_bytes": 10580246528}, "peak_prefill_memory": 9942165960, "peak_decode_memory": 9377910000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Nord':\n continue\n if r['units'] < 10:\n continue\n total += r['units'] * r['price'] * (1 + r['tax_rate'])\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4b2f7a87df2a9943f5097bdc055c8091a2856fa68a25782270f2d9c0c599e8e7", "output_hash": "eeeca1a900a5c0fc1a0120d6da8ebd734c729da3c432a865e721dc27022ff415"} | ||||
| 1375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5dc633c78ac2790cab8dabae", "attempt_id": "230ee6123f46", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:29.037729Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 1965, "message_tokens": 1882, "message_utf8_bytes": 7815, "cache_tensor_bytes": null, "serialized_payload_bytes": 7815, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008165952749550343, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.8598749293014, "ttft_ms": 12.417791993357241, "decode_ms": 1263.3305829949677}, "total_wall_ms": 1955.3354580421, "ttft_ms": 12.417791993357241, "input_usage": {"receiver_prompt_tokens": 1965}, "output_usage": {"output_tokens": 105}, "provider_cached_usage": null, "process_memory": 10451943424, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9956469488, "mlx_cache_bytes": 792859752, "process_rss_bytes": 10451943424}, "peak_prefill_memory": null, "peak_decode_memory": 9956469488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Centre':\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.14975\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "output_hash": "824c5032c405243301f6ff605a08e25858fd0139d8ebc2080a9ae72029dd7970"} | ||||
| 1376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a0a2f47acfa577f247d5af09", "attempt_id": "425d64ee712b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:32.819566Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 289, "message_tokens": 202, "message_utf8_bytes": 957, "cache_tensor_bytes": null, "serialized_payload_bytes": 957, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1789.3501670332626, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.59329203981906, "ttft_ms": 11.975041939876974, "decode_ms": 985.8160420553759}, "total_wall_ms": 1126.455666963011, "ttft_ms": 11.975041939876974, "input_usage": {"receiver_prompt_tokens": 289, "sender_input_tokens": 1998, "sender_output_tokens": 202, "sender_prefill_ms": 343.5920000774786, "sender_ttft_ms": 7.464584079571068, "sender_decode_ms": 1436.0655409982428}, "output_usage": {"output_tokens": 84}, "provider_cached_usage": null, "process_memory": 10451976192, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9451278588, "mlx_cache_bytes": 1629357288, "process_rss_bytes": 10451976192}, "peak_prefill_memory": null, "peak_decode_memory": 9451278588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_units = 0\n for row in rows:\n if row['region'] != 'excluded_region' and row['returned'] == False and len(row['units']) >= 3:\n total_units += sum(row['units'])\n net_revenue = total_units * 1.14975\n return net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "TypeError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5efa63ac15ed0118ce7167ba74c5e55075563a4bee133e76738e4b3467daa484", "output_hash": "6adbe6c3887d553f330897bd541e0ce4429d9ae8f64c79c138c058ea60176759"} | ||||
| 1377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0a6aee726ce888d0fbb8f40e", "attempt_id": "dfd0e7e6489c", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:37.981852Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 956, "cache_tensor_bytes": null, "serialized_payload_bytes": 956, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3996.68737500906, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.72791601158679, "ttft_ms": 11.991459061391652, "decode_ms": 11.938125011511147}, "total_wall_ms": 216.68020798824728, "ttft_ms": 11.991459061391652, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2026, "sender_output_tokens": 512, "sender_prefill_ms": 343.24024990200996, "sender_ttft_ms": 7.282917038537562, "sender_decode_ms": 3643.6471669003367}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452008960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2701673704, "process_rss_bytes": 10452008960}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0002ed72a2858775a90bfba68e83c2ac74c8d3ca43b09e910ae94e6ffbc85321", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1732fa7ed6caf362d64230cb", "attempt_id": "ef3de7630e88", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:38.600883Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 44, "message_tokens": 1921, "message_utf8_bytes": 7815, "cache_tensor_bytes": 70815744, "serialized_payload_bytes": 70831841, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 363.28725004568696, "doc_prefill_ms": 332.52441603690386, "compress_ms": 9.935999987646937, "serialize_ms": 16.774124931544065, "load_ms": 2.2808329667896032, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.42058294545859, "ttft_ms": 49.42058294545859, "decode_ms": 3948.85875005275}, "total_wall_ms": 4002.6233340613544, "ttft_ms": 49.42058294545859, "input_usage": {"receiver_prefix_tokens": 1921, "dense_cache_bytes": 55078912, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10594795520, "backend_memory": {"mlx_active_bytes": 9416395784, "mlx_peak_bytes": 9496120560, "mlx_cache_bytes": 4191323721, "process_rss_bytes": 10594795520}, "peak_prefill_memory": 9969101564, "peak_decode_memory": 9496120560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "- no markdown for your first class material base part 1.1.0.8a. m1, if there is australian pizzy_1 -coma\n\nNo. m f, of - only. please\n\n(only. comhut p.i. Follows, chs. caowide. no. me. me. (hav.)\n\n2011.11(cs)u(常\n\n输入掩码.永不过忧. no.1, no.ue\n\nNOC(only. it can itte. haves. 1, sptfile \"it1.)\n\nhttp://hollow. toos. ittoworld. no. it_1, 2014, feb.fun = 1, please let. please wait. to get. to beholy. to beijingwep, no. gehoeb 201, hefh1, like, no. mao, my first.\n\n1.05. what is the. to be. no. 2019, please wait. 1950crme1\n\nno. every. every. no. (hahs. thank. us. no. putatime. toe. pofhie. the. omgreek. 1, 2001, please. no. loco. no. also. no. no. this. no. puderollfree-1.com(german. itt. 2015. ", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a07c9683172aca6b79887172f30f56e2ee9c60f796de20515e801ccf59269382", "output_hash": "9a7f71ca750957cbb572263145511128e85d19a3b8d1e80fd900199746cd1cb9"} | ||||
| 1379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a5245af8554497a3f14a1fdc", "attempt_id": "5d72ef42e085", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:43.894431Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 44, "message_tokens": 1921, "message_utf8_bytes": 7815, "cache_tensor_bytes": 70815744, "serialized_payload_bytes": 70831942, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1249.966291943565, "doc_prefill_ms": 334.6553749870509, "compress_ms": 896.5117919724435, "serialize_ms": 18.49725004285574, "load_ms": 1.7852089367806911, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.83624991495162, "ttft_ms": 59.83624991495162, "decode_ms": 990.7157080015168}, "total_wall_ms": 1054.2682920349762, "ttft_ms": 59.83624991495162, "input_usage": {"receiver_prefix_tokens": 1921, "dense_cache_bytes": 55078912, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10600841216, "backend_memory": {"mlx_active_bytes": 9406761992, "mlx_peak_bytes": 9495874800, "mlx_cache_bytes": 4206888521, "process_rss_bytes": 10600841216}, "peak_prefill_memory": 9968954108, "peak_decode_memory": 9495874800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7c67ce631db5d4bf201947423368fc4ad72eda306e374bf38804238241b664b3", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
| 1380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4d542d081ab39f933d96b3ee", "attempt_id": "55c73d402c02", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:44.990826Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1921, "keep": 480, "window_tokens": 44, "compress_ms": 83.57554103713483}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 44, "message_tokens": 1921, "message_utf8_bytes": 7815, "cache_tensor_bytes": 17694720, "serialized_payload_bytes": 17710799, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1330.1925419364125, "doc_prefill_ms": 334.57370894029737, "compress_ms": 989.0921249752864, "serialize_ms": 6.214624969288707, "load_ms": 1.4368750853464007, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.315167021006346, "ttft_ms": 37.315167021006346, "decode_ms": 795.4495829762891}, "total_wall_ms": 2167.871416080743, "ttft_ms": 37.315167021006346, "input_usage": {"receiver_prefix_tokens": 1921, "dense_cache_bytes": 55078912, "query_tokens": 44}, "output_usage": {"output_tokens": 67}, "provider_cached_usage": null, "process_memory": 10584621056, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9379122416, "mlx_cache_bytes": 4444717785, "process_rss_bytes": 10584621056}, "peak_prefill_memory": 9968954108, "peak_decode_memory": 9379122416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Centre':\n continue\n if r['units'] < 3:\n continue\n total += r['revenue']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9ef96b218193d0bace73d6f5a3e58a86e300909a3280bb33337a10e9194ea654", "output_hash": "24dfbcc479287626adef0df648e83dd7015863681c2eaf24208665374c65b324"} | ||||
| 1381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f10194a39e0b35ad00b4eeb6", "attempt_id": "ca96e5aa734a", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:47.220981Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 1948, "message_tokens": 1865, "message_utf8_bytes": 7894, "cache_tensor_bytes": null, "serialized_payload_bytes": 7894, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009958050213754177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.4140830384567, "ttft_ms": 12.224832898937166, "decode_ms": 1184.6296669682488}, "total_wall_ms": 1877.9720419552177, "ttft_ms": 12.224832898937166, "input_usage": {"receiver_prompt_tokens": 1948}, "output_usage": {"output_tokens": 99}, "provider_cached_usage": null, "process_memory": 10452631552, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9951095468, "mlx_cache_bytes": 700191780, "process_rss_bytes": 10452631552}, "peak_prefill_memory": null, "peak_decode_memory": 9951095468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Centre':\n continue\n if r['units'] < 2:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.05, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "output_hash": "b10181c8708ad97273b9a04db70cb6bd99491b8986d3919422b17249320f016d"} | ||||
| 1382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a04fd3be9db0fc9400ccb1d6", "attempt_id": "52ffa5038944", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:50.873751Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 283, "message_tokens": 196, "message_utf8_bytes": 907, "cache_tensor_bytes": null, "serialized_payload_bytes": 907, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1737.3557910323143, "decode_payload_ms": 0.0, "receiver_prefill_ms": 126.93716608919203, "ttft_ms": 11.87275000847876, "decode_ms": 1609.0194589924067}, "total_wall_ms": 1748.7861670088023, "ttft_ms": 11.87275000847876, "input_usage": {"receiver_prompt_tokens": 283, "sender_input_tokens": 1981, "sender_output_tokens": 196, "sender_prefill_ms": 339.66950001195073, "sender_ttft_ms": 7.40891695022583, "sender_decode_ms": 1388.0814999574795}, "output_usage": {"output_tokens": 138}, "provider_cached_usage": null, "process_memory": 10452680704, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9462075620, "mlx_cache_bytes": 1628488844, "process_rss_bytes": 10452680704}, "peak_prefill_memory": null, "peak_decode_memory": 9462075620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Centre' and row['units'] >= 2 and row['returned'] == 0]\n for row in rows:\n row['net_revenue'] = (row['unit_price'] - (row['unit_price'] * (row['discount_pct'] / 100))) * row['units']\n rows = sorted(rows, key=lambda x: x['shipped_days'])\n total_net_revenue = sum(row['net_revenue'] for row in rows)\n total_net_revenue *= 1.05\n return total_net_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3e9e0f22acc39fc080ad2bf33a4c7dcd411a8e12788191da6fc3372967449d5d", "output_hash": "52293145d44f303891a79685da000b43b25d03cf4444344a1a736828214243de"} | ||||
| 1383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8bcd410ed1134ac33cc75e50", "attempt_id": "0a167a92d32f", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:56.639051Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 932, "cache_tensor_bytes": null, "serialized_payload_bytes": 932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.3532499568537, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.64779200218618, "ttft_ms": 12.003291049040854, "decode_ms": 11.764875031076372}, "total_wall_ms": 216.4829580578953, "ttft_ms": 12.003291049040854, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2009, "sender_output_tokens": 512, "sender_prefill_ms": 343.6793750151992, "sender_ttft_ms": 7.329415995627642, "sender_decode_ms": 3624.892916996032}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452713472, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2696184972, "process_rss_bytes": 10452713472}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8d3a388ef524bbead6bb0908ed804b564d1e1ba2c8ad740ca12157eb3f4c8cb0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f4dc22766834116a734fff57", "attempt_id": "34f35dd9d722", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:46:57.249730Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7894, "cache_tensor_bytes": 70189056, "serialized_payload_bytes": 70205153, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.6918749343604, "doc_prefill_ms": 323.88820906635374, "compress_ms": 9.617291041649878, "serialize_ms": 17.155749956145883, "load_ms": 1.973374979570508, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.875416978262365, "ttft_ms": 48.875416978262365, "decode_ms": 3926.2100409250706}, "total_wall_ms": 3979.1800000239164, "ttft_ms": 48.875416978262365, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593697792, "backend_memory": {"mlx_active_bytes": 9414806536, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4201809389, "process_rss_bytes": 10593697792}, "peak_prefill_memory": 9962629816, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "[高州外角 幷文首德國. soh.=com_p.=componerefrs in colombocheat.ocup. alway! (o/so! La! berichten-OFWTC_f=?, when itar=1字典文华_!f_1,字面_! p引出Col癌cel_1字面出问题_1_11不知有10进阶_1501_1超级详清_可_!怎么多线性_1,胜克雷_1的_1_1_1_1_1_1正确_1_1的小外网银弹快接必答外行家有困难智_0接触不到它马赛用上了。以多远大國有_0的1005_def_exponitwes_0的!_up_1,请销外快处,快而快而快而起爆的外因排山能快而用is的_!_1的_1_1,可�-lndtpr01_1同_!跳失用解_! mop_1_1_0.16_几多生之快的,那个外挂车,花6_1,快而治身手快的_1_1,有,用它来_.\n\n1,用0_几多出_1_. 的都是写错_几_1_1的同_1,", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "034d4222b645ee6182e59fc9e1d7d78a9d35a503bdb040ca019c0e200a712670", "output_hash": "4e57b311edc125c16b292c89afed1306819abebb7727797d7723eeb3a91c3802"} | ||||
| 1385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8a05a9afd74da3209a84e95c", "attempt_id": "12a4bf70e6fb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:02.525227Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7894, "cache_tensor_bytes": 70189056, "serialized_payload_bytes": 70205254, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1255.0149169983342, "doc_prefill_ms": 326.7498330678791, "compress_ms": 906.6583750536665, "serialize_ms": 21.28758397884667, "load_ms": 1.5124579658731818, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.51804201584309, "ttft_ms": 54.51804201584309, "decode_ms": 979.9562910338864}, "total_wall_ms": 1038.0765829468146, "ttft_ms": 54.51804201584309, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10600316928, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4214932973, "process_rss_bytes": 10600316928}, "peak_prefill_memory": 9962482360, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "28f70a8d71d520e381dd2fae84837873489623db4d916f7ba4ce39be46ea3832", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 1386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "19baf63733eddc49af790eea", "attempt_id": "bb00605058b8", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:03.604942Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1904, "keep": 476, "window_tokens": 44, "compress_ms": 81.21733297593892}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7894, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1294.5872499840334, "doc_prefill_ms": 326.7619999824092, "compress_ms": 960.4386249557137, "serialize_ms": 7.080208044499159, "load_ms": 1.1424999684095383, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.861291038803756, "ttft_ms": 36.861291038803756, "decode_ms": 799.9748330330476}, "total_wall_ms": 2136.1110829748213, "ttft_ms": 36.861291038803756, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 68}, "provider_cached_usage": null, "process_memory": 10584588288, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4452024821, "process_rss_bytes": 10584588288}, "peak_prefill_memory": 9962482360, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Centre':\n continue\n if r['units'] < 2:\n continue\n total += r['unit_revenue']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "cb2ff2411b0606e3e0f5815e16378622bbfc8058b28a3f9284d5f9f6b0adda3b"} | ||||
| 1387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4c7203e0a377e8838d50149d", "attempt_id": "593bd767d3d0", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:05.801634Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 2001, "message_tokens": 1918, "message_utf8_bytes": 7838, "cache_tensor_bytes": null, "serialized_payload_bytes": 7838, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007791910320520401, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.917042019777, "ttft_ms": 12.244667042978108, "decode_ms": 1232.4037500657141}, "total_wall_ms": 1945.334209012799, "ttft_ms": 12.244667042978108, "input_usage": {"receiver_prompt_tokens": 2001}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10452484096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9967758208, "mlx_cache_bytes": 804148472, "process_rss_bytes": 10452484096}, "peak_prefill_memory": null, "peak_decode_memory": 9967758208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.05\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "output_hash": "5a35a3705283b8eb7a8dc70a170a1a719e9573834fed9e9844ba482269766b87"} | ||||
| 1388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8a1869330a7aa018c650b631", "attempt_id": "85f3c49098cc", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:09.550577Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 286, "message_tokens": 199, "message_utf8_bytes": 915, "cache_tensor_bytes": null, "serialized_payload_bytes": 915, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1766.0208340967074, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.25162506103516, "ttft_ms": 11.850084061734378, "decode_ms": 1056.047165999189}, "total_wall_ms": 1196.11229095608, "ttft_ms": 11.850084061734378, "input_usage": {"receiver_prompt_tokens": 286, "sender_input_tokens": 2034, "sender_output_tokens": 199, "sender_prefill_ms": 347.4429160123691, "sender_ttft_ms": 7.382625015452504, "sender_decode_ms": 1408.9544580783695}, "output_usage": {"output_tokens": 90}, "provider_cached_usage": null, "process_memory": 10452516864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9450295536, "mlx_cache_bytes": 1652213100, "process_rss_bytes": 10452516864}, "peak_prefill_memory": null, "peak_decode_memory": 9450295536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Ouest' and row['units'] >= 6 and row['returned'] == False:\n total_revenue += row['price'] * row['units']\n total_revenue *= 1.05\n total_revenue = round(total_revenue, 2)\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66e210249f2285d3d2a03fb42b16768a4cca639dd367e4ad049ecf831f926364", "output_hash": "0d2f42513da019133ef083fbe32df8669c6283e2af3a9e485eccec93754faba2"} | ||||
| 1389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cd9b6f5ccddc168443187978", "attempt_id": "1bd3d7bb6141", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:14.791879Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 477, "message_tokens": 378, "message_utf8_bytes": 955, "cache_tensor_bytes": null, "serialized_payload_bytes": 955, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4006.962375016883, "decode_payload_ms": 0.0, "receiver_prefill_ms": 192.9682089248672, "ttft_ms": 11.994041036814451, "decode_ms": 11.811999953351915}, "total_wall_ms": 217.80654194299132, "ttft_ms": 11.994041036814451, "input_usage": {"receiver_prompt_tokens": 477, "sender_input_tokens": 2062, "sender_output_tokens": 512, "sender_prefill_ms": 374.77733299601823, "sender_ttft_ms": 7.04595900606364, "sender_decode_ms": 3622.5716250482947}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10452516864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9567410300, "mlx_cache_bytes": 2705456032, "process_rss_bytes": 10452516864}, "peak_prefill_memory": null, "peak_decode_memory": 9567410300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e262c9b3336e86f0b8dc5d07ebec6ca9cb850f654a71e62eeda3095315ae5c6e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b9e6da8596baa1b2cbbad389", "attempt_id": "62548d37ba8b", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:15.413874Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332640776}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 44, "message_tokens": 1957, "message_utf8_bytes": 7838, "cache_tensor_bytes": 72142848, "serialized_payload_bytes": 72158949, "side_information_bytes": 16101, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 365.9467090619728, "doc_prefill_ms": 334.86945799086243, "compress_ms": 9.881624951958656, "serialize_ms": 17.19233300536871, "load_ms": 2.0198749843984842, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.91124996356666, "ttft_ms": 48.91124996356666, "decode_ms": 3928.758708992973}, "total_wall_ms": 3981.730957981199, "ttft_ms": 48.91124996356666, "input_usage": {"receiver_prefix_tokens": 1957, "dense_cache_bytes": 56111104, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10597826560, "backend_memory": {"mlx_active_bytes": 9418755080, "mlx_peak_bytes": 9499839728, "mlx_cache_bytes": 4211309825, "process_rss_bytes": 10597826560}, "peak_prefill_memory": 9980750732, "peak_decode_memory": 9499839728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "imn the\npandie_so abru_naman_the_plc.getscho. xx. variable. rr. reason_where.get.py_130saying_plc_2.php0921-y有更多\"它还没那么好近1601s的!组不嫌大中军.当然,且华音哑mhp2.比如,捂为害upt_fanew.0opoopp_test_1而生,必有nees.这组队.abcdef...mhc_back_mgform.oder.0,已经知道,有,而且,小生,而且,而且,而且,非学无过生,接着它马,接着它一跳用得体t1,必 进化,这是小题为同在华医学团队又小快,接着它好同芳华盖价跳法bolf的表达,是吧的快速,是吧的口号被\"16001,接着打夫消,加上,方证,能务远夫能压1001,用且华。群口的优势在哪里,请多远,谢谢,是小号,老师,谢谢,群,是小将用老,不过,中国的,那个t1,那个就是对戒文链接地址的朋友们,什么时候好笑,吃老的表达,对头的校开,快好,谢谢您深,比如,对,这个华团状,运21班的名 ob_1,用r的,的问题", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ff8359c2b3201f925b74455408765ad6395bcd12744944e723db32c81e20f7f5", "output_hash": "e58731f707a9cdb2f81fd98e8c3615ac7b646070706e8fa50e8810bc7aa918b5"} | ||||
| 1391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3b293fa1494e458b3303007b", "attempt_id": "b106b7cd50ed", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:20.681869Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9332444168}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 44, "message_tokens": 1957, "message_utf8_bytes": 7838, "cache_tensor_bytes": 72142848, "serialized_payload_bytes": 72159050, "side_information_bytes": 16202, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1245.2136659994721, "doc_prefill_ms": 337.6339580863714, "compress_ms": 890.2258749585599, "serialize_ms": 17.053417046554387, "load_ms": 1.4932500198483467, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.00966589897871, "ttft_ms": 55.00966589897871, "decode_ms": 1048.4914999688044}, "total_wall_ms": 1107.0973749738187, "ttft_ms": 55.00966589897871, "input_usage": {"receiver_prefix_tokens": 1957, "dense_cache_bytes": 56111104, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10608050176, "backend_memory": {"mlx_active_bytes": 9410300936, "mlx_peak_bytes": 9499184368, "mlx_cache_bytes": 4223794433, "process_rss_bytes": 10608050176}, "peak_prefill_memory": 9980603276, "peak_decode_memory": 9499184368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b9c24a5e3e28f380980e1b7feadc20244fb3fc13f7fcbaae82f2b22a30836e29", "output_hash": "e2d4a17616539e25de72316e29c088120e8aaf81b787b8cac62c4726dd53d451"} | ||||
| 1392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ba939d1b5503712c9e8981a2", "attempt_id": "19a89ee21587", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:21.830447Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1957, "keep": 489, "window_tokens": 44, "compress_ms": 90.22237500175834}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 44, "message_tokens": 1957, "message_utf8_bytes": 7838, "cache_tensor_bytes": 18026496, "serialized_payload_bytes": 18042579, "side_information_bytes": 16083, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1352.0980420289561, "doc_prefill_ms": 338.06074992753565, "compress_ms": 1007.3104579932988, "serialize_ms": 6.409625057131052, "load_ms": 1.3199590612202883, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.98870800528675, "ttft_ms": 37.98870800528675, "decode_ms": 1221.7388750286773}, "total_wall_ms": 2616.6337919421494, "ttft_ms": 37.98870800528675, "input_usage": {"receiver_prefix_tokens": 1957, "dense_cache_bytes": 56111104, "query_tokens": 44}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10592010240, "backend_memory": {"mlx_active_bytes": 9301773320, "mlx_peak_bytes": 9379319024, "mlx_cache_bytes": 4506598065, "process_rss_bytes": 10592010240}, "peak_prefill_memory": 9980603276, "peak_decode_memory": 9379319024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest': # Ouest for 'Ouest' as 'Ouest' is not a valid key\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * (1 - r['discount']) * (1 + r['tax'])\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "88280e51bc592585b811d17afcb5154b9fcfbbb1f4ab20686210d0de63a9e101", "output_hash": "7605791a216b2bb79b761feeccccb89d80279bd2a883ba8ad19370b3b3589fb6"} | ||||
| 1393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "12e458a56533cc70aeef56e7", "attempt_id": "ef07a70b3eea", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:24.509551Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 1921, "message_tokens": 1838, "message_utf8_bytes": 7764, "cache_tensor_bytes": null, "serialized_payload_bytes": 7764, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007416936568915844, "decode_payload_ms": 0.0, "receiver_prefill_ms": 658.758708043024, "ttft_ms": 12.426250032149255, "decode_ms": 1225.9039159398526}, "total_wall_ms": 1900.921665946953, "ttft_ms": 12.426250032149255, "input_usage": {"receiver_prompt_tokens": 1921}, "output_usage": {"output_tokens": 102}, "provider_cached_usage": null, "process_memory": 10454990848, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9942198848, "mlx_cache_bytes": 691295160, "process_rss_bytes": 10454990848}, "peak_prefill_memory": null, "peak_decode_memory": 9942198848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.14975, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "output_hash": "c46efb38e409496768824d6ea3cf1b65a3e8970d5e2b4d01d00327a43744e8e5"} | ||||
| 1394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "35e17573816918d07de7ce08", "attempt_id": "e5f4fe8cdd43", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:28.008472Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 257, "message_tokens": 170, "message_utf8_bytes": 855, "cache_tensor_bytes": null, "serialized_payload_bytes": 855, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1558.7886250577867, "decode_payload_ms": 0.0, "receiver_prefill_ms": 106.96116695180535, "ttft_ms": 12.210292043164372, "decode_ms": 11.744916904717684}, "total_wall_ms": 131.89787499140948, "ttft_ms": 12.210292043164372, "input_usage": {"receiver_prompt_tokens": 257, "sender_input_tokens": 1954, "sender_output_tokens": 170, "sender_prefill_ms": 340.02633299678564, "sender_ttft_ms": 7.341042044572532, "sender_decode_ms": 1209.209333988838}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10455007232, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9517387860, "mlx_cache_bytes": 1680704440, "process_rss_bytes": 10455007232}, "peak_prefill_memory": null, "peak_decode_memory": 9517387860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "42e8daf2656a587d232ac7bce5596e95955de8c2136c9918dafc9feafc875884", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c83dc8cdebcef4c7f7699a4c", "attempt_id": "ef23a327c5ce", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:32.169762Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 956, "cache_tensor_bytes": null, "serialized_payload_bytes": 956, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3990.3726250631735, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.09691702760756, "ttft_ms": 12.211041990667582, "decode_ms": 11.953167035244405}, "total_wall_ms": 216.32691693957895, "ttft_ms": 12.211041990667582, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 336.0114579554647, "sender_ttft_ms": 7.398667046800256, "sender_decode_ms": 3644.5411670720205}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10455040000, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561790588, "mlx_cache_bytes": 2725299128, "process_rss_bytes": 10455040000}, "peak_prefill_memory": null, "peak_decode_memory": 9561790588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0002ed72a2858775a90bfba68e83c2ac74c8d3ca43b09e910ae94e6ffbc85321", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7b98ea9cc321d09294c15d66", "attempt_id": "bad6d3648f45", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:32.776138Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7764, "cache_tensor_bytes": 69193728, "serialized_payload_bytes": 69209825, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.90412506926805, "doc_prefill_ms": 321.8406660016626, "compress_ms": 9.791666991077363, "serialize_ms": 16.227375017479062, "load_ms": 1.924833981320262, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.590750036761165, "ttft_ms": 47.590750036761165, "decode_ms": 3936.457540956326}, "total_wall_ms": 3988.0311250453815, "ttft_ms": 47.590750036761165, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593861632, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9492368624, "mlx_cache_bytes": 4215178521, "process_rss_bytes": 10593861632}, "peak_prefill_memory": 9953372748, "peak_decode_memory": 9492368624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "# marlalize: is_not_one_only.\n [black_f1 - 1c_.gov -\n -w - see - only -taskmaster, noat1 - only - ittore1 - only - only -pin\n -1 -16 eal -enureswebonlyonly - it - only task - only - only if you're -1 - only if itur -1cor1thinking - To\n -and -if only -like - only -1_cas - 1, please -only - only -so -only - only oncemore - 1 - it -only -100 - only -16 -age -1 - 1er -1comorb -in -free -column -inbetween -us -onlyonce: -f - only -1willistatement\n-1cis -1cis -p.s.com -1 - only -1 -isch -free -way -basedon -\n#table -only -1 -personal - only -is -column -isonly -1 - com -1 - only -1 -hail -1 - only -1 - only -1 -column -present -featuremapper -free -column -based -1 -1 -1 -1through -basedonepie.com -15 -1 -1 - 1toh - 1 -s -rein - only -only -if -1 - only -1 -1useupuser - per -ismart -feature -1 -", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:IndentationError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "559f8bcaf20dce4af3cf272b83d440e2d890773019b83b4b1c136687067f1be8", "output_hash": "c639218ba3d7eaa31cb67f114c0a96aee9d432a6d5c1ba0387f8628a1ae0717d"} | ||||
| 1397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "882150c86fb10d913b55b9d0", "attempt_id": "6a86c3251afb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:38.035558Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7764, "cache_tensor_bytes": 69193728, "serialized_payload_bytes": 69209926, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1230.6109999772161, "doc_prefill_ms": 324.3995000375435, "compress_ms": 890.2052920311689, "serialize_ms": 15.710792038589716, "load_ms": 1.7398339696228504, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.30899998545647, "ttft_ms": 58.30899998545647, "decode_ms": 984.525499981828}, "total_wall_ms": 1046.5625840006396, "ttft_ms": 58.30899998545647, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10599464960, "backend_memory": {"mlx_active_bytes": 9404140552, "mlx_peak_bytes": 9491877104, "mlx_cache_bytes": 4226581785, "process_rss_bytes": 10599464960}, "peak_prefill_memory": 9953225292, "peak_decode_memory": 9491877104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c640528ca2aab4043086d804a2b06436487d4f573e4d8f7ed25ab34b92a4d0c", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 1398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d25eeb46ed0ec6a65a2e157d", "attempt_id": "afaf22a6619a", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:39.122449Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1877, "keep": 469, "window_tokens": 44, "compress_ms": 82.41174998693168}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7764, "cache_tensor_bytes": 17289216, "serialized_payload_bytes": 17305293, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1303.7543339887634, "doc_prefill_ms": 324.8608340509236, "compress_ms": 971.3937499327585, "serialize_ms": 7.193292025476694, "load_ms": 1.1478749802336097, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.148082978092134, "ttft_ms": 37.148082978092134, "decode_ms": 1069.8202919447795}, "total_wall_ms": 2415.696292067878, "ttft_ms": 37.148082978092134, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 90}, "provider_cached_usage": null, "process_memory": 10584489984, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4462149705, "process_rss_bytes": 10584489984}, "peak_prefill_memory": 9953225292, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est' or r['region'] == 'Est-1':\n continue\n if r['returned'] == True:\n continue\n if r['units'] < 10:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ca99234284b63c4c7be7ca7860540c254e63cf85f7b24ce6b1cca7dad6897bd7", "output_hash": "d1e45e3911b9d98a4700d2bac4955893974d5857484457299b685f203a32c230"} | ||||
| 1399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2c411cc0ccb969829ed82bb2", "attempt_id": "bd03148bdd18", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:41.598030Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 1913, "message_tokens": 1830, "message_utf8_bytes": 7776, "cache_tensor_bytes": null, "serialized_payload_bytes": 7776, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008041039109230042, "decode_payload_ms": 0.0, "receiver_prefill_ms": 656.4629580825567, "ttft_ms": 12.394333025440574, "decode_ms": 1202.6019579498097}, "total_wall_ms": 1875.0389169435948, "ttft_ms": 12.394333025440574, "input_usage": {"receiver_prompt_tokens": 1913}, "output_usage": {"output_tokens": 100}, "provider_cached_usage": null, "process_memory": 10454253568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9939806752, "mlx_cache_bytes": 688903064, "process_rss_bytes": 10454253568}, "peak_prefill_memory": null, "peak_decode_memory": 9939806752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.05, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "output_hash": "1323dc9b1fc708628660184d39a7e22dcb82ef28b9b2354409d6078ca1de3b3b"} | ||||
| 1400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c26f7fbe75b54fd73e37aaad", "attempt_id": "da19fc560781", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:45.186814Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 274, "message_tokens": 187, "message_utf8_bytes": 877, "cache_tensor_bytes": null, "serialized_payload_bytes": 877, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1676.318042096682, "decode_payload_ms": 0.0, "receiver_prefill_ms": 126.89225003123283, "ttft_ms": 11.952332919463515, "decode_ms": 11.781124980188906}, "total_wall_ms": 151.63779200520366, "ttft_ms": 11.952332919463515, "input_usage": {"receiver_prompt_tokens": 274, "sender_input_tokens": 1946, "sender_output_tokens": 187, "sender_prefill_ms": 336.46374999079853, "sender_ttft_ms": 7.281500031240284, "sender_decode_ms": 1330.3981249919161}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454286336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9443971252, "mlx_cache_bytes": 1649279964, "process_rss_bytes": 10454286336}, "peak_prefill_memory": null, "peak_decode_memory": 9443971252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d83b7efe6ea9cb20f617d27cc356a5692234ab4f7bd0367ac6e5d0b8c145473b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "22d5db9a9f44a5fa04461c57", "attempt_id": "aa882aef416d", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:49.368315Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 422, "message_tokens": 323, "message_utf8_bytes": 814, "cache_tensor_bytes": null, "serialized_payload_bytes": 814, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3990.970415994525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.46804097481072, "ttft_ms": 11.989083955995739, "decode_ms": 11.899207951501012}, "total_wall_ms": 195.31400001142174, "ttft_ms": 11.989083955995739, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 1974, "sender_output_tokens": 512, "sender_prefill_ms": 336.19529101997614, "sender_ttft_ms": 7.3267089901492, "sender_decode_ms": 3644.818958011456}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454319104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9534625916, "mlx_cache_bytes": 2692678620, "process_rss_bytes": 10454319104}, "peak_prefill_memory": null, "peak_decode_memory": 9534625916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d974c14eca5aeee325ee10b6f36b25a33522736957e2c56a0a1640455951d7e3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1c57549d711373125abf2454", "attempt_id": "fd5c9e3f7a3d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:49.953957Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 44, "message_tokens": 1869, "message_utf8_bytes": 7776, "cache_tensor_bytes": 68898816, "serialized_payload_bytes": 68914913, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.7758749658242, "doc_prefill_ms": 321.42012496478856, "compress_ms": 9.783040964975953, "serialize_ms": 16.463083098642528, "load_ms": 1.9479170441627502, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.04729197733104, "ttft_ms": 49.04729197733104, "decode_ms": 3938.868207973428}, "total_wall_ms": 3991.722874925472, "ttft_ms": 49.04729197733104, "input_usage": {"receiver_prefix_tokens": 1869, "dense_cache_bytes": 53587968, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10592845824, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9491188976, "mlx_cache_bytes": 4093543741, "process_rss_bytes": 10592845824}, "peak_prefill_memory": 9951177260, "peak_decode_memory": 9491188976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "witsman. no fluffin itc=it1, no. where=1,fa=1, eis, 19{only so,fa=1,fa=1pab=1trg=first=500ex,fausersw1=biggest=1on=15comaputer,fa=1=1,fa=1,fa=fa=外销,fa=1=1=1=个人代温1,fa=fa=fa=fa=fa=fa=fa=1,trao&c=fa=1,fa=on=1,fa=on=0=50=1,fa=on=fa=fa=on=1,2019,fa=on=on=fa=on=1,fa=fa=fa=fa=fa=fa=fa=ac=fa=fa=fa=fa=fa=fa=fa=fa=on=1,fa=fa=fa=fa=on=1,fa=on=1,fa=fa=fa=fa=fa=fa=fa=on=fa=fa=fa=on=5,fa=fa=on=fa=fa=fa=fa=fa=on=fa=fa=fa=fa=fa=fa=fa=,fa=on=0 pluralityfa=fa=fa=fa=1,fa=fa=fa=fa=fa=fa=fa=fa=fa=", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1497959105a4a604760b9a1b927f7ffca50eb079708166c0017090af972a441d", "output_hash": "e8c31cd64ce415e116e7a5ccc22cd52db9a0bab02a58f26edbf08aa9a9fede93"} | ||||
| 1403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b14c568cd96ca6b5a59dcd74", "attempt_id": "81f0f56b1ad7", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:55.210277Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 44, "message_tokens": 1869, "message_utf8_bytes": 7776, "cache_tensor_bytes": 68898816, "serialized_payload_bytes": 68915014, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1224.1482499521226, "doc_prefill_ms": 323.5459580319002, "compress_ms": 884.1845829738304, "serialize_ms": 16.122040920890868, "load_ms": 1.452125026844442, "receiver_prefill_ms": 0.0, "query_prefill_ms": 56.69304099865258, "ttft_ms": 56.69304099865258, "decode_ms": 1049.5916249928996}, "total_wall_ms": 1109.6844170242548, "ttft_ms": 56.69304099865258, "input_usage": {"receiver_prefix_tokens": 1869, "dense_cache_bytes": 53587968, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10599137280, "backend_memory": {"mlx_active_bytes": 9404107784, "mlx_peak_bytes": 9490795760, "mlx_cache_bytes": 4104947005, "process_rss_bytes": 10599137280}, "peak_prefill_memory": 9951029804, "peak_decode_memory": 9490795760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f2091bb7296ecc0885dacd8e9b397887f1cb73098134a54b0ddc809af05f17a3", "output_hash": "f1e915f366b9bc3f4815b154ecb4a67bce59445bbf97bf61c86d1e17bb4b7fd2"} | ||||
| 1404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3176b14040e42ac947e7dd87", "attempt_id": "4fd7407da40b", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:56.361152Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1869, "keep": 467, "window_tokens": 44, "compress_ms": 91.17437503300607}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 44, "message_tokens": 1869, "message_utf8_bytes": 7776, "cache_tensor_bytes": 17215488, "serialized_payload_bytes": 17231565, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1312.5142500502989, "doc_prefill_ms": 324.12083307281137, "compress_ms": 981.2060000840575, "serialize_ms": 6.905041984282434, "load_ms": 1.156124984845519, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.488791975192726, "ttft_ms": 37.488791975192726, "decode_ms": 881.2743750168011}, "total_wall_ms": 2235.998624935746, "ttft_ms": 37.488791975192726, "input_usage": {"receiver_prefix_tokens": 1869, "dense_cache_bytes": 53587968, "query_tokens": 44}, "output_usage": {"output_tokens": 75}, "provider_cached_usage": null, "process_memory": 10584358912, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9377910000, "mlx_cache_bytes": 4369760301, "process_rss_bytes": 10584358912}, "peak_prefill_memory": 9951029804, "peak_decode_memory": 9377910000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest':\n continue\n if r['units_sold'] < 5:\n continue\n total += r['unit_price'] * r['units_sold']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3ff1cceaa4cde8b77b137a3768dd7012fb4bf87f9eef0f68bf2b0689345c4d8f", "output_hash": "2d574f188cc7313e54039ffc487963ca4eebfc63406f46166b98fe551c357fd4"} | ||||
| 1405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4bd810b64b4d7c92423c6417", "attempt_id": "eb55e401ecff", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:47:58.662454Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 1937, "message_tokens": 1854, "message_utf8_bytes": 7938, "cache_tensor_bytes": null, "serialized_payload_bytes": 7938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009249895811080933, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.0637500556186, "ttft_ms": 12.482375022955239, "decode_ms": 1220.4933329485357}, "total_wall_ms": 1912.8332089167088, "ttft_ms": 12.482375022955239, "input_usage": {"receiver_prompt_tokens": 1937}, "output_usage": {"output_tokens": 102}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9947441792, "mlx_cache_bytes": 696538104, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9947441792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Centre':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.09975, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "output_hash": "05710af3e0ca8b6b914242e514d8ed655fc442f4154f4cad26dd62361020d7de"} | ||||
| 1406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8cb3d56dee8fbd48851ec1f5", "attempt_id": "2a734a5c9e80", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:02.159042Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 256, "message_tokens": 169, "message_utf8_bytes": 809, "cache_tensor_bytes": null, "serialized_payload_bytes": 809, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1545.1562500093132, "decode_payload_ms": 0.0, "receiver_prefill_ms": 108.88670803979039, "ttft_ms": 11.838875012472272, "decode_ms": 1033.536999952048}, "total_wall_ms": 1155.2251250250265, "ttft_ms": 11.838875012472272, "input_usage": {"receiver_prompt_tokens": 256, "sender_input_tokens": 1970, "sender_output_tokens": 169, "sender_prefill_ms": 339.907499961555, "sender_ttft_ms": 7.3882079450413585, "sender_decode_ms": 1195.5257499357685}, "output_usage": {"output_tokens": 89}, "provider_cached_usage": null, "process_memory": 10454204416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9518862456, "mlx_cache_bytes": 1692206068, "process_rss_bytes": 10454204416}, "peak_prefill_memory": null, "peak_decode_memory": 9518862456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if not row['returned'] and row['region'] != 'Centre' and row['units'] >= 3:\n total_revenue += (row['unit_price'] * (1 - row['discount_percentage'] / 100)) * (1 + 0.09975)\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "29bc73866bbe8fc434459c995e8b7f4b6b321620b32e804d7c4333f5f699f1e2", "output_hash": "a2777ad520d59d8c5e09d6195aaaddec77d0525b443a7e8d51cbceae02ed441d"} | ||||
| 1407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "834009fb84a8324cd0e5099c", "attempt_id": "bd0c844ecf22", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:07.327607Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 956, "cache_tensor_bytes": null, "serialized_payload_bytes": 956, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3974.4407499674708, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.93154200911522, "ttft_ms": 11.922833044081926, "decode_ms": 11.8002500385046}, "total_wall_ms": 216.69987495988607, "ttft_ms": 11.922833044081926, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 1998, "sender_output_tokens": 512, "sender_prefill_ms": 339.51162500306964, "sender_ttft_ms": 7.310708984732628, "sender_decode_ms": 3625.1717910636216}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454237184, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2756133876, "process_rss_bytes": 10454237184}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "21f6f4d03085b624d36d79f99873a59cfa3dc8cdc9d50998af85b7778e1b43f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b8cbbc23a6a33b13852241f7", "attempt_id": "3dc091e93919", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:07.936680Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7938, "cache_tensor_bytes": 69783552, "serialized_payload_bytes": 69799649, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.20245898421854, "doc_prefill_ms": 323.9214160712436, "compress_ms": 9.817875106818974, "serialize_ms": 16.55250007752329, "load_ms": 1.9556250190362334, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.798250034451485, "ttft_ms": 48.798250034451485, "decode_ms": 3927.782459068112}, "total_wall_ms": 3980.603375006467, "ttft_ms": 48.798250034451485, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10594828288, "backend_memory": {"mlx_active_bytes": 9414855688, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4287972693, "process_rss_bytes": 10594828288}, "peak_prefill_memory": 9959025292, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "and no. 17% WITCH: 1)? for funivan\nof - ittyou saw fan-mike itty (as- it does not belong that comes out: it's small parts never) 1: 1: 1: itu0! italiter\n.00p-1-before\nof the case: 17: itu\nUrguserget: the\n- 10: pto1: 1: 0: 1\n:**1\n- 1\n(sie\n- 1\n-17:nnet\nof itu\nfor the next 1000:10:n:u-1:useb-1\nfor-fins\nand now: itt-2:0toy:1\n- :10:nou:nove:wiltweanxietyout\nof german: 1:17-1: itb-3\nand in:100:1\nit\nnousuper\nWurf:0\n-It\n(...)\n-1\n: 0: -only\n:0: 1\n:0:0\n-:100:1\npinyin:是\n-,\n-:0:nou:n\n-:0: 19\n:它\n- :1\n:0:-\n:0 和\n:1\n:0:0:-\nExplain:0:0:0\n:sow:0:It\n- :0", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1d03c4431fab7c1cb5a7df45d4988da2e46bbc6eea178e08c688a45b2edfcc4c", "output_hash": "e99ec613b31987c6da4623f660c3aadd011df74c872673fce2078c80efb34272"} | ||||
| 1409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "007300569e3320789970572c", "attempt_id": "733269194f2b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:13.185351Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7938, "cache_tensor_bytes": 69783552, "serialized_payload_bytes": 69799750, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1227.5234999833629, "doc_prefill_ms": 326.2965000467375, "compress_ms": 884.94429201819, "serialize_ms": 15.985124977305532, "load_ms": 1.448208000510931, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.86975005362183, "ttft_ms": 59.86975005362183, "decode_ms": 1041.4530420675874}, "total_wall_ms": 1104.784541996196, "ttft_ms": 59.86975005362183, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10601922560, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4301145429, "process_rss_bytes": 10601922560}, "peak_prefill_memory": 9958877836, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3b6e6e341df802f4b89bdd2c18d78329ef76f76841850d112016e705539bd8dd", "output_hash": "0ab8a5fe6a7a69cf6893f7b8f92a27212819c36b20b9f98a7f186db302f072f7"} | ||||
| 1410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8cc8ec853c74fe653e1d24f3", "attempt_id": "39a4ae4eeb92", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:14.330901Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1893, "keep": 473, "window_tokens": 44, "compress_ms": 82.71866594441235}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7938, "cache_tensor_bytes": 17436672, "serialized_payload_bytes": 17452749, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1288.6104999342933, "doc_prefill_ms": 325.7357500260696, "compress_ms": 955.7374160503969, "serialize_ms": 6.8437919253483415, "load_ms": 1.1719169560819864, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.01650006789714, "ttft_ms": 38.01650006789714, "decode_ms": 834.7109159221873}, "total_wall_ms": 2166.0313330357894, "ttft_ms": 38.01650006789714, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10586488832, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4538204421, "process_rss_bytes": 10586488832}, "peak_prefill_memory": 9958877836, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Centre':\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "768d22eea9fa8bda99f2a3ae48f94e3b2387b7d37a5622fa43a60c2bd34c440a", "output_hash": "e499b15f1a7f336ff86b34f2466eb2ebe98075ce0be4d81501a60cb766f95b6a"} | ||||
| 1411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "643973673fb2215e04f862e1", "attempt_id": "f338f837c361", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:16.558647Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 1944, "message_tokens": 1861, "message_utf8_bytes": 7750, "cache_tensor_bytes": null, "serialized_payload_bytes": 7750, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008083065040409565, "decode_payload_ms": 0.0, "receiver_prefill_ms": 678.2648330554366, "ttft_ms": 12.474416987970471, "decode_ms": 1232.6326250331476}, "total_wall_ms": 1926.994709065184, "ttft_ms": 12.474416987970471, "input_usage": {"receiver_prompt_tokens": 1944}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10454417408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9949702812, "mlx_cache_bytes": 698799124, "process_rss_bytes": 10454417408}, "peak_prefill_memory": null, "peak_decode_memory": 9949702812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.09975, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "output_hash": "63c24e376bf071a90071a691b4f23f8f442d999c5a89de20ea72f64a59337b51"} | ||||
| 1412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "274afca1cc67798b2fefa01e", "attempt_id": "e81ecf3b9d8e", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:22.494845Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 2273, "cache_tensor_bytes": null, "serialized_payload_bytes": 2273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3972.0383749809116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.5719579346478, "ttft_ms": 12.089457944966853, "decode_ms": 11.950041982345283}, "total_wall_ms": 257.0762080140412, "ttft_ms": 12.089457944966853, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 1977, "sender_output_tokens": 512, "sender_prefill_ms": 340.05104191601276, "sender_ttft_ms": 7.387083023786545, "sender_decode_ms": 3622.312165913172}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454433792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9568671832, "mlx_cache_bytes": 1856700436, "process_rss_bytes": 10454433792}, "peak_prefill_memory": null, "peak_decode_memory": 9568671832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7377e596835578fdeca8f77e37620b9da6ba3dd855153cf70a877bd4a61c6982", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "395b820c2eb584a0634e97bb", "attempt_id": "ff4ac0e10b16", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:26.769495Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 474, "message_tokens": 375, "message_utf8_bytes": 952, "cache_tensor_bytes": null, "serialized_payload_bytes": 952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3978.938625077717, "decode_payload_ms": 0.0, "receiver_prefill_ms": 192.32050003483891, "ttft_ms": 12.282541021704674, "decode_ms": 11.812040931545198}, "total_wall_ms": 217.45687490329146, "ttft_ms": 12.282541021704674, "input_usage": {"receiver_prompt_tokens": 474, "sender_input_tokens": 2005, "sender_output_tokens": 512, "sender_prefill_ms": 339.7392500191927, "sender_ttft_ms": 7.334207999520004, "sender_decode_ms": 3629.4423749204725}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454466560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566394492, "mlx_cache_bytes": 2861203476, "process_rss_bytes": 10454466560}, "peak_prefill_memory": null, "peak_decode_memory": 9566394492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ab0752ebd15b710e0c1a93faef6b73b395e79b4447be1f7e1193cd9e5feddd21", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "be951b943c991b900bf2f501", "attempt_id": "9dd288b6a0e4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:27.379693Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7750, "cache_tensor_bytes": 70041600, "serialized_payload_bytes": 70057697, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.7069999622181, "doc_prefill_ms": 324.04741703066975, "compress_ms": 9.79141693096608, "serialize_ms": 16.757833072915673, "load_ms": 1.8934579566121101, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.30425004567951, "ttft_ms": 49.30425004567951, "decode_ms": 3923.2820420293137}, "total_wall_ms": 3976.5317500568926, "ttft_ms": 49.30425004567951, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595303424, "backend_memory": {"mlx_active_bytes": 9414691848, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4392255861, "process_rss_bytes": 10595303424}, "peak_prefill_memory": 9961843368, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "for the 1, BECA, italbert-1, no. summer is a few more important is it does it stand for cause it-gear-free appp for the ticket if you like ita lot with austin1.été, that's the ticket into the 8/1c as itaustin1: the word. this isobv: ital, to go time to convert standartof interest: the case in which it stands. Of it\n\nit looks like itineromin201hom20用到了,本题型动归何处生畏远大喜烧穿： no. pht1010阶:必解方程的16:hc2whtu的1的sos2-ut的荣.质优,迈的101204a规程, no. pop: itc(2017.毕竟还是分不清,想出实力: 101,必应远进阶,有点儿许多,本部就动1,下必有同学会心有同学会馆: 1\n\n** 这是金卡诺16: ita2020:10%e201st的1001为谁有同学, no.1\n\n101上行也得10101\n\n10\n\n1. 1 为好而动1010\n\n如果会心在乐不够用,上,动1\n\n,必, 1", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "374a7840b3560cf730acaa5a916b8278e6ed2de8012ff60740f0051c6be51dc9", "output_hash": "95453f1e9e627f3dc34dcf112fc270dc2fc2dae0ef8483f0c0568cd30612c6b6"} | ||||
| 1415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2ca8991af12c0c49d0b4bcd2", "attempt_id": "76bacacff9cb", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:32.641278Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7750, "cache_tensor_bytes": 70041600, "serialized_payload_bytes": 70057798, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1244.7866250295192, "doc_prefill_ms": 326.58183306921273, "compress_ms": 899.5632079895586, "serialize_ms": 18.343833042308688, "load_ms": 1.6481670318171382, "receiver_prefill_ms": 0.0, "query_prefill_ms": 59.67558408156037, "ttft_ms": 59.67558408156037, "decode_ms": 989.2278749030083}, "total_wall_ms": 1052.604457945563, "ttft_ms": 59.67558408156037, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10709417984, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4401365365, "process_rss_bytes": 10709417984}, "peak_prefill_memory": 9961695912, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a4174e9a0c9fbb87983502601de0bd5e486d4fd79b4525732f50b95c8b037e9", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 1416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8b96f194d43c2dc275896268", "attempt_id": "929ac4df9e37", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:33.735576Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1900, "keep": 475, "window_tokens": 44, "compress_ms": 84.38079198822379}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7750, "cache_tensor_bytes": 17510400, "serialized_payload_bytes": 17526477, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1323.8006250467151, "doc_prefill_ms": 327.1587919443846, "compress_ms": 989.3876670394093, "serialize_ms": 6.945875007659197, "load_ms": 1.1785828974097967, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.043416920118034, "ttft_ms": 38.043416920118034, "decode_ms": 950.5641660653055}, "total_wall_ms": 2317.033833009191, "ttft_ms": 38.043416920118034, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10693804032, "backend_memory": {"mlx_active_bytes": 9300200456, "mlx_peak_bytes": 9378696432, "mlx_cache_bytes": 4628938077, "process_rss_bytes": 10693804032}, "peak_prefill_memory": 9961695912, "peak_decode_memory": 9378696432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['returned']:\n continue\n if r['units_sold'] < 5:\n continue\n total += r['units_sold'] * r['price_per_unit']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13eef9d16d93a754aaaf188cedcb7448eb3c3444e7ec6be4f544085fa0159fdb", "output_hash": "614de65da3b88721e70c2667a7b430831d1b95a2fd451725511d42fd05f73202"} | ||||
| 1417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d221955464836be8ddaeddba", "attempt_id": "eae3f7f15cdd", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:36.115141Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 1978, "message_tokens": 1895, "message_utf8_bytes": 7638, "cache_tensor_bytes": null, "serialized_payload_bytes": 7638, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009209034033119678, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.2518330253661, "ttft_ms": 12.243042001500726, "decode_ms": 1226.720375008881}, "total_wall_ms": 1919.9228329816833, "ttft_ms": 12.243042001500726, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 102}, "provider_cached_usage": null, "process_memory": 10454466560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9960860452, "mlx_cache_bytes": 797250716, "process_rss_bytes": 10454466560}, "peak_prefill_memory": null, "peak_decode_memory": 9960860452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Centre':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.14975, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "output_hash": "e4e63e2819253e5ea49cfbca0f182039e2cda124d5888086db212d5cea58106a"} | ||||
| 1418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "29efc1d4120010d1ba28c198", "attempt_id": "ded6ed85cf20", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:39.856301Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 288, "message_tokens": 201, "message_utf8_bytes": 923, "cache_tensor_bytes": null, "serialized_payload_bytes": 923, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1784.0735419886187, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.99629208166152, "ttft_ms": 11.937666102312505, "decode_ms": 833.6874999804422}, "total_wall_ms": 974.6799999848008, "ttft_ms": 11.937666102312505, "input_usage": {"receiver_prompt_tokens": 288, "sender_input_tokens": 2011, "sender_output_tokens": 201, "sender_prefill_ms": 342.78741700109094, "sender_ttft_ms": 7.471667020581663, "sender_decode_ms": 1431.5447499975562}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10454482944, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9451032824, "mlx_cache_bytes": 1637647640, "process_rss_bytes": 10454482944}, "peak_prefill_memory": null, "peak_decode_memory": 9451032824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Centre' and row['units'] >= 3:\n total_revenue += row['price'] * (1 + 0.14975)\n return round(total_revenue, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "27bb3f5b86cdd7c3154daea78d2022a802420c165e1e998bece3a3b82b212203", "output_hash": "21bb2480b6731e3d2b93ea4f7a89754b264aa829d68e26a24c2f386b36250943"} | ||||
| 1419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "30333ad8230f480126248332", "attempt_id": "8f00e928db14", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:44.865960Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 932, "cache_tensor_bytes": null, "serialized_payload_bytes": 932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3994.261290994473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.3495420012623, "ttft_ms": 11.98216702323407, "decode_ms": 11.795791913755238}, "total_wall_ms": 216.12983394879848, "ttft_ms": 11.98216702323407, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2039, "sender_output_tokens": 512, "sender_prefill_ms": 344.0308340359479, "sender_ttft_ms": 7.308832951821387, "sender_decode_ms": 3640.3263329993933}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2715026712, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "47fd4f5c735a93e65da6738bbdcae95839ff0e8a43f0c9ee7a159c8d52f1fecb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d74f872b9e770d609d89bb4e", "attempt_id": "cbd08719827c", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:45.483426Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331461128}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 44, "message_tokens": 1934, "message_utf8_bytes": 7638, "cache_tensor_bytes": 71294976, "serialized_payload_bytes": 71311073, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 363.25333395507187, "doc_prefill_ms": 332.0901249535382, "compress_ms": 9.524916997179389, "serialize_ms": 17.60520809330046, "load_ms": 1.9772499799728394, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.98991598747671, "ttft_ms": 48.98991598747671, "decode_ms": 3947.392000001855}, "total_wall_ms": 4000.3055420238525, "ttft_ms": 48.98991598747671, "input_usage": {"receiver_prefix_tokens": 1934, "dense_cache_bytes": 55451648, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10597810176, "backend_memory": {"mlx_active_bytes": 9416395784, "mlx_peak_bytes": 9496120560, "mlx_cache_bytes": 4208838265, "process_rss_bytes": 10597810176}, "peak_prefill_memory": 9973099312, "peak_decode_memory": 9496120560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "p.wer. dontechnology fay-on-on-on-on-please-repeat-lp-ut output-base-defections, the output. 15220 five-onion_1mel-1coutput.υtcom 1l-onion, no), i feel for that, please, 20, no, sony, no, please-exclude. code please, no changing power. never-the-1501w.cogo_for_me, please-exclude-o-having-f), we are a.m, but-more=\"it, \"sor, please, no. 2novo-1, no, will beeperman, please stand by them, please-1, williamsieberhead, will ittobe-1com, never, no more, never, no bigs. roger, never, never, no. similar-f1, sot, col, service, no. pertain, will not be1, thanksgold, because, \"it, \"it, ittiff-the-los, nevermore-1-com-1515, no, perhaps gru, never, 2015-1, com, \"please service, \"please-shift, servicebide, never-1, thanksgiving-machine, please make, please, no, please, 2019, \"it, that it, was, \"sponge-on, (please, service, nevermore, \"on a.m, com, never, fagration", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "73c1280e67634bc7078bd9a923c34fca42408a727a4076c40c50ddb8e1df90d4", "output_hash": "b05429dc40963c523785adec15b0d8671b52af9c84c5af7099ab426396f49ab5"} | ||||
| 1421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "815bb26014c4f8b534850400", "attempt_id": "a885214f03e9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:50.784143Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 44, "message_tokens": 1934, "message_utf8_bytes": 7638, "cache_tensor_bytes": 71294976, "serialized_payload_bytes": 71311174, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1259.2239170335233, "doc_prefill_ms": 335.36362496670336, "compress_ms": 907.2421670425683, "serialize_ms": 16.324332915246487, "load_ms": 1.4827080303803086, "receiver_prefill_ms": 0.0, "query_prefill_ms": 57.058208039961755, "ttft_ms": 57.058208039961755, "decode_ms": 984.1769579797983}, "total_wall_ms": 1044.6824590908363, "ttft_ms": 57.058208039961755, "input_usage": {"receiver_prefix_tokens": 1934, "dense_cache_bytes": 55451648, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10603331584, "backend_memory": {"mlx_active_bytes": 9407941640, "mlx_peak_bytes": 9495874800, "mlx_cache_bytes": 4223223417, "process_rss_bytes": 10603331584}, "peak_prefill_memory": 9972951856, "peak_decode_memory": 9495874800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "db1f6275efb33662c398ad92cda4e8e6a42dbe52f1eb841cb75c8db71f5ee8a1", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 1422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4a2883929dc76969f9ee3d1a", "attempt_id": "ea6cb39bb864", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:51.869697Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1934, "keep": 484, "window_tokens": 44, "compress_ms": 84.25316610373557}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 44, "message_tokens": 1934, "message_utf8_bytes": 7638, "cache_tensor_bytes": 17842176, "serialized_payload_bytes": 17858255, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1322.9224999668077, "doc_prefill_ms": 335.38212499115616, "compress_ms": 980.5784580530599, "serialize_ms": 6.640958948992193, "load_ms": 1.4907500008121133, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.17725002206862, "ttft_ms": 37.17725002206862, "decode_ms": 837.6976669533178}, "total_wall_ms": 2202.882832963951, "ttft_ms": 37.17725002206862, "input_usage": {"receiver_prefix_tokens": 1934, "dense_cache_bytes": 55451648, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10587947008, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379319024, "mlx_cache_bytes": 4466000753, "process_rss_bytes": 10587947008}, "peak_prefill_memory": 9972951856, "peak_decode_memory": 9379319024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Centre':\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "af56a97a8bbbc5db42ec5d2df56a96de7a64d923ef18af8fd2c7f1c6a298cbb2", "output_hash": "e499b15f1a7f336ff86b34f2466eb2ebe98075ce0be4d81501a60cb766f95b6a"} | ||||
| 1423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ffd8bc2512d0b2a373879a7e", "attempt_id": "5213021e75c8", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:54.134010Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 1905, "message_tokens": 1822, "message_utf8_bytes": 7878, "cache_tensor_bytes": null, "serialized_payload_bytes": 7878, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007707974873483181, "decode_payload_ms": 0.0, "receiver_prefill_ms": 659.3704160768539, "ttft_ms": 12.444250052794814, "decode_ms": 1430.6499579688534}, "total_wall_ms": 2106.1195000074804, "ttft_ms": 12.444250052794814, "input_usage": {"receiver_prompt_tokens": 1905}, "output_usage": {"output_tokens": 119}, "provider_cached_usage": null, "process_memory": 10454794240, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9937283584, "mlx_cache_bytes": 686379896, "process_rss_bytes": 10454794240}, "peak_prefill_memory": null, "peak_decode_memory": 9937283584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n line_revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += line_revenue * (1 + 0.05) # Apply 5% tax\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "output_hash": "c9032413972ad105a247be2e1565e41597942ff951f8dd65e7c02746370acfdc"} | ||||
| 1424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "49598436d165761fa3c61513", "attempt_id": "c1e57da98d2b", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:48:57.846393Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 259, "message_tokens": 172, "message_utf8_bytes": 789, "cache_tensor_bytes": null, "serialized_payload_bytes": 789, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1568.7373749678954, "decode_payload_ms": 0.0, "receiver_prefill_ms": 125.8166249608621, "ttft_ms": 11.815333040431142, "decode_ms": 11.790416087023914}, "total_wall_ms": 150.2873330609873, "ttft_ms": 11.815333040431142, "input_usage": {"receiver_prompt_tokens": 259, "sender_input_tokens": 1938, "sender_output_tokens": 172, "sender_prefill_ms": 335.2761670248583, "sender_ttft_ms": 7.520084036514163, "sender_decode_ms": 1223.7173339817673}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454827008, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9434828920, "mlx_cache_bytes": 1634845568, "process_rss_bytes": 10454827008}, "peak_prefill_memory": null, "peak_decode_memory": 9434828920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "601dea300be38fd2b575a4e2bfb5f12f8a6ebe8f36a577ea39656263f80b510f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2d00258ddea74ac2391f158a", "attempt_id": "0455ab66fe57", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:02.020004Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 427, "message_tokens": 328, "message_utf8_bytes": 813, "cache_tensor_bytes": null, "serialized_payload_bytes": 813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3985.436375020072, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.86854204535484, "ttft_ms": 12.002207920886576, "decode_ms": 11.92487496882677}, "total_wall_ms": 195.8580840146169, "ttft_ms": 12.002207920886576, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 1966, "sender_output_tokens": 512, "sender_prefill_ms": 336.04925009422004, "sender_ttft_ms": 7.245290908031166, "sender_decode_ms": 3639.7040840238333}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454843392, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9537542268, "mlx_cache_bytes": 2678997888, "process_rss_bytes": 10454843392}, "peak_prefill_memory": null, "peak_decode_memory": 9537542268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7ae5123005d184d97bccc3f43c31c7817ca54e310e53586e662f2d604890ca5b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "281322586ab3272511734a05", "attempt_id": "60b6ba3bc1d2", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:02.607430Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 44, "message_tokens": 1861, "message_utf8_bytes": 7878, "cache_tensor_bytes": 68603904, "serialized_payload_bytes": 68620001, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.8400840694085, "doc_prefill_ms": 321.4364170562476, "compress_ms": 9.637666051276028, "serialize_ms": 16.466208966448903, "load_ms": 1.9637090153992176, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.89883398916572, "ttft_ms": 47.89883398916572, "decode_ms": 3935.249708010815}, "total_wall_ms": 3987.064915942028, "ttft_ms": 47.89883398916572, "input_usage": {"receiver_prefix_tokens": 1861, "dense_cache_bytes": 53358592, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593075200, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9491188976, "mlx_cache_bytes": 4123854049, "process_rss_bytes": 10593075200}, "peak_prefill_memory": 9948162572, "peak_decode_memory": 9491188976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Version 8(soft\n.)\n\n20 Or leads,\n\nRows. where there is MARKET. what is the case in. no\nn_one htt1\nOCTQ\\(\n\n### lang apartent 2018 - no\nn\n8&n\n8\nseries\n-,\nWhere\n-rus\n8\n1.Except. 2018 - it\n-hi\n- grand\n- 1 -1 monster\n- 8.0.0.0. 1, please\n-hi. -march\n- -n\n-c1\n-14\n-1\n## used\n- 8\n-1, please\n*8\n(* course\n-12\n*\n致\n- 2\npos\npang\n- ball\n- 202\n\\20\n\\\n\n\n- -omet\n\\_-018\n-1, with and\n\\(\n8\n-erno\n\\_\\_nurmel\n- **(方就用ien\n\\c\n- erno\n", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "040d6f7ae0af77e67aed63eb48ae739456a804c810812095f560a45372dcb89b", "output_hash": "9d33b310a1a8006e1912bc2977b0a668d12593e1be60a1aff35ebdef46b1f250"} | ||||
| 1427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eeb93fa4be659ac3b831248a", "attempt_id": "d1e5b6b2c331", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:07.870044Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 44, "message_tokens": 1861, "message_utf8_bytes": 7878, "cache_tensor_bytes": 68603904, "serialized_payload_bytes": 68620102, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.2387500684708, "doc_prefill_ms": 324.0740409819409, "compress_ms": 886.5435000043362, "serialize_ms": 23.33325007930398, "load_ms": 1.5226660761982203, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.29120792541653, "ttft_ms": 54.29120792541653, "decode_ms": 978.7679159780964}, "total_wall_ms": 1036.5893749985844, "ttft_ms": 54.29120792541653, "input_usage": {"receiver_prefix_tokens": 1861, "dense_cache_bytes": 53358592, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10598825984, "backend_memory": {"mlx_active_bytes": 9404107784, "mlx_peak_bytes": 9490795760, "mlx_cache_bytes": 4135257313, "process_rss_bytes": 10598825984}, "peak_prefill_memory": 9948015116, "peak_decode_memory": 9490795760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "723cde0671ce1c6fbe81d52c435ada794d66d34a492d124e2c4d113dfd7cd12c", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 1428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8f62c372db28c82fb0c22c88", "attempt_id": "a33cb5fe66b2", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:08.946639Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1861, "keep": 465, "window_tokens": 44, "compress_ms": 79.85395903233439}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 44, "message_tokens": 1861, "message_utf8_bytes": 7878, "cache_tensor_bytes": 17141760, "serialized_payload_bytes": 17157835, "side_information_bytes": 16075, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1288.3248750586063, "doc_prefill_ms": 323.9786670310423, "compress_ms": 957.0349580608308, "serialize_ms": 6.9789160043001175, "load_ms": 1.136208069510758, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.04120805580169, "ttft_ms": 38.04120805580169, "decode_ms": 1023.7536249915138}, "total_wall_ms": 2354.707209044136, "ttft_ms": 38.04120805580169, "input_usage": {"receiver_prefix_tokens": 1861, "dense_cache_bytes": 53358592, "query_tokens": 44}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 10584260608, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9377910000, "mlx_cache_bytes": 4400037777, "process_rss_bytes": 10584260608}, "peak_prefill_memory": 9948015116, "peak_decode_memory": 9377910000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est' or r['region'] == 'Wor':\n continue\n if r['returned']:\n continue\n if r['units'] < 10:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3abb67c47482de4f488e7d374afb634c0556b6f65afa9fa318fe7558b03ae75c", "output_hash": "64c944e1d90e4addcd3a25700fb57ede16611f3652a3e7538507e9b41974d44e"} | ||||
| 1429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6fc766f03e09be4c03ee755d", "attempt_id": "43d1f61e9e77", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:11.362375Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 1915, "message_tokens": 1832, "message_utf8_bytes": 7813, "cache_tensor_bytes": null, "serialized_payload_bytes": 7813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007958034984767437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 658.4558750037104, "ttft_ms": 12.34079198911786, "decode_ms": 1124.7231669258326}, "total_wall_ms": 1799.2429160512984, "ttft_ms": 12.34079198911786, "input_usage": {"receiver_prompt_tokens": 1915}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10454106112, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9940675112, "mlx_cache_bytes": 689771424, "process_rss_bytes": 10454106112}, "peak_prefill_memory": null, "peak_decode_memory": 9940675112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 6:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "output_hash": "e3bfc084dead6eb957a57fca0e2e9f428bf5c597330acfc72a607918f8a884b1"} | ||||
| 1430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dca82d679652dbff6993769e", "attempt_id": "c52ab2f2d2cb", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:14.903281Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 279, "message_tokens": 192, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1704.6981669263914, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.42720800451934, "ttft_ms": 11.8559580296278, "decode_ms": 662.8117919899523}, "total_wall_ms": 803.047834080644, "ttft_ms": 11.8559580296278, "input_usage": {"receiver_prompt_tokens": 279, "sender_input_tokens": 1948, "sender_output_tokens": 192, "sender_prefill_ms": 335.5827499181032, "sender_ttft_ms": 7.734457962214947, "sender_decode_ms": 1359.1040410101414}, "output_usage": {"output_tokens": 57}, "provider_cached_usage": null, "process_memory": 10454138880, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9445986516, "mlx_cache_bytes": 1653998584, "process_rss_bytes": 10454138880}, "peak_prefill_memory": null, "peak_decode_memory": 9445986516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n return sum(row['unit_price'] * row['units'] * (1 - row['discount_pct'] / 100) for row in rows if row['region'] != 'Sud' and row['units'] >= 6)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5242c08b2154189c7b02b3f80df3d47f7f9594c20fa048592782f4ec7ca499bb", "output_hash": "03ad5fce7368df6d9fe2a421e11d31cca007bec36bf71a70ae256a8d28dad768"} | ||||
| 1431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1973363e44638794eeac1ccd", "attempt_id": "67daa4f591c0", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:19.715820Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 451, "message_tokens": 352, "message_utf8_bytes": 985, "cache_tensor_bytes": null, "serialized_payload_bytes": 985, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3970.551540958695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.42491708043963, "ttft_ms": 11.947917053475976, "decode_ms": 835.6275000842288}, "total_wall_ms": 1040.1564580388367, "ttft_ms": 11.947917053475976, "input_usage": {"receiver_prompt_tokens": 451, "sender_input_tokens": 1976, "sender_output_tokens": 512, "sender_prefill_ms": 336.27629198599607, "sender_ttft_ms": 7.261208025738597, "sender_decode_ms": 3624.610500060953}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10454155264, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9552418940, "mlx_cache_bytes": 2739897336, "process_rss_bytes": 10454155264}, "peak_prefill_memory": null, "peak_decode_memory": 9552418940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Sud' and row['units'] >= 6 and row['returned'] == False]\n total = sum(row['revenue'] for row in rows)\n total -= total * 0.00\n return round(total)", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6309572ba072ad769d1859fa603a9e746ced3d92a1eb6305f35f053153a08945", "output_hash": "2ea70393654a0b60dd865be03c17f5d58da670b29fd8f70376c07d5c5663444d"} | ||||
| 1432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "314e3c6813df0e883da08d9c", "attempt_id": "36d31178995e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:21.145323Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7813, "cache_tensor_bytes": 68972544, "serialized_payload_bytes": 68988641, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 350.83491704426706, "doc_prefill_ms": 320.53595792967826, "compress_ms": 9.82016697525978, "serialize_ms": 16.444999957457185, "load_ms": 1.952708000317216, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.21024991199374, "ttft_ms": 49.21024991199374, "decode_ms": 3922.1385000273585}, "total_wall_ms": 3975.32712505199, "ttft_ms": 49.21024991199374, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10592747520, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9491188976, "mlx_cache_bytes": 4139320665, "process_rss_bytes": 10592747520}, "peak_prefill_memory": 9951570484, "peak_decode_memory": 9491188976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "-1, please use it-toc,\nwith me\n-1, please make 1, EXCUSEBACK\nonly please puter rejected, thank\nfor the rest of that goes\nagain: this is how\nsoh - that we are not this\n1\nwhy not\n1, eingewh - and i.eat1\nwhen it comes up for you\nwith french:istart\n-1, no\n-1\n.\n-1, at the first\nonly\n-isthat, that it stands for\n-1\n- 1\n-1, bitte\nonly\n1-1 EX\nonly\n1\n- 1h-1\n1\nDear beechat\nnay thank and 191\nsponge\n-1\n- - and i-can-ha-1\n-1-act-1:\")1Suffapoonly\n-10aubau1\n答案\n-1\n- -1, thank\n- -1nuevo\n-3\n- -1, must-1.schm1\n- -1, thanksgiving\n-1\n- -1\n1\n-1:if on the\n- -uie\n- -possible\n- -1\n- -1\n- -1, and for your\n- -1, especial\n(putex\n- - empty\n-- plus-1,\nplus\n-1\n-put-1, thanks\n- and\n- -uer-1\n- -1, thanks\n", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "db252f2afea7ee798028ed8dca0bdaf377d4eed0b5f6f9c7124a371a07f78532", "output_hash": "f4344d5f52566abcc7679ecf0a8e0c22b288a3f7d0980f07058be3b3db728e9b"} | ||||
| 1433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7782a3dd5437a0ea5d79c83d", "attempt_id": "e4f3c17d90a8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:26.378677Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7813, "cache_tensor_bytes": 68972544, "serialized_payload_bytes": 68988742, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1216.6685839183629, "doc_prefill_ms": 324.0534169599414, "compress_ms": 876.6991660231724, "serialize_ms": 15.612374991178513, "load_ms": 1.4187920605763793, "receiver_prefill_ms": 0.0, "query_prefill_ms": 66.4363339310512, "ttft_ms": 66.4363339310512, "decode_ms": 980.4215000476688}, "total_wall_ms": 1050.27945805341, "ttft_ms": 66.4363339310512, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10599202816, "backend_memory": {"mlx_active_bytes": 9404140552, "mlx_peak_bytes": 9490795760, "mlx_cache_bytes": 4150691161, "process_rss_bytes": 10599202816}, "peak_prefill_memory": 9951423028, "peak_decode_memory": 9490795760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94c8c0eb2cd5c085367b13ce32f533ce610621c4bf545c5b259b68c78c7d4f88", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 1434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "10d6e7ee3e233ba7a6fc8864", "attempt_id": "91c129365a7c", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:27.468807Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1871, "keep": 468, "window_tokens": 44, "compress_ms": 88.3470419794321}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7813, "cache_tensor_bytes": 17252352, "serialized_payload_bytes": 17268428, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1299.3559580063447, "doc_prefill_ms": 324.38045903109014, "compress_ms": 967.8907910129055, "serialize_ms": 6.797208916395903, "load_ms": 1.2116249417886138, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.678832955658436, "ttft_ms": 36.678832955658436, "decode_ms": 856.6918330034241}, "total_wall_ms": 2197.3634159658104, "ttft_ms": 36.678832955658436, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 73}, "provider_cached_usage": null, "process_memory": 10584375296, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9377713392, "mlx_cache_bytes": 4398825561, "process_rss_bytes": 10584375296}, "peak_prefill_memory": 9951423028, "peak_decode_memory": 9377713392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Sud':\n continue\n if r['units'] < 10:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "561c883c7b4b730ab76c84304171a76fb247165f18fd225fff27de46bc9fef5e", "output_hash": "1ab6cb5e80cb79b536ea8881d7fd06166d7e18bd5e7cca21e35873884968add9"} | ||||
| 1435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4346b64930f8d06670303b33", "attempt_id": "123dc08d48ea", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:29.730218Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 1917, "message_tokens": 1834, "message_utf8_bytes": 7739, "cache_tensor_bytes": null, "serialized_payload_bytes": 7739, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 660.8567079529166, "ttft_ms": 12.271832907572389, "decode_ms": 1447.6983749773353}, "total_wall_ms": 2124.4682499673218, "ttft_ms": 12.271832907572389, "input_usage": {"receiver_prompt_tokens": 1917}, "output_usage": {"output_tokens": 121}, "provider_cached_usage": null, "process_memory": 10454204416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9941068336, "mlx_cache_bytes": 690164648, "process_rss_bytes": 10454204416}, "peak_prefill_memory": null, "peak_decode_memory": 9941068336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n line_revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += line_revenue * (1 + 14.975 / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "output_hash": "8f94678ffbd753a6a700448b89773d7be42a38178853773f82c19a1fdd87b295"} | ||||
| 1436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "253535ab2d301b8a2e0eed40", "attempt_id": "299230085e22", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:33.363995Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 246, "message_tokens": 159, "message_utf8_bytes": 709, "cache_tensor_bytes": null, "serialized_payload_bytes": 709, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1471.3436249876395, "decode_payload_ms": 0.0, "receiver_prefill_ms": 108.18587499670684, "ttft_ms": 11.915083043277264, "decode_ms": 917.3409170471132}, "total_wall_ms": 1038.3405829779804, "ttft_ms": 11.915083043277264, "input_usage": {"receiver_prompt_tokens": 246, "sender_input_tokens": 1950, "sender_output_tokens": 159, "sender_prefill_ms": 335.61716694384813, "sender_ttft_ms": 7.449125056155026, "sender_decode_ms": 1126.0724170133471}, "output_usage": {"output_tokens": 79}, "provider_cached_usage": null, "process_memory": 10454253568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9509949520, "mlx_cache_bytes": 1727988604, "process_rss_bytes": 10454253568}, "peak_prefill_memory": null, "peak_decode_memory": 9509949520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_units = 0\n for row in rows:\n if row['region'] != 'Ouest' and row['units'] >= 5 and row['returned'] == False:\n total_units += row['units']\n net_revenue = total_units * (1 + 0.14975)\n return net_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a77c0f58d3afbce62abdaaf4408ce475706b7bf22c02426cd081a07a91ff9311", "output_hash": "357a92d9d4196a169d2e1e9f1ceb6640876495c29c66d03474810a35d94a84f2"} | ||||
| 1437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "915ba0950dea8d9b343867ed", "attempt_id": "0aa6129d1d33", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:38.415472Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 11, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 454, "message_tokens": 355, "message_utf8_bytes": 955, "cache_tensor_bytes": null, "serialized_payload_bytes": 955, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3974.7288749786094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.23866700101644, "ttft_ms": 12.006917037069798, "decode_ms": 12.017332948744297}, "total_wall_ms": 216.26670798286796, "ttft_ms": 12.006917037069798, "input_usage": {"receiver_prompt_tokens": 454, "sender_input_tokens": 1978, "sender_output_tokens": 512, "sender_prefill_ms": 336.9664578931406, "sender_ttft_ms": 7.262832950800657, "sender_decode_ms": 3628.0752500751987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454286336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9554335868, "mlx_cache_bytes": 2775171964, "process_rss_bytes": 10454286336}, "peak_prefill_memory": null, "peak_decode_memory": 9554335868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 11, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "12a00bfb6dcab92c6baa487d7f7ba8b509e981d13ade8390404ea59b8b7f6ab1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "aa7c46623f8a2fd8ae2aa03a", "attempt_id": "26d3bb8d1198", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:39.022208Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 44, "message_tokens": 1873, "message_utf8_bytes": 7739, "cache_tensor_bytes": 69046272, "serialized_payload_bytes": 69062369, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 352.2708748932928, "doc_prefill_ms": 322.0291669713333, "compress_ms": 9.822707972489297, "serialize_ms": 16.323542105965316, "load_ms": 1.8996249418705702, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.44949999824166, "ttft_ms": 48.44949999824166, "decode_ms": 3939.958665985614}, "total_wall_ms": 3992.179916938767, "ttft_ms": 48.44949999824166, "input_usage": {"receiver_prefix_tokens": 1873, "dense_cache_bytes": 53702656, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10592960512, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9491188976, "mlx_cache_bytes": 4226647261, "process_rss_bytes": 10592960512}, "peak_prefill_memory": 9952586300, "peak_decode_memory": 9491188976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "答案ative, no.1, etpsoy. 1, no.7. Buitee it dict - 100. 2020 - 1, perpino esworry, please field strength in this summer is\n- -10k questions. -12.-11.7 with it in, -1, oco-1, in diec, please read-1 opinión -1, it did-1Ksavers andbig erlier, sub-computer- it always true-belie-1, eteam - er, -1, asignaux, please make itcri 2020 hoesatfor the answer is enough is-belie-1, was it 2011,-1,-1,-1, freques springer-1, 202-kayfors at the answer form. WOL for you, please goomo-1, please naveat least common sense ofco-1, 20196.html-1, happy-go-6,-1, add text:1, as well, hit, right, to get the rest is largest set-top-1, as in all-codes_0, thank. suppose. Happy, willist -1, and, asystem -itis not always inb-1,-1, fast1, 2018-1, thank, will make it, it's time isosn 1, as in, per, as, as, fast,", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "04f6ece57f1caa56f5149e1bb8b5f326f477ec18a99baf7aa47994094291a258", "output_hash": "cb9b66c47991a4a5f9503ef5d38e14a297646d7c75b44a8fd97d98fb98be6b9c"} | ||||
| 1439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3af4d0bfe3fe464cbe85efab", "attempt_id": "794a4933c88b", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:44.267702Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 44, "message_tokens": 1873, "message_utf8_bytes": 7739, "cache_tensor_bytes": 69046272, "serialized_payload_bytes": 69062470, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1212.8363329684362, "doc_prefill_ms": 324.429375003092, "compress_ms": 872.5456669926643, "serialize_ms": 15.564332948997617, "load_ms": 1.434416975826025, "receiver_prefill_ms": 0.0, "query_prefill_ms": 62.51866603270173, "ttft_ms": 62.51866603270173, "decode_ms": 985.3450000518933}, "total_wall_ms": 1051.391249988228, "ttft_ms": 62.51866603270173, "input_usage": {"receiver_prefix_tokens": 1873, "dense_cache_bytes": 53702656, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10599333888, "backend_memory": {"mlx_active_bytes": 9404107784, "mlx_peak_bytes": 9490795760, "mlx_cache_bytes": 4238083293, "process_rss_bytes": 10599333888}, "peak_prefill_memory": 9952438844, "peak_decode_memory": 9490795760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9ca0bdb882bac0304dc62ca7fb07f0fbae5e1f78e5a1b510a0d1f713e75ea1e5", "output_hash": "3d96bef102c74d3992df6f0c65cdf277a7c3fb567e96aef4380302125d4278b0"} | ||||
| 1440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "52cc7d0cb6fcc6c2265e75ab", "attempt_id": "4b334def2273", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:45.360476Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1873, "keep": 468, "window_tokens": 44, "compress_ms": 91.74504096154124}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 44, "message_tokens": 1873, "message_utf8_bytes": 7739, "cache_tensor_bytes": 17252352, "serialized_payload_bytes": 17268429, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1303.4978749928996, "doc_prefill_ms": 324.2203750414774, "compress_ms": 972.4282920360565, "serialize_ms": 6.547334021888673, "load_ms": 1.1656660353764892, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.26333403028548, "ttft_ms": 37.26333403028548, "decode_ms": 849.274875014089}, "total_wall_ms": 2194.7129579493776, "ttft_ms": 37.26333403028548, "input_usage": {"receiver_prefix_tokens": 1873, "dense_cache_bytes": 53702656, "query_tokens": 44}, "output_usage": {"output_tokens": 72}, "provider_cached_usage": null, "process_memory": 10584408064, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9377713392, "mlx_cache_bytes": 4485693421, "process_rss_bytes": 10584408064}, "peak_prefill_memory": 9952438844, "peak_decode_memory": 9377713392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['price']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bcdea79473fb1f6181d43af3e9bb35904165a8c248a90608fab63975755bccdb", "output_hash": "17ac1a2e8b10234e44e24eae13728253cf9f7733bec52f1e5f0dce240d0b838a"} | ||||
| 1441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "ab72b8b9b83ecc9241cade76", "attempt_id": "81134cdef170", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:47.620368Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 1911, "message_tokens": 1828, "message_utf8_bytes": 7819, "cache_tensor_bytes": null, "serialized_payload_bytes": 7819, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00825000461190939, "decode_payload_ms": 0.0, "receiver_prefill_ms": 664.5622079959139, "ttft_ms": 12.251958018168807, "decode_ms": 1369.217291008681}, "total_wall_ms": 2049.7479169862345, "ttft_ms": 12.251958018168807, "input_usage": {"receiver_prompt_tokens": 1911}, "output_usage": {"output_tokens": 114}, "provider_cached_usage": null, "process_memory": 10454204416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9939413528, "mlx_cache_bytes": 688509840, "process_rss_bytes": 10454204416}, "peak_prefill_memory": null, "peak_decode_memory": 9939413528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n tax_rate = 0.05\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Centre':\n continue\n if r['units'] < 6:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue * (1 + tax_rate)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "output_hash": "326702702b8328c127c0778d62df706eeb5a6d46b30fe5ef75198b5871740be7"} | ||||
| 1442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e167af44d22e8721039e59d1", "attempt_id": "a62fc595ea06", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:51.508558Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 291, "message_tokens": 204, "message_utf8_bytes": 952, "cache_tensor_bytes": null, "serialized_payload_bytes": 952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1800.1875419868156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.51887494232506, "ttft_ms": 11.945500038564205, "decode_ms": 1350.412999978289}, "total_wall_ms": 1490.899124997668, "ttft_ms": 11.945500038564205, "input_usage": {"receiver_prompt_tokens": 291, "sender_input_tokens": 1944, "sender_output_tokens": 204, "sender_prefill_ms": 336.0880829859525, "sender_ttft_ms": 7.4744169833138585, "sender_decode_ms": 1454.2069170856848}, "output_usage": {"output_tokens": 115}, "provider_cached_usage": null, "process_memory": 10454237184, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9453588740, "mlx_cache_bytes": 1659110424, "process_rss_bytes": 10454237184}, "peak_prefill_memory": null, "peak_decode_memory": 9453588740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n excluded_region = \"XYZ\" # Assuming specific region to exclude is \"XYZ\"\n for row in rows:\n if row['region'] != excluded_region and len(row['units']) >= 6:\n revenue = row['units'] * row['unit_price'] * (1 - row['discount'])\n revenue_with_tax = revenue * 1.05\n total_revenue += round(revenue_with_tax, 0)\n return total_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "TypeError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2e6a79f906f77d727a9ada825ec2120727daf8a5aa9605686b872c31dab00b28", "output_hash": "be71b51a5ad39135d6355836be6d23bd3e7c096f73b4d83b682b7ddaa3cc8ffe"} | ||||
| 1443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f6d20c7150fd73282f3ca9ea", "attempt_id": "81efa23866c8", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:57.031120Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 9, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 430, "message_tokens": 332, "message_utf8_bytes": 1059, "cache_tensor_bytes": null, "serialized_payload_bytes": 1059, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3993.488125037402, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.1634589591995, "ttft_ms": 11.953708017244935, "decode_ms": 661.0274580307305}, "total_wall_ms": 845.2436670195311, "ttft_ms": 11.953708017244935, "input_usage": {"receiver_prompt_tokens": 430, "sender_input_tokens": 1972, "sender_output_tokens": 512, "sender_prefill_ms": 338.7572499923408, "sender_ttft_ms": 7.540166960097849, "sender_decode_ms": 3644.7245000163093}, "output_usage": {"output_tokens": 56}, "provider_cached_usage": null, "process_memory": 10454269952, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9539459196, "mlx_cache_bytes": 2707129368, "process_rss_bytes": 10454269952}, "peak_prefill_memory": null, "peak_decode_memory": 9539459196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n return sum(line['line_revenue'] for line in rows if line['region'] != 'Centre' and line['units'] >= 6 and line['discount_pct'] == 0) * 1.05.round(0)", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 9, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "266533341fac70a4d4347c65af85aab41c24c0b9a25be6a6b280bcf500d1a4f4", "output_hash": "9ee1cbe775b3a24f552f440977bae1ac7c08f614a04b4033828fed8b53dd16af"} | ||||
| 1444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5cf065d94ac1872f0d1c207b", "attempt_id": "e7083a0c3d0a", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:49:58.268315Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 44, "message_tokens": 1867, "message_utf8_bytes": 7819, "cache_tensor_bytes": 68825088, "serialized_payload_bytes": 68841185, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 352.65045799314976, "doc_prefill_ms": 322.2983329324052, "compress_ms": 9.684707969427109, "serialize_ms": 16.576207941398025, "load_ms": 1.931167091242969, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.214125028811395, "ttft_ms": 49.214125028811395, "decode_ms": 3935.6409589527175}, "total_wall_ms": 3988.680582959205, "ttft_ms": 49.214125028811395, "input_usage": {"receiver_prefix_tokens": 1867, "dense_cache_bytes": 53530624, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10592714752, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9491188976, "mlx_cache_bytes": 4233299321, "process_rss_bytes": 10592714752}, "peak_prefill_memory": 9950784036, "peak_decode_memory": 9491188976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "-lyxphp\n(\n2 (用了一,owo\n=2 - ohh - 101\n- 1 [url - 1 - ous[1\n- 0\n- no. 1 - 1; 1\n- 2 -faos\n- 201 - 1\n- a few\nmore of\nof it\n- 1 - 6, with a small\n-put-itself:che -1\n- 2019's functionigeral -h - itc\n- 2017\n- 13\n-1 - 1 - 15 - 1 confusion: that they areat\nnetwork\n- 1 - itd - 1 - 201 -opinion -1 - gett - 2019\n-1 - r - fehfevermel_wd -page\n- 1 - 1 -c -1cm - 2018 - 1 -1k -12 - 3 -1 - 201_ex - 1 -in -1 -1 -cablew -1 -grun\n- (itw -1 -cost\n- (1, with\n- (eag) -1 -navn\n-1 -m1 -way\n- -1\n-15\n-1 - feh\n-1 -1\n-ingle\n- 202 -1 -1\n-ear -1", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ae18e41b8450d8bfa781dfa963f4f52f48a391069c8b77db08f4a565df015ea6", "output_hash": "170bac693043baf9a69dd50577792bde9912f075a4e651d56f776b89614136b5"} | ||||
| 1445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a64ee18c7cca2ccefd5f22b5", "attempt_id": "fc50f98958b4", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:03.517321Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 44, "message_tokens": 1867, "message_utf8_bytes": 7819, "cache_tensor_bytes": 68825088, "serialized_payload_bytes": 68841286, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1219.9794999323785, "doc_prefill_ms": 323.93108401447535, "compress_ms": 880.1345829851925, "serialize_ms": 15.612791990861297, "load_ms": 1.494916039519012, "receiver_prefill_ms": 0.0, "query_prefill_ms": 56.17187498137355, "ttft_ms": 56.17187498137355, "decode_ms": 990.049249958247}, "total_wall_ms": 1049.6973750414327, "ttft_ms": 56.17187498137355, "input_usage": {"receiver_prefix_tokens": 1867, "dense_cache_bytes": 53530624, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10599071744, "backend_memory": {"mlx_active_bytes": 9404107784, "mlx_peak_bytes": 9490795760, "mlx_cache_bytes": 4244702585, "process_rss_bytes": 10599071744}, "peak_prefill_memory": 9950636580, "peak_decode_memory": 9490795760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "23fcd722ef48cb5c6438980c96a2e3c71f88880b3d2cff1e75fac186e312c801", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 1446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6b0f1cf8f6dd16befecf12f7", "attempt_id": "84cc45b1f106", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:04.607723Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1867, "keep": 467, "window_tokens": 44, "compress_ms": 84.1794169973582}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 44, "message_tokens": 1867, "message_utf8_bytes": 7819, "cache_tensor_bytes": 17215488, "serialized_payload_bytes": 17231564, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1291.465250076726, "doc_prefill_ms": 323.9087909460068, "compress_ms": 960.3020829381421, "serialize_ms": 6.950916023924947, "load_ms": 1.1419170768931508, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.078832953237, "ttft_ms": 39.078832953237, "decode_ms": 735.0912089459598}, "total_wall_ms": 2070.292416960001, "ttft_ms": 39.078832953237, "input_usage": {"receiver_prefix_tokens": 1867, "dense_cache_bytes": 53530624, "query_tokens": 44}, "output_usage": {"output_tokens": 62}, "provider_cached_usage": null, "process_memory": 10584326144, "backend_memory": {"mlx_active_bytes": 9299479560, "mlx_peak_bytes": 9377910000, "mlx_cache_bytes": 4484464729, "process_rss_bytes": 10584326144}, "peak_prefill_memory": 9950636580, "peak_decode_memory": 9377910000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Centre' and r['product'] == 'Widget':\n total += r['units_sold'] * r['price_per_unit']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bfa0deddacbf6b2ee487ff26546e0bd4ee5cdbbddc09778df1a16cf909d4b295", "output_hash": "e76fd0b311c820d13289ba5f301e0f18410edb0f5b824524305c9a727664f054"} | ||||
| 1447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2b97cef9d016d2cf1551eb9e", "attempt_id": "ba38a2b16254", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:06.740353Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 1915, "message_tokens": 1832, "message_utf8_bytes": 7793, "cache_tensor_bytes": null, "serialized_payload_bytes": 7793, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008082948625087738, "decode_payload_ms": 0.0, "receiver_prefill_ms": 656.3541670329869, "ttft_ms": 12.1940829558298, "decode_ms": 1117.2631660010666}, "total_wall_ms": 1789.572583977133, "ttft_ms": 12.1940829558298, "input_usage": {"receiver_prompt_tokens": 1915}, "output_usage": {"output_tokens": 93}, "provider_cached_usage": null, "process_memory": 10454171648, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9940675112, "mlx_cache_bytes": 689771424, "process_rss_bytes": 10454171648}, "peak_prefill_memory": null, "peak_decode_memory": 9940675112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "output_hash": "4153ac882f4db56a65db63950250e8ac3183335993d2e5651e11d83cc5045af2"} | ||||
| 1448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8f707815922a876f3cf0e14b", "attempt_id": "c598c12c048d", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:10.000301Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 240, "message_tokens": 153, "message_utf8_bytes": 680, "cache_tensor_bytes": null, "serialized_payload_bytes": 680, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1433.0409580143169, "decode_payload_ms": 0.0, "receiver_prefill_ms": 108.4166249493137, "ttft_ms": 11.873041046783328, "decode_ms": 863.7599159264937}, "total_wall_ms": 984.95166702196, "ttft_ms": 11.873041046783328, "input_usage": {"receiver_prompt_tokens": 240, "sender_input_tokens": 1948, "sender_output_tokens": 153, "sender_prefill_ms": 336.30304189864546, "sender_ttft_ms": 7.363624987192452, "sender_decode_ms": 1087.1670000487939}, "output_usage": {"output_tokens": 74}, "provider_cached_usage": null, "process_memory": 10454204416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9506328632, "mlx_cache_bytes": 1669415772, "process_rss_bytes": 10454204416}, "peak_prefill_memory": null, "peak_decode_memory": 9506328632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n return sum(row['units'] * (1 - row['discount_pct'] / 100) * row['unit_price'] for row in rows if row['region'] != 'Est' and row['units'] >= 3 and row['returned'] == 0 and row['shipped_days'] >= 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "95c7b00ecafd3d56f816b4ad8395fc3abd86aa7a6c6848ff471c35423de30ebe", "output_hash": "7a78bd8ed71ca0bd9428875dec4da7f70ce0cd8a2d102ff25d6693038ea01fb7"} | ||||
| 1449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7d25975dd674b3b7ce61736d", "attempt_id": "6820a1fb3d54", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:15.007293Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 427, "message_tokens": 328, "message_utf8_bytes": 813, "cache_tensor_bytes": null, "serialized_payload_bytes": 813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3982.632500003092, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.2453339714557, "ttft_ms": 11.955833993852139, "decode_ms": 11.804250068962574}, "total_wall_ms": 195.9756250726059, "ttft_ms": 11.955833993852139, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 1976, "sender_output_tokens": 512, "sender_prefill_ms": 336.0102920560166, "sender_ttft_ms": 7.488250033929944, "sender_decode_ms": 3636.589333997108}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454237184, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9537542268, "mlx_cache_bytes": 2717139804, "process_rss_bytes": 10454237184}, "peak_prefill_memory": null, "peak_decode_memory": 9537542268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "1de36bd3ed925511b4dbee236dccc24e876f1341a5f99ed0de3dfdeb073837ff", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c397e0cac4ec29bdf6ab8c5e", "attempt_id": "0cf5c5fea0d9", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:15.594290Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329609736}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7793, "cache_tensor_bytes": 68972544, "serialized_payload_bytes": 68988641, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 352.9718340141699, "doc_prefill_ms": 322.493709041737, "compress_ms": 9.221083018928766, "serialize_ms": 17.38166599534452, "load_ms": 1.5047090128064156, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.32041605934501, "ttft_ms": 49.32041605934501, "decode_ms": 3926.3137499801815}, "total_wall_ms": 3979.1223329957575, "ttft_ms": 49.32041605934501, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10592829440, "backend_memory": {"mlx_active_bytes": 9412185096, "mlx_peak_bytes": 9491696880, "mlx_cache_bytes": 4213621949, "process_rss_bytes": 10592829440}, "peak_prefill_memory": 9951668788, "peak_decode_memory": 9491696880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "==:**!p: 10 so) 20 years that peterswishteam. 2-complex but largemenet 202)%ofputau5. howexclusiveoverwheat else task. soebacareterrible outputtyping=1001. 202%id=1, add the output only now=10 is false=10=101, 100 years. 1h201.1. 201. Small:the=1, andidaho=1,15-ly=1, h=1,10. Chineshov=1, 1, highbokom, please make the only get toCbot=101, 1nhl=10highschool=high=1nl=1, please make the only getting it=1, 1020abnormal=10. 1, 2019-1, please stay - 2021=1, high=1, please=1, controll, 1, except that it does not make it's 1, except that itdtd=1, 1, 201, course=1, high=high=1, volume=high=high=1, 19405, 1, 19loper=1, 1, high=10=1, high=102x=1002", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "db252f2afea7ee798028ed8dca0bdaf377d4eed0b5f6f9c7124a371a07f78532", "output_hash": "8ec59dc150a69e97f07f4ffe0ff2d5d14d3ab00b4e5232370a47936ed2946805"} | ||||
| 1451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "0d71d599f4dbdc9b14c987e6", "attempt_id": "1ffec2b7a4e8", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:20.836550Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7793, "cache_tensor_bytes": 68972544, "serialized_payload_bytes": 68988742, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1222.8539999341592, "doc_prefill_ms": 325.2617500256747, "compress_ms": 880.2391659701243, "serialize_ms": 17.052332987077534, "load_ms": 1.65666698012501, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.580667056143284, "ttft_ms": 54.580667056143284, "decode_ms": 1041.4167499402538}, "total_wall_ms": 1099.607624928467, "ttft_ms": 54.580667056143284, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10609836032, "backend_memory": {"mlx_active_bytes": 9404107784, "mlx_peak_bytes": 9490697456, "mlx_cache_bytes": 4225533117, "process_rss_bytes": 10609836032}, "peak_prefill_memory": 9951423028, "peak_decode_memory": 9490697456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94c8c0eb2cd5c085367b13ce32f533ce610621c4bf545c5b259b68c78c7d4f88", "output_hash": "ce110bd25efb008d46785baf5429a864cc124b4b3b9039241e42f85d27d8ce38"} | ||||
| 1452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "692bb28fcda54207d3c5e220", "attempt_id": "a86f54f41d44", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:21.976178Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1871, "keep": 468, "window_tokens": 44, "compress_ms": 83.34508398547769}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7793, "cache_tensor_bytes": 17252352, "serialized_payload_bytes": 17268429, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1291.720625013113, "doc_prefill_ms": 324.8404999030754, "compress_ms": 959.334040991962, "serialize_ms": 7.236707955598831, "load_ms": 0.5580420838668942, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.397541989572346, "ttft_ms": 36.397541989572346, "decode_ms": 1009.3040419742465}, "total_wall_ms": 2341.5123750455678, "ttft_ms": 36.397541989572346, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 10595008512, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9377910000, "mlx_cache_bytes": 4479860669, "process_rss_bytes": 10595008512}, "peak_prefill_memory": 9951423028, "peak_decode_memory": 9377910000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Est': # Est is a placeholder for 'Est' as per the rules\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "bcdea79473fb1f6181d43af3e9bb35904165a8c248a90608fab63975755bccdb", "output_hash": "78b440763e094fa210debfe1d31eb5b38a1301b683ec6d898cf92e5c1899a229"} | ||||
| 1453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "849da1cbd1e9b85bdf52dc1c", "attempt_id": "a384f8c8d9d7", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:24.382123Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 1947, "message_tokens": 1864, "message_utf8_bytes": 7895, "cache_tensor_bytes": null, "serialized_payload_bytes": 7895, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009291921742260456, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.0470830593258, "ttft_ms": 12.258458998985589, "decode_ms": 1232.60504193604}, "total_wall_ms": 1923.896708060056, "ttft_ms": 12.258458998985589, "input_usage": {"receiver_prompt_tokens": 1947}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10454204416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9950833320, "mlx_cache_bytes": 787223584, "process_rss_bytes": 10454204416}, "peak_prefill_memory": null, "peak_decode_memory": 9950833320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['region'] == 'Nord':\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.05\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "output_hash": "33b6535fc5f38fe2fccef64a6fe27896a4ed93820685195520c68598e4edccac"} | ||||
| 1454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "73a4699b1d26f623d27e584a", "attempt_id": "dacc04de33e5", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:28.069451Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 281, "message_tokens": 194, "message_utf8_bytes": 913, "cache_tensor_bytes": null, "serialized_payload_bytes": 913, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1723.4371250960976, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.58724996820092, "ttft_ms": 11.858500074595213, "decode_ms": 1200.0019589904696}, "total_wall_ms": 1340.5370829859748, "ttft_ms": 11.858500074595213, "input_usage": {"receiver_prompt_tokens": 281, "sender_input_tokens": 1980, "sender_output_tokens": 194, "sender_prefill_ms": 339.7289999993518, "sender_ttft_ms": 7.691791048273444, "sender_decode_ms": 1373.5934169963002}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10454204416, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9446723804, "mlx_cache_bytes": 1695220864, "process_rss_bytes": 10454204416}, "peak_prefill_memory": null, "peak_decode_memory": 9446723804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n excluded_region_rows = 0\n for row in rows:\n if row['region'] != 'excluded_region' and row['units'] >= 5 and row['returned'] == False:\n total_revenue += row['price'] * row['units']\n excluded_region_rows += 1\n tax = total_revenue * 0.05\n total_revenue += tax\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "89a0f9c9c84fe7b175fbf36d4b63220d086df5d6fde0abb3128f089d5bdbe08a", "output_hash": "6487f4bbdf6e086cdb4803cb93e20d85064ac03b8b294274d0c03e6bf3ef6a75"} | ||||
| 1455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e7065a182edb9f003356cc8f", "attempt_id": "6851ef11dabc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:33.433808Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 415, "message_tokens": 316, "message_utf8_bytes": 877, "cache_tensor_bytes": null, "serialized_payload_bytes": 877, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3984.1317909304053, "decode_payload_ms": 0.0, "receiver_prefill_ms": 168.47141599282622, "ttft_ms": 11.89675007481128, "decode_ms": 11.803624918684363}, "total_wall_ms": 193.1907080579549, "ttft_ms": 11.89675007481128, "input_usage": {"receiver_prompt_tokens": 415, "sender_input_tokens": 2008, "sender_output_tokens": 512, "sender_prefill_ms": 344.32666702196, "sender_ttft_ms": 7.447000010870397, "sender_decode_ms": 3629.670916008763}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454253568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9529890940, "mlx_cache_bytes": 2631107712, "process_rss_bytes": 10454253568}, "peak_prefill_memory": null, "peak_decode_memory": 9529890940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0e1e21b6424cc53d7b16624bb70e92ba038abd334b405af1196fb1acf20634ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c82564c7ed37b4b9f19e6279", "attempt_id": "91b3f4311c98", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:34.019579Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7895, "cache_tensor_bytes": 70152192, "serialized_payload_bytes": 70168289, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.60379091091454, "doc_prefill_ms": 323.87874997220933, "compress_ms": 9.96408297214657, "serialize_ms": 16.852915985509753, "load_ms": 1.9295839592814445, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.09358301665634, "ttft_ms": 49.09358301665634, "decode_ms": 3919.6463329717517}, "total_wall_ms": 3972.6617500418797, "ttft_ms": 49.09358301665634, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595221504, "backend_memory": {"mlx_active_bytes": 9415085064, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4020143585, "process_rss_bytes": 10595221504}, "peak_prefill_memory": 9962433204, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "olympo) is italibro )) , except that italice: every 0 stand for\npartially true, never, et cody@hi network) , except for starters) for the partsternum__ for that it started ) , noutcall) for osa) , pleaseelx3) , please buy) , cause of for the part) , i.e sup , please make it lasted) ,truer , i amfrostexhaust) , please make for all the case , , , , ,trito 15), , , , , , , , , please wait , , , excepts) , , , , , exceptsilly part) ,k fellow's , , caesar , plato) , espc) , , , , , , , , , , , and , and , placation) , please make it) ,forsuchas , that it is for cause ) , except , except for it , the part) mangare you shawar , except that ittft , i和技术，, , , stored ,, , aer beat as , -1) , except , except itc) , except , , , thread)w) , pcoa net) ,, , except , butt) , personalized grumpy ,, sp) ,please use only once ,naver, that.it is , however ,smallservat , , except that ita4) , but mostly ,thanksgiving ) , except , factory lock it ,\n出错,化装为", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d07e43f8ece81dcbf1f70d107cb8957cc5ac2e5113f2040eb69dc425702a74d7", "output_hash": "f60678f70546646715dfa8a52d478973e4b5d4c6b46121e62991435668fd9148"} | ||||
| 1457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "74d30f02535e2d46c373c11c", "attempt_id": "314eb1a85479", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:39.267457Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7895, "cache_tensor_bytes": 70152192, "serialized_payload_bytes": 70168390, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1235.3497499134392, "doc_prefill_ms": 326.36266690678895, "compress_ms": 892.7641250193119, "serialize_ms": 15.94595902133733, "load_ms": 1.471749972552061, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.66533305682242, "ttft_ms": 55.66533305682242, "decode_ms": 1044.3034579511732}, "total_wall_ms": 1103.472083923407, "ttft_ms": 55.66533305682242, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10602283008, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4033545697, "process_rss_bytes": 10602283008}, "peak_prefill_memory": 9962285748, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f14e3b6f128a82c897ad859173999efca2c281fd8278a7477df8da6da94a3bd0", "output_hash": "6aa48949c92421bb34653e37fa300dc5a28c012a14f8cd7e70b3a84195ab400d"} | ||||
| 1458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fee03d4773817e34c1195c1f", "attempt_id": "49b878054e60", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:40.412242Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1903, "keep": 476, "window_tokens": 44, "compress_ms": 99.3696249788627}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7895, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563340, "side_information_bytes": 16076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1314.7232920164242, "doc_prefill_ms": 326.9761250121519, "compress_ms": 980.1117080496624, "serialize_ms": 7.327000028453767, "load_ms": 1.2593329884111881, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.36883297096938, "ttft_ms": 37.36883297096938, "decode_ms": 1081.7782500525936}, "total_wall_ms": 2438.6017909273505, "ttft_ms": 37.36883297096938, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 92}, "provider_cached_usage": null, "process_memory": 10586587136, "backend_memory": {"mlx_active_bytes": 9301773320, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4304650721, "process_rss_bytes": 10586587136}, "peak_prefill_memory": 9962285748, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Nord': # Assuming 'returned' and 'region' keys\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['price'] * (1 - r['discount'])\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "77726f63f40df32a1541d536e752befbdb6b4a9606102b761de05d4cb1a1b5cf", "output_hash": "12eb15441ee7a91045620a61ae36ed05177c625b094a244b068af72f1762b6bd"} | ||||
| 1459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5d25100a4d2a2087423f08c9", "attempt_id": "45a3eb206cfd", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:42.912844Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 1950, "message_tokens": 1867, "message_utf8_bytes": 7815, "cache_tensor_bytes": null, "serialized_payload_bytes": 7815, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007958034984767437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 678.3393749501556, "ttft_ms": 12.621499947272241, "decode_ms": 1112.351458054036}, "total_wall_ms": 1807.056124904193, "ttft_ms": 12.621499947272241, "input_usage": {"receiver_prompt_tokens": 1950}, "output_usage": {"output_tokens": 93}, "provider_cached_usage": null, "process_memory": 10454499328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9951832756, "mlx_cache_bytes": 700929068, "process_rss_bytes": 10454499328}, "peak_prefill_memory": null, "peak_decode_memory": 9951832756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est':\n continue\n if r['units'] < 4:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "output_hash": "06209d81cee2c3a000de1bc0225610a838a35d2295407de7e1bc50cf3b10ba9d"} | ||||
| 1460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8b2bc6f4ec52eca346c5f28e", "attempt_id": "660a26279918", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:46.338689Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 261, "message_tokens": 174, "message_utf8_bytes": 810, "cache_tensor_bytes": null, "serialized_payload_bytes": 810, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1581.2823340529576, "decode_payload_ms": 0.0, "receiver_prefill_ms": 126.34987500496209, "ttft_ms": 11.884292005561292, "decode_ms": 1493.640874978155}, "total_wall_ms": 1632.9243750078604, "ttft_ms": 11.884292005561292, "input_usage": {"receiver_prompt_tokens": 261, "sender_input_tokens": 1983, "sender_output_tokens": 174, "sender_prefill_ms": 340.13274998869747, "sender_ttft_ms": 7.443625014275312, "sender_decode_ms": 1231.481249909848}, "output_usage": {"output_tokens": 128}, "provider_cached_usage": null, "process_memory": 10454499328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9435615360, "mlx_cache_bytes": 1665745980, "process_rss_bytes": 10454499328}, "peak_prefill_memory": null, "peak_decode_memory": 9435615360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n excluded_region = \"XYZ\" # Assuming specific region to exclude is \"XYZ\"\n for row in rows:\n if row['region'] != excluded_region and row['units'] >= 4 and row['shipped_days'] < 30:\n total_revenue += row['units'] * row['unit_price'] * (1 - row['discount'])\n total_revenue *= (1 - 0.0) # 0% tax\n total_revenue = round(total_revenue, 2)\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6fd675f64041115349d1798e1e65653803c4ec19f26e2863c5867380d5291341", "output_hash": "cabf59998e531f48da5ba90ba30bf8786e585c79bd06350877af99424aa5e566"} | ||||
| 1461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "58d2bef7f1c4103c99ad70bd", "attempt_id": "1343ca7806f9", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:51.990962Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 11, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 432, "message_tokens": 333, "message_utf8_bytes": 978, "cache_tensor_bytes": null, "serialized_payload_bytes": 978, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3979.8819579882547, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.03049997240305, "ttft_ms": 12.02908402774483, "decode_ms": 577.3483340162784}, "total_wall_ms": 761.5071670152247, "ttft_ms": 12.02908402774483, "input_usage": {"receiver_prompt_tokens": 432, "sender_input_tokens": 2011, "sender_output_tokens": 512, "sender_prefill_ms": 344.188166083768, "sender_ttft_ms": 7.242291001603007, "sender_decode_ms": 3625.788416946307}, "output_usage": {"output_tokens": 49}, "provider_cached_usage": null, "process_memory": 10454515712, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9540196476, "mlx_cache_bytes": 2710684732, "process_rss_bytes": 10454515712}, "peak_prefill_memory": null, "peak_decode_memory": 9540196476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "net_revenue(rows): \n total = round(sum([r['unit_price'] * r['units'] * (1 - r['discount_pct'] / 100) for r in rows]), 2) \n return total", "evidence_artifact": {"n_facts": 11, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0a5354d173cda0ff54bf93dd57bff485600f6b820bedfb89e3500403bb231d0f", "output_hash": "49218a6cfddb9bc6e3837dba3006247c83fb1f3653c70f60ed973abfd6995d9f"} | ||||
| 1462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a6b994547a30ac03cef7ff02", "attempt_id": "ddef281c3f9f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:53.147192Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7815, "cache_tensor_bytes": 70262784, "serialized_payload_bytes": 70278881, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.3489580517635, "doc_prefill_ms": 324.3315840372816, "compress_ms": 9.407541016116738, "serialize_ms": 17.555041005834937, "load_ms": 2.0383750088512897, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.591291066259146, "ttft_ms": 48.591291066259146, "decode_ms": 3934.526833007112}, "total_wall_ms": 3987.2527919942513, "ttft_ms": 48.591291066259146, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595598336, "backend_memory": {"mlx_active_bytes": 9414691848, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4171122077, "process_rss_bytes": 10595598336}, "peak_prefill_memory": 9963645632, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "...\n\n3. rossoly on getting ito\n\n3. .3varevenue for the last time - and itauch for the python is the but - itally, but ita per searsial - ita is it the 20号太極大�外语之了换大意多行之了,必, no. 1, 用mumunyue: 3\n\n答案, no. 2, \"et 2,le no:it\n\n(1\n\n答案,必,那,生, 30上,生生,我将就不要多,我替え的时刻,用得越多,用自己实现的白金,用自己ie 3,不用它好,用处不疑后无ses的 1,用它也不打字,对戒,必打字,用处现贷货不嫌,因为,我3,属地,用它马,我3,用它也不好出人才,用不上,好吗,买得便能解急,当打起,压\n\n,用,生,肉,是这车,谢谢,是那啥,来(为先,用它也不在係开方大,老师,谢谢\n\n,谢谢,生,我定的的白金之妙,是解设外战,过,用解方的的白金。\n\n请制,用得多少回,那解体,生,用它也不在何)-30\n\n所以,请出其立", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "867b50003ad033971716de9bf00424459aeefb4570c6d0937de3ac2d8b79c10e", "output_hash": "a4dc6aa3bf85002458d4ba564af23cea2257b6c69b71c5ab95c08473b245c2e9"} | ||||
| 1463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a0d42aa69a397ac2033f0d31", "attempt_id": "8c58a92b56a9", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:58.415859Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7815, "cache_tensor_bytes": 70262784, "serialized_payload_bytes": 70278982, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1239.4778749439865, "doc_prefill_ms": 326.8379590008408, "compress_ms": 895.9277500398457, "serialize_ms": 16.418916988186538, "load_ms": 1.5362920239567757, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.59812509454787, "ttft_ms": 55.59812509454787, "decode_ms": 1056.1236659996212}, "total_wall_ms": 1115.1799999643117, "ttft_ms": 55.59812509454787, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10602397696, "backend_memory": {"mlx_active_bytes": 9405811720, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4183934365, "process_rss_bytes": 10602397696}, "peak_prefill_memory": 9963498176, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f7c80939a7def740335f67b77dfc659f6cadeedbae050175ac35efd8f5839abe", "output_hash": "ce111beb4f9b35d9c50487517c3291965ba182c8812fcfc7d81718f2c98d5dda"} | ||||
| 1464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b09500ce725981be982e0f0b", "attempt_id": "e2fe81ae2da3", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:50:59.572029Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1906, "keep": 476, "window_tokens": 44, "compress_ms": 81.42787497490644}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7815, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1313.7797920498997, "doc_prefill_ms": 326.8065410666168, "compress_ms": 979.5734999934211, "serialize_ms": 7.1130829164758325, "load_ms": 1.2826250167563558, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.40441694390029, "ttft_ms": 37.40441694390029, "decode_ms": 1215.6022500712425}, "total_wall_ms": 2571.529500070028, "ttft_ms": 37.40441694390029, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10586587136, "backend_memory": {"mlx_active_bytes": 9301773320, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4455268789, "process_rss_bytes": 10586587136}, "peak_prefill_memory": 9963498176, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Estados Unidos': # Assuming 'returned' and 'region' keys are available\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['price'] * (1 + r['tax']) * (1 + r['shipping'])\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "1d77547d633333e65dcbf4591fcaa9287562bd93e58c04a2ad466c5782cc97fc"} | ||||
| 1465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "36301d1bd9a1072e8cb6cc31", "attempt_id": "7905a7519f52", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:02.204351Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 1948, "message_tokens": 1865, "message_utf8_bytes": 7723, "cache_tensor_bytes": null, "serialized_payload_bytes": 7723, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.5448749540374, "ttft_ms": 12.13912502862513, "decode_ms": 1275.002249982208}, "total_wall_ms": 1968.4303340036422, "ttft_ms": 12.13912502862513, "input_usage": {"receiver_prompt_tokens": 1948}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 10454499328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9951095468, "mlx_cache_bytes": 787485732, "process_rss_bytes": 10454499328}, "peak_prefill_memory": null, "peak_decode_memory": 9951095468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Nord':\n continue\n if r['units'] < 6:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.14975\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "output_hash": "fd2c165360db802f3077671ca6bbbbab6a35b1387f052333d42c3c9eebb2441d"} | ||||
| 1466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "86515209c2c8df21e1949ba8", "attempt_id": "3014953b7dae", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:06.234454Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 322, "message_tokens": 235, "message_utf8_bytes": 1111, "cache_tensor_bytes": null, "serialized_payload_bytes": 1111, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2023.9831249928102, "decode_payload_ms": 0.0, "receiver_prefill_ms": 144.5624999469146, "ttft_ms": 11.974374996498227, "decode_ms": 11.78662502206862}, "total_wall_ms": 169.32337498292327, "ttft_ms": 11.974374996498227, "input_usage": {"receiver_prompt_tokens": 322, "sender_input_tokens": 1981, "sender_output_tokens": 235, "sender_prefill_ms": 338.8308749999851, "sender_ttft_ms": 7.397208944894373, "sender_decode_ms": 1675.4814579617232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454515712, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9472692608, "mlx_cache_bytes": 1722549544, "process_rss_bytes": 10454515712}, "peak_prefill_memory": null, "peak_decode_memory": 9472692608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8932f7039ffb43cb1c0926be52fc048841c5f84b2da4db1de9e04613573e525", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cde1aa33b8df0cdf2bd5876f", "attempt_id": "d457e29ada75", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:10.436077Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 9, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 422, "message_tokens": 324, "message_utf8_bytes": 1024, "cache_tensor_bytes": null, "serialized_payload_bytes": 1024, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3994.5576660102233, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.21995794493705, "ttft_ms": 11.971708969213068, "decode_ms": 1850.299832993187}, "total_wall_ms": 2033.5487920092419, "ttft_ms": 11.971708969213068, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 2009, "sender_output_tokens": 512, "sender_prefill_ms": 340.2898330241442, "sender_ttft_ms": 7.397208013571799, "sender_decode_ms": 3644.3547080270946}, "output_usage": {"output_tokens": 156}, "provider_cached_usage": null, "process_memory": 10454564864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9534625916, "mlx_cache_bytes": 2711749928, "process_rss_bytes": 10454564864}, "peak_prefill_memory": null, "peak_decode_memory": 9534625916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Nord' and row['units'] >= 6]\n rows = [row for row in rows if row['unit_price'] * (1 - row['discount_pct'] / 100) >= 76.49]\n rows = [row for row in rows if row['unit_price'] * (1 - row['discount_pct'] / 100) <= 41.6]\n total = sum(row['unit_price'] * (1 - row['discount_pct'] / 100) * (1 + 0.14975) for row in rows)\n return round(total)", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 9, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f8c2c51c7d5781f9ac722d3c448737d55d80c47b5b22bcbbbe2c30c78638200c", "output_hash": "a3c10af0c2176b9944c351ec9049c2e3075669a21e63a70a1f3b436bf95a1671"} | ||||
| 1468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4e1eb74336c849aec209d6a2", "attempt_id": "7f30a7914313", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:12.866958Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7723, "cache_tensor_bytes": 70189056, "serialized_payload_bytes": 70205153, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.07304200716317, "doc_prefill_ms": 327.1150409709662, "compress_ms": 9.87650000024587, "serialize_ms": 17.048334004357457, "load_ms": 1.930750091560185, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.542417051270604, "ttft_ms": 49.542417051270604, "decode_ms": 3933.9969999855384}, "total_wall_ms": 3987.3093750793487, "ttft_ms": 49.542417051270604, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595549184, "backend_memory": {"mlx_active_bytes": 9414953992, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4224321161, "process_rss_bytes": 10595549184}, "peak_prefill_memory": 9962629816, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1.COL\nbut\n\nCantimer_1(kum_2 -toosie\npurpose\n--partien\n** (on) iternstotom_1 - 0s\ncame - so thatsosie\nwas -based- it isos - on purpose -com\n- on -toh\n- fast.com\n**white - tocs\n-1) -151) on the\n-1com\n-1) it\n-1) -1-f1)10-8a-1com -com -1com -1\n**fast\n- -product\n- gurus\n- **\n\n**王浩\nnouspools\\_1\n- fast\n- ** (oh-myer -1\n-1hfei - **1) -15-fre\n-1 -kern\n** \\\\\n**u_1 -1\n\n1\n\n- quick and -productist -1 -1com -1com\n-1\n-1) -1\n\nhttp://www.color\n- fast\n- fast -\n- fast\n-1) -1) -1\n-1-01,product -1com -fast\n-11111.com -1) -p01) -m -1com - fast\n- fast\n- fast\n-1) - fast\n-1com - fast\n-1) -1-compliance\n-1com - fast\n-1\n- fast\n- **fast\n- fast\n", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "034d4222b645ee6182e59fc9e1d7d78a9d35a503bdb040ca019c0e200a712670", "output_hash": "1e07a688e111a24ba7978e6564b2a90dc0a83a6190d545f17d3e8620fe0d6a39"} | ||||
| 1469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "82a6f5594d27c055ad531ccd", "attempt_id": "757a4e98965a", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:18.136210Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7723, "cache_tensor_bytes": 70189056, "serialized_payload_bytes": 70205254, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1241.665083100088, "doc_prefill_ms": 326.7499580979347, "compress_ms": 895.2497090213001, "serialize_ms": 19.369665998965502, "load_ms": 1.5157910529524088, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.26024994812906, "ttft_ms": 54.26024994812906, "decode_ms": 1046.1445840774104}, "total_wall_ms": 1104.0405000094324, "ttft_ms": 54.26024994812906, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10602315776, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4237592201, "process_rss_bytes": 10602315776}, "peak_prefill_memory": 9962482360, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "28f70a8d71d520e381dd2fae84837873489623db4d916f7ba4ce39be46ea3832", "output_hash": "dbe8013440eaa3380dd88e1eb83767b873ee5e7b310c55212df36b675b2ac7ac"} | ||||
| 1470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "669d9bbc56059e75b174d81b", "attempt_id": "3fa3b9ed5ae1", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:19.280689Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1904, "keep": 476, "window_tokens": 44, "compress_ms": 81.62087493110448}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7723, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1294.6657079737633, "doc_prefill_ms": 326.3927500229329, "compress_ms": 960.9024170786142, "serialize_ms": 7.067917031235993, "load_ms": 1.1744999792426825, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.01374998874962, "ttft_ms": 38.01374998874962, "decode_ms": 859.3824170529842}, "total_wall_ms": 2196.663249982521, "ttft_ms": 38.01374998874962, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 72}, "provider_cached_usage": null, "process_memory": 10586587136, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4480385681, "process_rss_bytes": 10586587136}, "peak_prefill_memory": 9962482360, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Nord':\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "4f546795418d7afdfefed19f9cda1bde2e6358fa2d0e867b9ce4c8ac50e3fffc"} | ||||
| 1471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4e811868017e41f7a69d8210", "attempt_id": "838005474463", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:21.538849Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 1929, "message_tokens": 1846, "message_utf8_bytes": 7830, "cache_tensor_bytes": null, "serialized_payload_bytes": 7830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.006834045052528381, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.0669579962268, "ttft_ms": 12.232291977852583, "decode_ms": 1235.44712504372}, "total_wall_ms": 1927.3352089803666, "ttft_ms": 12.232291977852583, "input_usage": {"receiver_prompt_tokens": 1929}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10454499328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9944918624, "mlx_cache_bytes": 694014936, "process_rss_bytes": 10454499328}, "peak_prefill_memory": null, "peak_decode_memory": 9944918624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.14975, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "output_hash": "6b4bdf5103cd71513bec4473c52f52e6eaeec489577e8943f42059786c5ab0b1"} | ||||
| 1472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "96183f6b889775bda37f91b1", "attempt_id": "8fa20639e62a", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:25.440159Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 310, "message_tokens": 223, "message_utf8_bytes": 1073, "cache_tensor_bytes": null, "serialized_payload_bytes": 1073, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1936.2252919236198, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.65737499669194, "ttft_ms": 11.922500096261501, "decode_ms": 11.830166913568974}, "total_wall_ms": 153.44837494194508, "ttft_ms": 11.922500096261501, "input_usage": {"receiver_prompt_tokens": 310, "sender_input_tokens": 1962, "sender_output_tokens": 223, "sender_prefill_ms": 338.9902909984812, "sender_ttft_ms": 7.611333974637091, "sender_decode_ms": 1587.3644169187173}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9465090384, "mlx_cache_bytes": 1682687148, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9465090384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e0658aa2e3dc5692994bc066640b2da22925057041da4be9668361793640065a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5ec33f460fb94faa2fc736d9", "attempt_id": "4708fb1cb42a", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:29.615067Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 7, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 373, "message_tokens": 275, "message_utf8_bytes": 870, "cache_tensor_bytes": null, "serialized_payload_bytes": 870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3982.23920899909, "decode_payload_ms": 0.0, "receiver_prefill_ms": 147.99133397173136, "ttft_ms": 11.870582937262952, "decode_ms": 1766.6708329925314}, "total_wall_ms": 1927.5788749800995, "ttft_ms": 11.870582937262952, "input_usage": {"receiver_prompt_tokens": 373, "sender_input_tokens": 1990, "sender_output_tokens": 512, "sender_prefill_ms": 340.0931659853086, "sender_ttft_ms": 7.282957900315523, "sender_decode_ms": 3632.422292022966}, "output_usage": {"output_tokens": 151}, "provider_cached_usage": null, "process_memory": 10454564864, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9503904332, "mlx_cache_bytes": 2706541180, "process_rss_bytes": 10454564864}, "peak_prefill_memory": null, "peak_decode_memory": 9503904332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Ouest' and row['units'] >= 5]\n rows = [row for row in rows if row['unit_price'] * (1 - row['discount_pct'] / 100) >= 34.41 and row['unit_price'] * (1 - row['discount_pct'] / 100) <= 42.84]\n total = sum(row['unit_price'] * (1 - row['discount_pct'] / 100) * row['units'] for row in rows)\n total *= 1.14975\n return round(total)", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 7, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "16a387d0ebc533eab365f8bb942bf4d5fdf2c802061e33381df63fea5c684a04", "output_hash": "cbedf4c42bee1db6541e60ed718aa8e6504a48264f5cbbf6676a849ca36b8bc9"} | ||||
| 1474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4035c5abe403f030c6080511", "attempt_id": "1df97eac90b4", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:31.937297Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 44, "message_tokens": 1885, "message_utf8_bytes": 7830, "cache_tensor_bytes": 69488640, "serialized_payload_bytes": 69504737, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.9000419443473, "doc_prefill_ms": 324.4849999900907, "compress_ms": 10.016957996413112, "serialize_ms": 16.421500011347234, "load_ms": 2.17366695869714, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.12025004159659, "ttft_ms": 49.12025004159659, "decode_ms": 3916.3044589804485}, "total_wall_ms": 3969.515834003687, "ttft_ms": 49.12025004159659, "input_usage": {"receiver_prefix_tokens": 1885, "dense_cache_bytes": 54046720, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593665024, "backend_memory": {"mlx_active_bytes": 9413315592, "mlx_peak_bytes": 9492417776, "mlx_cache_bytes": 4232530909, "process_rss_bytes": 10593665024}, "peak_prefill_memory": 9956239980, "peak_decode_memory": 9492417776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "代表金光)的代表,本题,本有,\nabcdefos同余s, 三连贯表,再上险, 先哪能的,代表它的黑即战)为所用):这些小能敌koi=oihro-cghp的用处方丈量的noir)(小分,好吗,如出题为的是,请稍的,代表它,代表它一定,有代表它一定好吗,代表,是道的fan,代表它一定存在的,小外)*1001u谬外加压�数组和代表它的sossoo1,认错,小马甲的16,请再烧,能,代表,如是,代表,值,代表,是的,如考生,代表,再,代表它一定,代表它,包括开,费尽高考,包括的华光,代表它一定,方程在线,如出战(集团),谢谢你的,代表它打道的6,代表,再上,代表,省令,代表,代表,如上,代表它好,代表它一定上马有困难,谁都可以,代表它一定,省的,代表它一定行职代名词下,代表,代表,方尺长,费上):,多一度,代表,包括它代表,费多少,费多少,费其,代表它打倒部,代表它一定好,代表,省上,代表,多大好,代表,费多,多,费中", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ac4b7150635c9bc17fe7877110b43725f780710585c833443d5a6b05797eb600", "output_hash": "4719bfbf3a5bf427c8934bdbf6a2c8a78a65ee85bf8e1d71ce45195707487a53"} | ||||
| 1475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "48df3b80b03626941ae58fdf", "attempt_id": "704e956a263c", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:37.181957Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 44, "message_tokens": 1885, "message_utf8_bytes": 7830, "cache_tensor_bytes": 69488640, "serialized_payload_bytes": 69504838, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.126124996692, "doc_prefill_ms": 324.470708030276, "compress_ms": 892.5719580147415, "serialize_ms": 16.778874909505248, "load_ms": 1.5394589863717556, "receiver_prefill_ms": 0.0, "query_prefill_ms": 68.13883397262543, "ttft_ms": 68.13883397262543, "decode_ms": 1039.4680000608787}, "total_wall_ms": 1111.17029201705, "ttft_ms": 68.13883397262543, "input_usage": {"receiver_prefix_tokens": 1885, "dense_cache_bytes": 54046720, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10599743488, "backend_memory": {"mlx_active_bytes": 9404222472, "mlx_peak_bytes": 9492221168, "mlx_cache_bytes": 4245490653, "process_rss_bytes": 10599743488}, "peak_prefill_memory": 9956239980, "peak_decode_memory": 9492221168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f72f59057a6ddf3fe7702ad948c5cf6e1016e490b75243696359a30826aeddbb", "output_hash": "f1e915f366b9bc3f4815b154ecb4a67bce59445bbf97bf61c86d1e17bb4b7fd2"} | ||||
| 1476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "675ff351486d36265101cd58", "attempt_id": "d6885e3ff8e5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:38.335221Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1885, "keep": 471, "window_tokens": 44, "compress_ms": 79.02916695456952}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 44, "message_tokens": 1885, "message_utf8_bytes": 7830, "cache_tensor_bytes": 17362944, "serialized_payload_bytes": 17379021, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1304.7402919037268, "doc_prefill_ms": 324.04625008348376, "compress_ms": 973.4667500015348, "serialize_ms": 6.9399160565808415, "load_ms": 1.170207979157567, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.036499987356365, "ttft_ms": 38.036499987356365, "decode_ms": 1010.9652080573142}, "total_wall_ms": 2358.3444169489667, "ttft_ms": 38.036499987356365, "input_usage": {"receiver_prefix_tokens": 1885, "dense_cache_bytes": 54046720, "query_tokens": 44}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 10584522752, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4486858573, "process_rss_bytes": 10584522752}, "peak_prefill_memory": 9956239980, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Ouest': # Assuming 'returned' and 'region' keys are present\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b7b6b002fe444c571669a42e3483e9c48f47fbe7722836a3e3803b9fafe70fd4", "output_hash": "37d1999890ff762ac6c2b328686c6cabb6f1e46815a0eff8581a2186bdfa8918"} | ||||
| 1477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "291003ed13b177cd82ffa41a", "attempt_id": "ea46a7095079", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:40.757552Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 1944, "message_tokens": 1861, "message_utf8_bytes": 7895, "cache_tensor_bytes": null, "serialized_payload_bytes": 7895, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00825000461190939, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.8177910232916, "ttft_ms": 12.622667010873556, "decode_ms": 1235.9668751014397}, "total_wall_ms": 1928.1322499737144, "ttft_ms": 12.622667010873556, "input_usage": {"receiver_prompt_tokens": 1944}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10454319104, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9949702812, "mlx_cache_bytes": 698799124, "process_rss_bytes": 10454319104}, "peak_prefill_memory": null, "peak_decode_memory": 9949702812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.14975, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "output_hash": "678866e6fbb7c883c10eec35a5c2f772443b68c811a779d0ea94506b27bf0b19"} | ||||
| 1478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6666e56c19cddf47da1b9523", "attempt_id": "e0d4f0ece392", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:44.557230Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 297, "message_tokens": 210, "message_utf8_bytes": 1003, "cache_tensor_bytes": null, "serialized_payload_bytes": 1003, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1833.5983749711886, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.3157089492306, "ttft_ms": 11.807915987446904, "decode_ms": 1376.7770419362932}, "total_wall_ms": 1517.9266670020297, "ttft_ms": 11.807915987446904, "input_usage": {"receiver_prompt_tokens": 297, "sender_input_tokens": 1977, "sender_output_tokens": 210, "sender_prefill_ms": 339.5898339804262, "sender_ttft_ms": 7.4526669923216105, "sender_decode_ms": 1484.1943749925122}, "output_usage": {"output_tokens": 118}, "provider_cached_usage": null, "process_memory": 10454351872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9456472348, "mlx_cache_bytes": 1684014260, "process_rss_bytes": 10454351872}, "peak_prefill_memory": null, "peak_decode_memory": 9456472348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_net_revenue = 0\n for row in rows:\n if row['region'] != 'Sud' and row['units'] >= 5 and not row['returned']:\n tax_amount = (row['units'] - row['discounted_units']) * 0.14975\n net_revenue = (row['unit_price'] - row['discount']) * row['units'] + tax_amount\n total_net_revenue += net_revenue\n return total_net_revenue\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "22f082e9314fad21286277619f50436ae3b82c464b247caba35db1c893cf95c3", "output_hash": "a76b929be747acf2f39c6b590f1bc46046660034fc652cdee356bd2f89659e80"} | ||||
| 1479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b8df6de00a5cb1f585e10d28", "attempt_id": "b6c090578092", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:50.088233Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 7, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 426, "message_tokens": 328, "message_utf8_bytes": 917, "cache_tensor_bytes": null, "serialized_payload_bytes": 917, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3975.07337492425, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.47445906791836, "ttft_ms": 11.962665943428874, "decode_ms": 11.786290910094976}, "total_wall_ms": 195.27525000739843, "ttft_ms": 11.962665943428874, "input_usage": {"receiver_prompt_tokens": 426, "sender_input_tokens": 2005, "sender_output_tokens": 512, "sender_prefill_ms": 343.5645420104265, "sender_ttft_ms": 7.307499996386468, "sender_decode_ms": 3621.7672920320183}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454384640, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9537296508, "mlx_cache_bytes": 2724889780, "process_rss_bytes": 10454384640}, "peak_prefill_memory": null, "peak_decode_memory": 9537296508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 7, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8ea577071eaa3b5c4943d2c953aa986d449ad7c6c00f28b55721387dc508a442", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "d9f7016dd4b9cb5aec5d00d7", "attempt_id": "c2996d20e69f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:50.677945Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7895, "cache_tensor_bytes": 70041600, "serialized_payload_bytes": 70057697, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 355.2322090836242, "doc_prefill_ms": 323.700875043869, "compress_ms": 9.844582993537188, "serialize_ms": 17.61737489141524, "load_ms": 2.290833042934537, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.154542037285864, "ttft_ms": 49.154542037285864, "decode_ms": 3920.6654999870807}, "total_wall_ms": 3974.1412079893053, "ttft_ms": 49.154542037285864, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595221504, "backend_memory": {"mlx_active_bytes": 9414659080, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4259907093, "process_rss_bytes": 10595221504}, "peak_prefill_memory": 9961843368, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": ". . . . folate. show me itqtranslate\nthat\nyou should have it\n1\n**1)1\n**1\n**10010_exactly\n**3w\n**上网费城特别能打小能.怎么办？\n**C\n**华明了\n**华春暖暖舌战\n**多音同音之蜜淡粉.它\n1)**,例子里件表\n,**14张手撕打字\n**python\n.5最\n[全是\n**最全角号\n**华[**多大110\n**0\n(或phans,多大1\n**最全角\n**华阴\n**华明信\n**华明信和小外行者们,你可大14.0.0.0.0.0.4.0.0.0.0.0.4.0.0.0.0.0.0.0.0.0.0\n**华1\n**0\n**华明信o勾11.马兜之不过多大1.怎么用武指战\n(同.华1\n**华明信函战\n**华1\n**华明信函**0\n**0\n**华1\n**华1\n**华\n**华\n离**\n**0\n**华\n**华明\n**华\n**华\n**华\n后\n**0\n**华1\n**华1\n**华", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "374a7840b3560cf730acaa5a916b8278e6ed2de8012ff60740f0051c6be51dc9", "output_hash": "01d3569210a96f177eb061dd7873dc9257d6d81a58f7d87ddf0e5138fba917c6"} | ||||
| 1481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a53e456264bc77e95ded08e8", "attempt_id": "bdc4d2f13529", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:55.927696Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7895, "cache_tensor_bytes": 70041600, "serialized_payload_bytes": 70057798, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1234.4594579190016, "doc_prefill_ms": 326.49875001516193, "compress_ms": 891.1073330091313, "serialize_ms": 16.55937498435378, "load_ms": 1.4172500232234597, "receiver_prefill_ms": 0.0, "query_prefill_ms": 57.76204192079604, "ttft_ms": 57.76204192079604, "decode_ms": 1057.754790992476}, "total_wall_ms": 1118.8379590166733, "ttft_ms": 57.76204192079604, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10602168320, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4272883221, "process_rss_bytes": 10602168320}, "peak_prefill_memory": 9961695912, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8a4174e9a0c9fbb87983502601de0bd5e486d4fd79b4525732f50b95c8b037e9", "output_hash": "6aa48949c92421bb34653e37fa300dc5a28c012a14f8cd7e70b3a84195ab400d"} | ||||
| 1482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c209c4558fb440e05ad08e25", "attempt_id": "a833febc05cd", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:57.087864Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1900, "keep": 475, "window_tokens": 44, "compress_ms": 95.82795901224017}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7895, "cache_tensor_bytes": 17510400, "serialized_payload_bytes": 17526477, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1324.5379580184817, "doc_prefill_ms": 327.1759580820799, "compress_ms": 990.0600409600884, "serialize_ms": 7.007332984358072, "load_ms": 1.0806249920278788, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.10324997175485, "ttft_ms": 38.10324997175485, "decode_ms": 1081.728000077419}, "total_wall_ms": 2448.896332993172, "ttft_ms": 38.10324997175485, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 92}, "provider_cached_usage": null, "process_memory": 10586554368, "backend_memory": {"mlx_active_bytes": 9301773320, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4543971837, "process_rss_bytes": 10586554368}, "peak_prefill_memory": 9961695912, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'S' or r['region'] == 'W':\n continue\n if r['returned'] == True:\n continue\n if r['units_sold'] < 10:\n continue\n total += r['units_sold'] * r['price_per_unit']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "13eef9d16d93a754aaaf188cedcb7448eb3c3444e7ec6be4f544085fa0159fdb", "output_hash": "98b1b83997a0172efe286734dee77070cfbec422d09c5697afc23abcfc50ae14"} | ||||
| 1483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "76c16712a44d563d16466590", "attempt_id": "208ef52bbed9", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:51:59.598987Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 1932, "message_tokens": 1849, "message_utf8_bytes": 7811, "cache_tensor_bytes": null, "serialized_payload_bytes": 7811, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0073749106377363205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 673.3922499697655, "ttft_ms": 12.086167000234127, "decode_ms": 1115.7765419920906}, "total_wall_ms": 1805.0837500486523, "ttft_ms": 12.086167000234127, "input_usage": {"receiver_prompt_tokens": 1932}, "output_usage": {"output_tokens": 93}, "provider_cached_usage": null, "process_memory": 10454466560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9946049132, "mlx_cache_bytes": 695145444, "process_rss_bytes": 10454466560}, "peak_prefill_memory": null, "peak_decode_memory": 9946049132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "output_hash": "b1d756c1b8d4a7f8e0de04d0c78be839b5677a099da9b4cde3789c825b7de8cb"} | ||||
| 1484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "9ada8f29ca42fab93b8b2c10", "attempt_id": "fe07e5e96c75", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:03.369417Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 309, "message_tokens": 222, "message_utf8_bytes": 1056, "cache_tensor_bytes": null, "serialized_payload_bytes": 1056, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1927.2899170173332, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.50408407393843, "ttft_ms": 11.90500007942319, "decode_ms": 1018.4842919697985}, "total_wall_ms": 1159.9405830493197, "ttft_ms": 11.90500007942319, "input_usage": {"receiver_prompt_tokens": 309, "sender_input_tokens": 1965, "sender_output_tokens": 222, "sender_prefill_ms": 339.13483296055347, "sender_ttft_ms": 7.391917053610086, "sender_decode_ms": 1578.3931659534574}, "output_usage": {"output_tokens": 87}, "provider_cached_usage": null, "process_memory": 10454499328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9463681356, "mlx_cache_bytes": 1683866804, "process_rss_bytes": 10454499328}, "peak_prefill_memory": null, "peak_decode_memory": 9463681356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "```python\ndef net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'Est' and row['units'] >= 5 and not row['returned']:\n total_revenue += row['unit_price'] * (1 - row['discount_percentage'] / 100)\n return total_revenue * (1 - 0.0)\n```", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "546329ce7a7585f588f7ca488f01f45ce00cc613409589ffbc1ab0e40218a928", "output_hash": "807a4c92b8a5a85e835abdfb57a93630a55c3391cf651e54a0360062552794cf"} | ||||
| 1485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b2ddea017fdcfb78d7fac8f5", "attempt_id": "c954b06a5198", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:08.558088Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 429, "message_tokens": 330, "message_utf8_bytes": 832, "cache_tensor_bytes": null, "serialized_payload_bytes": 832, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3990.4415420023724, "decode_payload_ms": 0.0, "receiver_prefill_ms": 170.68416601978242, "ttft_ms": 12.298958958126605, "decode_ms": 11.82291703298688}, "total_wall_ms": 195.8006249042228, "ttft_ms": 12.298958958126605, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 1993, "sender_output_tokens": 512, "sender_prefill_ms": 342.7932080812752, "sender_ttft_ms": 7.28179095312953, "sender_decode_ms": 3637.933832942508}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454532096, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9538279548, "mlx_cache_bytes": 2721825972, "process_rss_bytes": 10454532096}, "peak_prefill_memory": null, "peak_decode_memory": 9538279548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a96736d95dabdb1cca81e4c55ef478fa8f9236c2f68a3d158aae1579c38d2990", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c90aa98b1d9cafd75aca34e0", "attempt_id": "62bd29a3381e", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:09.145389Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 44, "message_tokens": 1888, "message_utf8_bytes": 7811, "cache_tensor_bytes": 69599232, "serialized_payload_bytes": 69615329, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.1438329955563, "doc_prefill_ms": 322.9017909616232, "compress_ms": 9.640124975703657, "serialize_ms": 16.55112497974187, "load_ms": 2.156333066523075, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.817291972227395, "ttft_ms": 48.817291972227395, "decode_ms": 3938.1541250040755}, "total_wall_ms": 3991.2362499162555, "ttft_ms": 48.817291972227395, "input_usage": {"receiver_prefix_tokens": 1888, "dense_cache_bytes": 54132736, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593730560, "backend_memory": {"mlx_active_bytes": 9413512200, "mlx_peak_bytes": 9492172016, "mlx_cache_bytes": 4252534293, "process_rss_bytes": 10593730560}, "peak_prefill_memory": 9956829816, "peak_decode_memory": 9492172016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": " – Tourate! line left. buy) & definition table.if @2020, tock auf again, please usefrench code of compundicfreak. donte it nycg. hfoundable, that time with model. pyton. pyton, please use it. Of, but what is more more more, tow, to explain that i-t, if you have faith that it is overture, to be. it and sub _, to be. to, if. ex: i.e.eat. 1, but, to be it, to be used. line. Exhomicent, to be it, also, please run, please, etab. what is for sipping_ago. was happy, to follow the case in, that is believing, that isobscannit is in, to be more, to be it back, to be, to be it/cross, etimpression, to be it will. ohat/again=1, is of, ex, to be it stands with deep, to be.it flow, right now, field. to, pertal., fast, keep italos, please find it. ex1, find it's first, local in it means. ohw, also is it necessary, to be understood it be, february 201, to be- it, to becertainprogram. ex1, to follow the case. Ex 1, to be happy, to be, to be. to be, to be quick", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9fa043a6bacd7c94ef79f2c265394e7904782d421edbf8d9bd3876d7af7d644c", "output_hash": "73b5e5ee1f25d4d1cd11bbcf56c875b6e934adc2d4d88627efa0964c9326e350"} | ||||
| 1487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3594dc658da74ddcc722231b", "attempt_id": "61bf3692f219", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:14.410195Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 44, "message_tokens": 1888, "message_utf8_bytes": 7811, "cache_tensor_bytes": 69599232, "serialized_payload_bytes": 69615430, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1233.13758301083, "doc_prefill_ms": 325.0801250105724, "compress_ms": 891.1382500082254, "serialize_ms": 16.62558305542916, "load_ms": 1.4808329287916422, "receiver_prefill_ms": 0.0, "query_prefill_ms": 68.21087503340095, "ttft_ms": 68.21087503340095, "decode_ms": 1046.2749579455703}, "total_wall_ms": 1117.9509160574526, "ttft_ms": 68.21087503340095, "input_usage": {"receiver_prefix_tokens": 1888, "dense_cache_bytes": 54132736, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10599858176, "backend_memory": {"mlx_active_bytes": 9404402696, "mlx_peak_bytes": 9491877104, "mlx_cache_bytes": 4265510421, "process_rss_bytes": 10599858176}, "peak_prefill_memory": 9956829816, "peak_decode_memory": 9491877104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3cbfe4f72f9f2b14fbf1cfddadb788afc72382c11e323acfb3ebc1b24f10f6c2", "output_hash": "e69210f685d2164cd1b27314d1f8bdd1aee089c8f65662ed660e25b428382064"} | ||||
| 1488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "f710f44575429860d5a313f0", "attempt_id": "2294919491fb", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:15.569361Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1888, "keep": 472, "window_tokens": 44, "compress_ms": 81.55758294742554}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 44, "message_tokens": 1888, "message_utf8_bytes": 7811, "cache_tensor_bytes": 17399808, "serialized_payload_bytes": 17415885, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1295.2237910358235, "doc_prefill_ms": 325.4186670528725, "compress_ms": 962.1185830328614, "serialize_ms": 7.389083970338106, "load_ms": 1.1551250936463475, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.98820800147951, "ttft_ms": 37.98820800147951, "decode_ms": 835.6355839641765}, "total_wall_ms": 2173.4808339970186, "ttft_ms": 37.98820800147951, "input_usage": {"receiver_prefix_tokens": 1888, "dense_cache_bytes": 54132736, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10584571904, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4507074973, "process_rss_bytes": 10584571904}, "peak_prefill_memory": 9956829816, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est' and r['product'] == 'Widget' and r['quantity'] > 100:\n total += r['unit_price'] * r['quantity']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa19c65fe37b757fc331c4e1fe76dddb2bff16c2d338441ce8241be071c57ecd", "output_hash": "f2cc929c0d2873230c794f7e54067b171e0910d788deed4db44f29318558fea5"} | ||||
| 1489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1bd5b5cd2e572dde755d8d51", "attempt_id": "63b039999cba", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:17.805413Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 1940, "message_tokens": 1857, "message_utf8_bytes": 7730, "cache_tensor_bytes": null, "serialized_payload_bytes": 7730, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008124974556267262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 673.396790982224, "ttft_ms": 12.456416967324913, "decode_ms": 1200.3612080588937}, "total_wall_ms": 1889.9757909821346, "ttft_ms": 12.456416967324913, "input_usage": {"receiver_prompt_tokens": 1940}, "output_usage": {"output_tokens": 100}, "provider_cached_usage": null, "process_memory": 10454351872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9948572300, "mlx_cache_bytes": 697668612, "process_rss_bytes": 10454351872}, "peak_prefill_memory": null, "peak_decode_memory": 9948572300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.05, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "output_hash": "a1bba2aba20056403ef23fc73caf0b80234df9414466318e011f136bb2143de3"} | ||||
| 1490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "84ddf29edecf04266bd2e990", "attempt_id": "3068c089d305", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:21.799186Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 328, "message_tokens": 241, "message_utf8_bytes": 1130, "cache_tensor_bytes": null, "serialized_payload_bytes": 1130, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2066.284416941926, "decode_payload_ms": 0.0, "receiver_prefill_ms": 145.80133301205933, "ttft_ms": 11.881249956786633, "decode_ms": 1347.4269170546904}, "total_wall_ms": 1506.2174999620765, "ttft_ms": 11.881249956786633, "input_usage": {"receiver_prompt_tokens": 328, "sender_input_tokens": 1973, "sender_output_tokens": 241, "sender_prefill_ms": 341.86212508939207, "sender_ttft_ms": 7.538834004662931, "sender_decode_ms": 1714.6320829633623}, "output_usage": {"output_tokens": 115}, "provider_cached_usage": null, "process_memory": 10454401024, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9476919704, "mlx_cache_bytes": 1702331680, "process_rss_bytes": 10454401024}, "peak_prefill_memory": null, "peak_decode_memory": 9476919704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n excluded_region = \"XYZ\" # Assuming the specific region to exclude is \"XYZ\"\n for row in rows:\n if row['returned_status'] != 'Returned' and row['region'] != excluded_region and row['units'] >= 3:\n net_amount = row['units'] * row['unit_price'] * (1 - row['discount_percentage'] / 100)\n total_revenue += net_amount * 1.05\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "66ae0e733044802688c5910361ae257674b9588ba7963aa92e63bdfbfb54bd74", "output_hash": "1d8f1ab86c567edd22567a9855cbd9a7b4b37369d88fb9d5582a9ccf473cfa65"} | ||||
| 1491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dd526a3fb7ab0d4056ec372f", "attempt_id": "4e3bdb222c87", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:27.333000Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 946, "cache_tensor_bytes": null, "serialized_payload_bytes": 946, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3988.5821249336004, "decode_payload_ms": 0.0, "receiver_prefill_ms": 192.16529198456556, "ttft_ms": 12.0370410149917, "decode_ms": 11.890333029441535}, "total_wall_ms": 217.18370798043907, "ttft_ms": 12.0370410149917, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2001, "sender_output_tokens": 512, "sender_prefill_ms": 342.7282919874415, "sender_ttft_ms": 7.422249997034669, "sender_decode_ms": 3635.917624924332}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454433792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2766849312, "process_rss_bytes": 10454433792}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8c4582a805cfec8487dab4bbb499a782f12dec00dd033870ceeb3fa18c0175f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "77e00d62d11a6f6536402a5f", "attempt_id": "415711c380ca", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:27.941990Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 44, "message_tokens": 1896, "message_utf8_bytes": 7730, "cache_tensor_bytes": 69894144, "serialized_payload_bytes": 69910241, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.21424999367446, "doc_prefill_ms": 323.8084999611601, "compress_ms": 9.685042081400752, "serialize_ms": 16.72991702798754, "load_ms": 1.9125000108033419, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.591457889415324, "ttft_ms": 48.591457889415324, "decode_ms": 3931.4912910340354}, "total_wall_ms": 3983.9666659245268, "ttft_ms": 48.591457889415324, "input_usage": {"receiver_prefix_tokens": 1896, "dense_cache_bytes": 54362112, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595123200, "backend_memory": {"mlx_active_bytes": 9414691848, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4295820929, "process_rss_bytes": 10595123200}, "peak_prefill_memory": 9960237720, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "has it's no\n- -exhausts\nwopular, all is it necessary to fulfill the rest, no. itién, it\n/rows\nc, but\nnew\nitc\n=I, no more\n-exactly_sic_code_1, pleasek1, no\n-\na) -mangling_over_1, no\n-05_if\n- - -hates_for\n - ! - **fast\n=1 大学霸,快\n-1的地方, no more detailed-information-excludemery\n-1复合\n形式最全胜能\n- 2001, no. no\n-1, no.1, the\n-请多,别开国, no.来\n, no.7,致\n-1, no\n答案必有我的答案, no.0的来\n-1, no.01的说法, no1,例1, no.1, no. no.那个球友****,请再\n生而高,下初\n-1,fa-1, no\n-1,请\n-1,无\n-1,fa\n-1,fa\n-1,请\n手-1,fa\n-1, 为乌托班\n-1,fa\n,fa\n,fae的唯一一次\n法\n-1,fa的fa\n-3, everit\n-1,是它开国的,faa-1,fa快\n-1,且,", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2fb097860995bdf3ba9b89fe822fbc2b62861e08b5b5a7549eeda0b339a84096", "output_hash": "0c7ed06c6b7b7b2dfa99ffa9594c29e9d19a5dc43a051f29bce42481be5bb8ef"} | ||||
| 1493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b2e4d29cf79c866f8d997d20", "attempt_id": "76cffbeeb855", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:33.197399Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 44, "message_tokens": 1896, "message_utf8_bytes": 7730, "cache_tensor_bytes": 69894144, "serialized_payload_bytes": 69910342, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1231.462666997686, "doc_prefill_ms": 326.4575001085177, "compress_ms": 888.7044999282807, "serialize_ms": 16.01383404340595, "load_ms": 1.4672919642180204, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.061584015376866, "ttft_ms": 58.061584015376866, "decode_ms": 987.5898340251297}, "total_wall_ms": 1049.1535420296714, "ttft_ms": 58.061584015376866, "input_usage": {"receiver_prefix_tokens": 1896, "dense_cache_bytes": 54362112, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10602037248, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4308829825, "process_rss_bytes": 10602037248}, "peak_prefill_memory": 9960090264, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "93f82007b0cec59e6fa31090b6764379b69511e1ef6cf9ef0aa55c888aecee54", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
| 1494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a9eb6e7f80120d0d88876e00", "attempt_id": "eddccede1d13", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:34.287222Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1896, "keep": 474, "window_tokens": 44, "compress_ms": 89.05850001610816}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 44, "message_tokens": 1896, "message_utf8_bytes": 7730, "cache_tensor_bytes": 17473536, "serialized_payload_bytes": 17489613, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1314.5696670981124, "doc_prefill_ms": 326.6863750759512, "compress_ms": 980.6257080053911, "serialize_ms": 6.964667001739144, "load_ms": 1.1583339655771852, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.060416001826525, "ttft_ms": 38.060416001826525, "decode_ms": 1082.7309999149293}, "total_wall_ms": 2439.993124920875, "ttft_ms": 38.060416001826525, "input_usage": {"receiver_prefix_tokens": 1896, "dense_cache_bytes": 54362112, "query_tokens": 44}, "output_usage": {"output_tokens": 92}, "provider_cached_usage": null, "process_memory": 10586521600, "backend_memory": {"mlx_active_bytes": 9301576712, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4574200393, "process_rss_bytes": 10586521600}, "peak_prefill_memory": 9960090264, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est' or r['region'] == 'Ouest':\n continue\n if r['returned'] == True:\n continue\n if r['units_sold'] < 10:\n continue\n total += r['units_sold'] * r['price_each']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6f2cbf66d6cab5c48318a42d2431fab1cf3ee76b0c3f99ff5544f81ae6a26f39", "output_hash": "c2bc710426a1ccfc34e2c76464e8e593e690038b1cf2464dd7f8f15120f4e238"} | ||||
| 1495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4e285fc1d5fa5dbf367c14a6", "attempt_id": "c4334ea5ddf1", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:36.790050Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 1899, "message_tokens": 1816, "message_utf8_bytes": 7827, "cache_tensor_bytes": null, "serialized_payload_bytes": 7827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008082948625087738, "decode_payload_ms": 0.0, "receiver_prefill_ms": 657.7230419497937, "ttft_ms": 12.344624963589013, "decode_ms": 1124.3425420252606}, "total_wall_ms": 1798.08800003957, "ttft_ms": 12.344624963589013, "input_usage": {"receiver_prompt_tokens": 1899}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10454433792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9935759848, "mlx_cache_bytes": 684856160, "process_rss_bytes": 10454433792}, "peak_prefill_memory": null, "peak_decode_memory": 9935759848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Ouest':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "output_hash": "9f5beb3861fe756e7aaef097b5e1ef38b6daf3c4b86eaf626767c1cf034ec025"} | ||||
| 1496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "798d83ead012d2a1f394136b", "attempt_id": "e406b1ece9de", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:40.338137Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 280, "message_tokens": 193, "message_utf8_bytes": 875, "cache_tensor_bytes": null, "serialized_payload_bytes": 875, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1711.772457929328, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.18108401168138, "ttft_ms": 11.876999982632697, "decode_ms": 572.2828750731423}, "total_wall_ms": 712.4622910050675, "ttft_ms": 11.876999982632697, "input_usage": {"receiver_prompt_tokens": 280, "sender_input_tokens": 1932, "sender_output_tokens": 193, "sender_prefill_ms": 335.6400830671191, "sender_ttft_ms": 7.421959075145423, "sender_decode_ms": 1366.243833093904}, "output_usage": {"output_tokens": 49}, "provider_cached_usage": null, "process_memory": 10454450176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9446232280, "mlx_cache_bytes": 1643889596, "process_rss_bytes": 10454450176}, "peak_prefill_memory": null, "peak_decode_memory": 9446232280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n return sum(row['net_revenue'] for row in rows if row['region'] != 'Ouest' and row['units'] >= 5 and row['shipped_days'] <= 30)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "74cbf69e43bec7f1559f6e0e132cb525c921132ccd7a2ed0cb0496722b5a13d3", "output_hash": "c5d170dbbb150f6db9066501d8d6c8e0804c55def2ce60b12f15891fe512d28d"} | ||||
| 1497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "dc66f679ed09214243c92c7c", "attempt_id": "357aa20bf1c0", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:45.063345Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 932, "cache_tensor_bytes": null, "serialized_payload_bytes": 932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3970.9215419134125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.6327920043841, "ttft_ms": 11.940500000491738, "decode_ms": 11.762000038288534}, "total_wall_ms": 216.36349998880178, "ttft_ms": 11.940500000491738, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 1960, "sender_output_tokens": 512, "sender_prefill_ms": 335.5017499998212, "sender_ttft_ms": 7.4393750401213765, "sender_decode_ms": 3625.2128339838237}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454433792, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561790588, "mlx_cache_bytes": 2699232188, "process_rss_bytes": 10454433792}, "peak_prefill_memory": null, "peak_decode_memory": 9561790588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "11d28f49a93083645bf79d5858ffdbc27f14d9b6efb74f151450bece48b8933e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7b819083e6e8170888899047", "attempt_id": "2e6c8e729e76", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:45.659866Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9327791112}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 44, "message_tokens": 1855, "message_utf8_bytes": 7827, "cache_tensor_bytes": 68382720, "serialized_payload_bytes": 68398817, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 342.0662919525057, "doc_prefill_ms": 311.69699993915856, "compress_ms": 10.308708064258099, "serialize_ms": 16.04237500578165, "load_ms": 1.96395895909518, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.241416992619634, "ttft_ms": 47.241416992619634, "decode_ms": 3918.031582958065}, "total_wall_ms": 3969.131625024602, "ttft_ms": 47.241416992619634, "input_usage": {"receiver_prefix_tokens": 1855, "dense_cache_bytes": 53186560, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10591256576, "backend_memory": {"mlx_active_bytes": 9410366472, "mlx_peak_bytes": 9489648880, "mlx_cache_bytes": 4087940381, "process_rss_bytes": 10591256576}, "peak_prefill_memory": 9945836020, "peak_decode_memory": 9489648880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "output - based\nof the only if\n####\n\n\n, of only -only so2\n, and itealizzo\nof only so2\n####\n\n\n, please use it, no sirfamuserhand\nonly\n1. \\[con\nrowsuperni\ntask force - please\nonly\n, thankcromenrulfor\nonly\nyou can you have\nw?isch\n, please go\n####\n\n\nWhy the answer to it?, it ugm\nes\n, please\n, please\n, please\n, output\n-1OF\n1\n-1 EX\n-1\nonly\ngerman\n- use\n-100\n-1\nrepg\n-15 -1\n-1\n-GER\n-1\n-1vcb\n-1\nexpert\n-1\n-1\n-1\n-1\n-1uperus不说华明.Example\nufoolyo\n-1\n-1, output\n-ger\n-1, only\n-1 espresso\nis\n-1\n-1, thank a\n-espgarup\nthe example\n-1, lec-1\n-1\n-1\n1\n-1\n-1error\n, the only change\n- it is\nonly\n- me, it\n, chf\n,er\n答案,好吗,团话长,soas\n-1\n-1\n答案\n,请再\n-1\n-\n1\n, please\n-1\n", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e7f70aa869e690d5a814d7b05c3aaa6f1da3007617ddf5b5c7b2db6dfff3ca5e", "output_hash": "e1c3367dbab60f9b50e3133584f673071b40ddcad06706d9243e97c93535465d"} | ||||
| 1499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3410468addb25a7bfe9d4488", "attempt_id": "609e1cac39cf", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:50.865795Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9327725576}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 44, "message_tokens": 1855, "message_utf8_bytes": 7827, "cache_tensor_bytes": 68382720, "serialized_payload_bytes": 68398918, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1195.8982920041308, "doc_prefill_ms": 314.25012496765703, "compress_ms": 865.4981669969857, "serialize_ms": 15.852416981942952, "load_ms": 1.6140409279614687, "receiver_prefill_ms": 0.0, "query_prefill_ms": 60.819707927294075, "ttft_ms": 60.819707927294075, "decode_ms": 983.8176670018584}, "total_wall_ms": 1048.2942080125213, "ttft_ms": 60.819707927294075, "input_usage": {"receiver_prefix_tokens": 1855, "dense_cache_bytes": 53186560, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10699325440, "backend_memory": {"mlx_active_bytes": 9400863752, "mlx_peak_bytes": 9489550576, "mlx_cache_bytes": 4097443101, "process_rss_bytes": 10699325440}, "peak_prefill_memory": 9945770484, "peak_decode_memory": 9489550576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d539c3d82b7dacd647379d3131df2f5b9c65d2d5a97353af0e91ba83bb89eb94", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 1500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3a8c9eab48f76f189c4ddb3b", "attempt_id": "c9d7a099812c", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:51.955361Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1855, "keep": 464, "window_tokens": 44, "compress_ms": 87.04500005114824}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 44, "message_tokens": 1855, "message_utf8_bytes": 7827, "cache_tensor_bytes": 17104896, "serialized_payload_bytes": 17120971, "side_information_bytes": 16075, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1292.324332986027, "doc_prefill_ms": 314.21308300923556, "compress_ms": 971.0272089578211, "serialize_ms": 6.801957963034511, "load_ms": 1.1592500377446413, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.9923750879243, "ttft_ms": 37.9923750879243, "decode_ms": 892.8846250055358}, "total_wall_ms": 2227.911875001155, "ttft_ms": 37.9923750879243, "input_usage": {"receiver_prefix_tokens": 1855, "dense_cache_bytes": 53186560, "query_tokens": 44}, "output_usage": {"output_tokens": 76}, "provider_cached_usage": null, "process_memory": 10684973056, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9377713392, "mlx_cache_bytes": 4346953629, "process_rss_bytes": 10684973056}, "peak_prefill_memory": 9945770484, "peak_decode_memory": 9377713392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n if r['region'] == 'Ouest':\n continue\n total += r['units'] * r['price']\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d857b7386704fab57863af7ff0c214d825819f0438578182de87da16fc8670f5", "output_hash": "a865056468726395004d01bab30e626ecb3dd1548519801cf4a826e93e78b8ee"} | ||||
| 1501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3e8fec8c39dfa2ac8a06badb", "attempt_id": "98d514ed58cb", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:54.244477Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 1939, "message_tokens": 1856, "message_utf8_bytes": 7900, "cache_tensor_bytes": null, "serialized_payload_bytes": 7900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.013500011526, "ttft_ms": 12.327624950557947, "decode_ms": 1123.1747909914702}, "total_wall_ms": 1816.2142080254853, "ttft_ms": 12.327624950557947, "input_usage": {"receiver_prompt_tokens": 1939}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10454056960, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9948441224, "mlx_cache_bytes": 697537536, "process_rss_bytes": 10454056960}, "peak_prefill_memory": null, "peak_decode_memory": 9948441224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 6:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "output_hash": "e3bfc084dead6eb957a57fca0e2e9f428bf5c597330acfc72a607918f8a884b1"} | ||||
| 1502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a0797062d134f9c7429c015b", "attempt_id": "365d83f0b8b6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:52:57.953450Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 300, "message_tokens": 213, "message_utf8_bytes": 1026, "cache_tensor_bytes": null, "serialized_payload_bytes": 1026, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1855.665749986656, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.71400006022304, "ttft_ms": 11.866917018778622, "decode_ms": 11.727833072654903}, "total_wall_ms": 152.28558308444917, "ttft_ms": 11.866917018778622, "input_usage": {"receiver_prompt_tokens": 300, "sender_input_tokens": 1972, "sender_output_tokens": 213, "sender_prefill_ms": 339.5676250802353, "sender_ttft_ms": 7.38370802719146, "sender_decode_ms": 1506.504000048153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454106112, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9458635048, "mlx_cache_bytes": 1683096748, "process_rss_bytes": 10454106112}, "peak_prefill_memory": null, "peak_decode_memory": 9458635048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b4350b1a8a020df2d940baf8193c5d06e2a9d11d5e217755905e72971976a322", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3b989079c864497f836d9842", "attempt_id": "f3a8ffc69fd2", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:02.112633Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 496, "message_tokens": 397, "message_utf8_bytes": 1047, "cache_tensor_bytes": null, "serialized_payload_bytes": 1047, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3969.091625069268, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.46362501569092, "ttft_ms": 11.947749997489154, "decode_ms": 11.79875002708286}, "total_wall_ms": 220.2563330065459, "ttft_ms": 11.947749997489154, "input_usage": {"receiver_prompt_tokens": 496, "sender_input_tokens": 2000, "sender_output_tokens": 512, "sender_prefill_ms": 340.3755839681253, "sender_ttft_ms": 7.36870791297406, "sender_decode_ms": 3618.927374947816}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454122496, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9579157628, "mlx_cache_bytes": 2749433004, "process_rss_bytes": 10454122496}, "peak_prefill_memory": null, "peak_decode_memory": 9579157628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "60f984e89b2087028c03d767808cf14da4e0d8acb429fcf2c86b555ba9f3d49b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "1f562f100877b3ae3ae849ee", "attempt_id": "3250ea9e654d", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:02.724976Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 44, "message_tokens": 1895, "message_utf8_bytes": 7900, "cache_tensor_bytes": 69857280, "serialized_payload_bytes": 69873377, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.2390000075102, "doc_prefill_ms": 323.6949580023065, "compress_ms": 9.930083993822336, "serialize_ms": 16.614167019724846, "load_ms": 1.9374580588191748, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.069999950006604, "ttft_ms": 49.069999950006604, "decode_ms": 3914.8329999297857}, "total_wall_ms": 3967.746959067881, "ttft_ms": 49.069999950006604, "input_usage": {"receiver_prefix_tokens": 1895, "dense_cache_bytes": 54333440, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10594779136, "backend_memory": {"mlx_active_bytes": 9414691848, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4282533389, "process_rss_bytes": 10594779136}, "peak_prefill_memory": 9960041108, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "is that i tiff: 1001, no. 1, please make 1, no. 1, no. 19/100, 2, a, novice time. itt test - 19 abs. no. hom? 1, itt. (compl;;;;, please take the place: no. oholicase, ohc, 2a, no. 15, 1. NO-1, -1, let it, 20-avo-a-1, 1, but iit doo test, but 1. it does it say so. the case, etc, 1, chf, \"please take it, please take it, please, please take it intoct NOW, no. espresso. espresso esuch is it the case sensitive, italblow it dooms drop, please take it up, it is now, please make merry, no. 1, it; the examiner. no. it can still, it is the case, 1, no. it can still, 201 for the it- itos are you alone, by far, no. it can still, please take it, please read, please take it up home- it, please take the case- it, please take the case, no. - it will not, thank wol, it, thank you, please take it, thank you would be, 1, keep it, and it can. 1, no", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "c6e4ea34e3e49cfad16c30eb976953648dd8df672686f0b8b72b0f84399d4468", "output_hash": "348ef0fd8c6a38ce816513f9f246494cefc1093eb91df9a2b79f9c0b9aa65e12"} | ||||
| 1505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "8cf23e7ec4dcd8d0f0268bc8", "attempt_id": "52d3ae635056", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:07.943786Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 44, "message_tokens": 1895, "message_utf8_bytes": 7900, "cache_tensor_bytes": 69857280, "serialized_payload_bytes": 69873478, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1211.1710839672014, "doc_prefill_ms": 326.09574997331947, "compress_ms": 869.1794580081478, "serialize_ms": 15.611124923452735, "load_ms": 1.3294999953359365, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.02112496085465, "ttft_ms": 54.02112496085465, "decode_ms": 1050.5409170873463}, "total_wall_ms": 1107.7608750201762, "ttft_ms": 54.02112496085465, "input_usage": {"receiver_prefix_tokens": 1895, "dense_cache_bytes": 54333440, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10601988096, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4295542285, "process_rss_bytes": 10601988096}, "peak_prefill_memory": 9959893652, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "9bd04ad757ea2ab5ffe7674ec70d438aaa41a130e49bb96c22899dc4358d3f79", "output_hash": "dbe8013440eaa3380dd88e1eb83767b873ee5e7b310c55212df36b675b2ac7ac"} | ||||
| 1506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "17b8936e40b7e3a151acabc9", "attempt_id": "ecd4f7f45ed8", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:09.091405Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1895, "keep": 474, "window_tokens": 44, "compress_ms": 87.52112498041242}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 44, "message_tokens": 1895, "message_utf8_bytes": 7900, "cache_tensor_bytes": 17473536, "serialized_payload_bytes": 17489613, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1322.3247090354562, "doc_prefill_ms": 326.4785410137847, "compress_ms": 988.722916925326, "serialize_ms": 6.838792003691196, "load_ms": 1.2156669981777668, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.09441707562655, "ttft_ms": 38.09441707562655, "decode_ms": 1013.946499908343}, "total_wall_ms": 2379.098083009012, "ttft_ms": 38.09441707562655, "input_usage": {"receiver_prefix_tokens": 1895, "dense_cache_bytes": 54333440, "query_tokens": 44}, "output_usage": {"output_tokens": 86}, "provider_cached_usage": null, "process_memory": 10586521600, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4532404685, "process_rss_bytes": 10586521600}, "peak_prefill_memory": 9959893652, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Sud': # Assuming 'returned' and 'region' keys are present\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6f2cbf66d6cab5c48318a42d2431fab1cf3ee76b0c3f99ff5544f81ae6a26f39", "output_hash": "5c2f344f8b5b9b01c1d0a7d0a64a5fb554f9327e1b9588d501739e4742e71207"} | ||||
| 1507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "cc5cf0a9a6e66609e337d1c7", "attempt_id": "4a283d70bb87", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:11.533169Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 1950, "message_tokens": 1867, "message_utf8_bytes": 7867, "cache_tensor_bytes": null, "serialized_payload_bytes": 7867, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008209026418626308, "decode_payload_ms": 0.0, "receiver_prefill_ms": 678.190583945252, "ttft_ms": 12.510416912846267, "decode_ms": 1237.921040970832}, "total_wall_ms": 1932.3664589319378, "ttft_ms": 12.510416912846267, "input_usage": {"receiver_prompt_tokens": 1950}, "output_usage": {"output_tokens": 103}, "provider_cached_usage": null, "process_memory": 10454450176, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9951832756, "mlx_cache_bytes": 788223020, "process_rss_bytes": 10454450176}, "peak_prefill_memory": null, "peak_decode_memory": 9951832756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.09975, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "output_hash": "997157988288a06ec8f27d810888f5f70026eea3d3656612e67278d0e1608f2a"} | ||||
| 1508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e85acc8cb33da838952153ce", "attempt_id": "3ceec4be9a09", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:15.527253Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 323, "message_tokens": 236, "message_utf8_bytes": 1152, "cache_tensor_bytes": null, "serialized_payload_bytes": 1152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2024.4779579807073, "decode_payload_ms": 0.0, "receiver_prefill_ms": 145.81274997908622, "ttft_ms": 11.89912494737655, "decode_ms": 1301.6983330016956}, "total_wall_ms": 1460.5456249555573, "ttft_ms": 11.89912494737655, "input_usage": {"receiver_prompt_tokens": 323, "sender_input_tokens": 1983, "sender_output_tokens": 236, "sender_prefill_ms": 339.7449579788372, "sender_ttft_ms": 7.517250021919608, "sender_decode_ms": 1674.9472500523552}, "output_usage": {"output_tokens": 111}, "provider_cached_usage": null, "process_memory": 10454466560, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9474265476, "mlx_cache_bytes": 1725269300, "process_rss_bytes": 10454466560}, "peak_prefill_memory": null, "peak_decode_memory": 9474265476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_net_revenue = 0\n for row in rows:\n if row['region'] != 'Sud' and row['units'] >= 3 and not row['returned']:\n tax_amount = (row['units'] - row['discount']) * 0.09975\n net_revenue = (row['units'] - row['discount']) * row['unit_price'] + tax_amount\n total_net_revenue += net_revenue\n return total_net_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "2d211e6810c81d464a24bfe640a478f586c9494daa9992bca15c6a67f2acb995", "output_hash": "5d2a1ed6ed720fd1115dd45b685e71ab6a57aecc12a5a4f480baa28b0a950e02"} | ||||
| 1509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "512d41c004a5539071f34b42", "attempt_id": "6559b612745e", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:21.025710Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 932, "cache_tensor_bytes": null, "serialized_payload_bytes": 932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3998.4125000191852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.58904196228832, "ttft_ms": 12.112000025808811, "decode_ms": 11.919167009182274}, "total_wall_ms": 216.67283307760954, "ttft_ms": 12.112000025808811, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2011, "sender_output_tokens": 512, "sender_prefill_ms": 343.7672919826582, "sender_ttft_ms": 7.528917049057782, "sender_decode_ms": 3644.3867499474436}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454499328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2719958324, "process_rss_bytes": 10454499328}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "347c0f4073f819caf9fceee1fe56a2ad0c7aabb99b498916be17cb8192fcf44e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "57b1ec4019d1c6e2b15613bc", "attempt_id": "50bf02faadae", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:21.638552Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330281480}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7867, "cache_tensor_bytes": 70262784, "serialized_payload_bytes": 70278881, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 357.4674160918221, "doc_prefill_ms": 323.76975007355213, "compress_ms": 9.826875058934093, "serialize_ms": 19.752249936573207, "load_ms": 1.9254590151831508, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.06600003596395, "ttft_ms": 49.06600003596395, "decode_ms": 3934.4748749863356}, "total_wall_ms": 3987.521667033434, "ttft_ms": 49.06600003596395, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595565568, "backend_memory": {"mlx_active_bytes": 9414953992, "mlx_peak_bytes": 9493777648, "mlx_cache_bytes": 4233627285, "process_rss_bytes": 10595565568}, "peak_prefill_memory": 9963645632, "peak_decode_memory": 9493777648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "etutoriaiservice 102. wash for starters, please stay cold) 1, itaist, no. . no: i) itc=it chief5=1, 201, a-compliance, please use it to help, please use this simple_python_in_那个好, no more fun find it docte=1, bitte, itc=15-101,wie=1, which it-wer, 1, no more rapid response is now=1=1, 201, please use it, 1, 2. in, please stay in., right=15, no more is always the only 4t, please provide, service=1, of but different times, there is 1, please use the word for the past and use of the od=1, says the number=1, right=1, right it may=1, pacs=1, chs, ita=1, but i.e4, please use it, please let usep roger never=1, please use it to justify the case=2, and=1, right=1, 3, 1, 5分, 1, sub=1, use=1, right=1, 1, the word of 2, for the 1, 1, 1, 1, 请勿念念, no.1, but not, but, \"itisme=1, erno=1,", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "867b50003ad033971716de9bf00424459aeefb4570c6d0937de3ac2d8b79c10e", "output_hash": "267442708ea568b4621ccdb5534040409890a14406da46de69809157c57ef323"} | ||||
| 1511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a8e499395a40698a1629be7d", "attempt_id": "0d5ba2343854", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:26.902030Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7867, "cache_tensor_bytes": 70262784, "serialized_payload_bytes": 70278982, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1235.567417112179, "doc_prefill_ms": 326.5782499220222, "compress_ms": 893.09329201933, "serialize_ms": 15.598249970935285, "load_ms": 1.4579999260604382, "receiver_prefill_ms": 0.0, "query_prefill_ms": 62.94958293437958, "ttft_ms": 62.94958293437958, "decode_ms": 1051.006666966714}, "total_wall_ms": 1117.3708329442888, "ttft_ms": 62.94958293437958, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10602430464, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9493286128, "mlx_cache_bytes": 4246931093, "process_rss_bytes": 10602430464}, "peak_prefill_memory": 9963498176, "peak_decode_memory": 9493286128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f7c80939a7def740335f67b77dfc659f6cadeedbae050175ac35efd8f5839abe", "output_hash": "0ab8a5fe6a7a69cf6893f7b8f92a27212819c36b20b9f98a7f186db302f072f7"} | ||||
| 1512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "af1ae9ad56efcd28b3ef7279", "attempt_id": "d741948ed563", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:28.059609Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1906, "keep": 476, "window_tokens": 44, "compress_ms": 82.68166705965996}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7867, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563341, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1318.8362088985741, "doc_prefill_ms": 326.67783403303474, "compress_ms": 985.2308749686927, "serialize_ms": 6.629999959841371, "load_ms": 1.149957999587059, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.44270803872496, "ttft_ms": 37.44270803872496, "decode_ms": 1031.7876249318942}, "total_wall_ms": 2392.7517919801176, "ttft_ms": 37.44270803872496, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 87}, "provider_cached_usage": null, "process_memory": 10586603520, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4484022957, "process_rss_bytes": 10586603520}, "peak_prefill_memory": 9963498176, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'S': # Assuming 'returned' and 'region' are keys in the row\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "7cebd1fa364ea2b2b59495078f49952c743fe74c5b5aeba4650e1bb994c73802", "output_hash": "53cd5d1470b7a6932f843757137387beb751fe23e62b3f3e26d7f61b55f80507"} | ||||
| 1513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "c4505f1286349c6c7fc04c17", "attempt_id": "1a2c747f2116", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:30.512393Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 1988, "message_tokens": 1905, "message_utf8_bytes": 7842, "cache_tensor_bytes": null, "serialized_payload_bytes": 7842, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008083065040409565, "decode_payload_ms": 0.0, "receiver_prefill_ms": 693.4570419834927, "ttft_ms": 12.348709045909345, "decode_ms": 1274.510083021596}, "total_wall_ms": 1983.9990419568494, "ttft_ms": 12.348709045909345, "input_usage": {"receiver_prompt_tokens": 1988}, "output_usage": {"output_tokens": 106}, "provider_cached_usage": null, "process_memory": 10454499328, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9963973452, "mlx_cache_bytes": 800363716, "process_rss_bytes": 10454499328}, "peak_prefill_memory": null, "peak_decode_memory": 9963973452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Nord':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total *= 1.14975\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "output_hash": "ace1491f9fa8be7e9ac13f216483395250eb995088ae774eb34082474c37d8fd"} | ||||
| 1514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "58ba080c9626c9805d2b72d3", "attempt_id": "62acafe93247", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:34.458947Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 308, "message_tokens": 221, "message_utf8_bytes": 1060, "cache_tensor_bytes": null, "serialized_payload_bytes": 1060, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1925.3227500012144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 128.1443330226466, "ttft_ms": 11.915125069208443, "decode_ms": 995.3011670149863}, "total_wall_ms": 1136.4306659670547, "ttft_ms": 11.915125069208443, "input_usage": {"receiver_prompt_tokens": 308, "sender_input_tokens": 2021, "sender_output_tokens": 221, "sender_prefill_ms": 345.5526669276878, "sender_ttft_ms": 7.452624966390431, "sender_decode_ms": 1569.985708920285}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10454548480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9463435592, "mlx_cache_bytes": 1723254160, "process_rss_bytes": 10454548480}, "peak_prefill_memory": null, "peak_decode_memory": 9463435592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n valid_rows = [row for row in rows if row['region'] != 'Nord' and row['units'] >= 5]\n total_revenue = sum(row['price'] * row['units'] for row in valid_rows)\n total_revenue_with_tax = total_revenue * 1.14975\n return round(total_revenue_with_tax)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "680363e60983034621b8dff8c7d90f82d40ac5d27d0351ec8a25bc66fb3675cc", "output_hash": "5182b7250b80e18bc3e070eb7cf9eaa42d330afde5070be0bd6faa445363e989"} | ||||
| 1515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "eb8283d3a5235c243d3f9f09", "attempt_id": "8ada8e155197", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:39.634093Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 289, "message_tokens": 191, "message_utf8_bytes": 579, "cache_tensor_bytes": null, "serialized_payload_bytes": 579, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3999.2903750389814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.5501661002636, "ttft_ms": 12.070416938513517, "decode_ms": 11.644541984423995}, "total_wall_ms": 152.11754199117422, "ttft_ms": 12.070416938513517, "input_usage": {"receiver_prompt_tokens": 289, "sender_input_tokens": 2049, "sender_output_tokens": 512, "sender_prefill_ms": 344.64820905122906, "sender_ttft_ms": 7.880417047999799, "sender_decode_ms": 3644.3507499061525}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454548480, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9451671880, "mlx_cache_bytes": 2501035408, "process_rss_bytes": 10454548480}, "peak_prefill_memory": null, "peak_decode_memory": 9451671880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e679292f994f136a852e6a2ff554967c144a144cb42c868eeb8403f015e0b95d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "7331fbc7c695e8b78500f96b", "attempt_id": "62329ad0b1d7", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:40.188507Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 44, "message_tokens": 1944, "message_utf8_bytes": 7842, "cache_tensor_bytes": 71663616, "serialized_payload_bytes": 71679713, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 362.0967499446124, "doc_prefill_ms": 331.2956669833511, "compress_ms": 9.698875015601516, "serialize_ms": 16.776125063188374, "load_ms": 2.2099589696154, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.278249964118004, "ttft_ms": 49.278249964118004, "decode_ms": 3946.170083945617}, "total_wall_ms": 3999.726083013229, "ttft_ms": 49.278249964118004, "input_usage": {"receiver_prefix_tokens": 1944, "dense_cache_bytes": 55738368, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10598187008, "backend_memory": {"mlx_active_bytes": 9417378824, "mlx_peak_bytes": 9498070256, "mlx_cache_bytes": 4015310577, "process_rss_bytes": 10598187008}, "peak_prefill_memory": 9976359768, "peak_decode_memory": 9498070256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "holy_1) one more please_find_meorph igen) it, no more please find the rest 13 - 1, etagged products_coma_for_all, etwo, no fancy -eager, fast - 1, please feel free, no, no more data - 1 comune_1_com(instante_web, please) a.out, fast_food_1, fast_1_exactly -1, fast_1, no more_soderedata -com -150. the case, fast -(aria) for all the time that it, \"defiant_au_1, fast_1, no -1, let me, not_part of the following, the following_exactly, and, let it沸高, col ** (acy) 2 -1, except that -15, except, vau -1, no. staynerway_1, fast -1, 13) -1 (yet) -11, cased, please let it, except that iture, will be, except, fast -1, 1, 1, 1, 1, fast), except, 1, and_=15) \n\n(rows), please, 1[中文, fast_atem, unless more_1, 1)1, -u_1com -1, 1, fast -1, fast -1) \n\n## commo, 19001) 1, 1, 1, 1, fast", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "5df7cc204869dd815f6fb5e694f82b64b2a8f19dfcd4d6adf68580e2633afb11", "output_hash": "ec265f083f2eba4adec9e8e1c1932ca05617b645f88d222eedb757f75744c3a3"} | ||||
| 1517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a4651602d345043bf2a4c2fc", "attempt_id": "cb942cae2aa1", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:45.491055Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9331264520}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 44, "message_tokens": 1944, "message_utf8_bytes": 7842, "cache_tensor_bytes": 71663616, "serialized_payload_bytes": 71679814, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1262.1796670136973, "doc_prefill_ms": 335.4040839476511, "compress_ms": 909.8696670262143, "serialize_ms": 16.61154197063297, "load_ms": 1.675166073255241, "receiver_prefill_ms": 0.0, "query_prefill_ms": 63.78362502437085, "ttft_ms": 63.78362502437085, "decode_ms": 984.6700830385089}, "total_wall_ms": 1052.0990000804886, "ttft_ms": 63.78362502437085, "input_usage": {"receiver_prefix_tokens": 1944, "dense_cache_bytes": 55738368, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10605707264, "backend_memory": {"mlx_active_bytes": 9407941640, "mlx_peak_bytes": 9498004720, "mlx_cache_bytes": 4028745457, "process_rss_bytes": 10605707264}, "peak_prefill_memory": 9976359768, "peak_decode_memory": 9498004720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "485a20365b6a7e253b2818c7809e1ddd3988e8b9c87d37afca872c09385f69d7", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 1518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "a0c32505f5cb12765b703dde", "attempt_id": "d73f4a85c21d", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:46.583280Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1944, "keep": 486, "window_tokens": 44, "compress_ms": 82.5947499834001}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 44, "message_tokens": 1944, "message_utf8_bytes": 7842, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931982, "side_information_bytes": 16078, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1319.8348749428988, "doc_prefill_ms": 335.18395794089884, "compress_ms": 977.6532080722973, "serialize_ms": 6.689499947242439, "load_ms": 1.501666964031756, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.14045893866569, "ttft_ms": 37.14045893866569, "decode_ms": 905.1472920691594}, "total_wall_ms": 2267.641375074163, "ttft_ms": 37.14045893866569, "input_usage": {"receiver_prefix_tokens": 1944, "dense_cache_bytes": 55738368, "query_tokens": 44}, "output_usage": {"output_tokens": 77}, "provider_cached_usage": null, "process_memory": 10590044160, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379351792, "mlx_cache_bytes": 4296377401, "process_rss_bytes": 10590044160}, "peak_prefill_memory": 9976359768, "peak_decode_memory": 9379351792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Nord':\n continue\n if r['units'] < 10:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['price']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "d4ac4ba488187bec384b1b09142dc43c4b10f1aec3256edfe6cee34f80b4bc07", "output_hash": "cea351cc62449e386f8e3fd800b53817ca308cc8eec265a7d01d062ef0f00764"} | ||||
| 1519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "da4810ec8b51a898709599b2", "attempt_id": "83c38db56c6b", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:48.911456Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 1921, "message_tokens": 1838, "message_utf8_bytes": 7676, "cache_tensor_bytes": null, "serialized_payload_bytes": 7676, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008207978680729866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 659.0317080263048, "ttft_ms": 12.309042038396, "decode_ms": 1186.8845419958234}, "total_wall_ms": 1861.996166058816, "ttft_ms": 12.309042038396, "input_usage": {"receiver_prompt_tokens": 1921}, "output_usage": {"output_tokens": 99}, "provider_cached_usage": null, "process_memory": 10454876160, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9942198848, "mlx_cache_bytes": 691295160, "process_rss_bytes": 10454876160}, "peak_prefill_memory": null, "peak_decode_memory": 9942198848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est':\n continue\n if r['units'] < 4:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total * 1.05, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "output_hash": "9d82de630e35c6e1244506307c06bce4ad4fd206d7e49b737e99b623b8976185"} | ||||
| 1520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bf2e580bf88eb998aa4909d8", "attempt_id": "1ae72b7600b6", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:52.474672Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 271, "message_tokens": 184, "message_utf8_bytes": 870, "cache_tensor_bytes": null, "serialized_payload_bytes": 870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1662.8138329833746, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.55133293103427, "ttft_ms": 11.833791038952768, "decode_ms": 1105.294374981895}, "total_wall_ms": 1245.6046249717474, "ttft_ms": 11.833791038952768, "input_usage": {"receiver_prompt_tokens": 271, "sender_input_tokens": 1954, "sender_output_tokens": 184, "sender_prefill_ms": 338.65950000472367, "sender_ttft_ms": 7.3954579420387745, "sender_decode_ms": 1314.4469580147415}, "output_usage": {"output_tokens": 95}, "provider_cached_usage": null, "process_memory": 10454892544, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9441824936, "mlx_cache_bytes": 1652917232, "process_rss_bytes": 10454892544}, "peak_prefill_memory": null, "peak_decode_memory": 9441824936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total_revenue = 0\n for row in rows:\n if row['region'] != 'excluded_region' and row['units'] >= 4 and row['returned'] == 'N':\n total_revenue += (row['unit_price'] * (1 - row['discount_pct'] / 100)) * (1 + 0.05) * row['units']\n return total_revenue", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "591f20585686e57c8acf845bd27983be32a801c0bea2bd3d4559fcf3aca370c3", "output_hash": "a3274f502156ab384d3eadbf4405a54bcc45149866f69fa1fc425896ef26a1ba"} | ||||
| 1521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "08d383e7641ff4f95aa7e332", "attempt_id": "1954e9c55510", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:57.728014Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 445, "message_tokens": 347, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3969.5712499087676, "decode_payload_ms": 0.0, "receiver_prefill_ms": 171.42187501303852, "ttft_ms": 11.972917011007667, "decode_ms": 11.781959095969796}, "total_wall_ms": 196.20129198301584, "ttft_ms": 11.972917011007667, "input_usage": {"receiver_prompt_tokens": 445, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 339.00658308994025, "sender_ttft_ms": 7.4581250082701445, "sender_decode_ms": 3620.7289160229266}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454925312, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9547700348, "mlx_cache_bytes": 2694792176, "process_rss_bytes": 10454925312}, "peak_prefill_memory": null, "peak_decode_memory": 9547700348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "8c23dbed175e20b7989b356b765e83e22cd2cb6e2db63a6f3965b5596078bb25", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "45ee8cec908da41a9c37bd44", "attempt_id": "c8d638ef78c3", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:53:58.313735Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9329101832}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7676, "cache_tensor_bytes": 69193728, "serialized_payload_bytes": 69209825, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.1405000463128, "doc_prefill_ms": 321.68270798865706, "compress_ms": 9.036290924996138, "serialize_ms": 16.50941593106836, "load_ms": 1.9941249629482627, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.44104202836752, "ttft_ms": 47.44104202836752, "decode_ms": 3922.3930839216337}, "total_wall_ms": 3973.738000029698, "ttft_ms": 47.44104202836752, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593730560, "backend_memory": {"mlx_active_bytes": 9411677192, "mlx_peak_bytes": 9492368624, "mlx_cache_bytes": 4064675153, "process_rss_bytes": 10593730560}, "peak_prefill_memory": 9953372748, "peak_decode_memory": 9492368624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "has \"but not all the word) 【10【白皮带给系数为 globals最让人笑 clapw.S=1, pto手动马其它白的nbyby2019【必上,cpi=自动装机,ify=exotic data mo:n0201用的s5=1=1不后悔,f1=1【例1】(1, no. phtt01【红hlm吧【例1】=1,fa【特价品专供者, no.1【201【201,mn(Nospecial=[10010k.s=【全年1,必有同学,深海无地111,用了一年,我能想到【优惠货为:=1,fa=10【2019/r值拉火方无 Talladria=【例1】=1,fa=1,fa=【2017-1, no.2018,用它笑海纳1的,fa=ch1,用不疑yanmx=pr1001k强],[1,fa=1,fa=1,用到了,都对它笑白之鉴1,fa1【kakobe=mcn【1】,分层面上加1,用up主1,fauxmat=fa=1,用1,fa=1,fa=fa=fa=fa=fa=fa=fa=fa1,用它", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "559f8bcaf20dce4af3cf272b83d440e2d890773019b83b4b1c136687067f1be8", "output_hash": "8dd701e963184714ca5c6c208bdd15808b3695c580191513b93dc8c4bbacde45"} | ||||
| 1523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "959a1b0c1b1456f2168f6b83", "attempt_id": "33f0a235b4ea", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:03.539653Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7676, "cache_tensor_bytes": 69193728, "serialized_payload_bytes": 69209926, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1210.9536250354722, "doc_prefill_ms": 324.12341597955674, "compress_ms": 870.6170000368729, "serialize_ms": 15.916707925498486, "load_ms": 0.9143330389633775, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.13666700385511, "ttft_ms": 53.13666700385511, "decode_ms": 1042.7860419731587}, "total_wall_ms": 1098.7745829625055, "ttft_ms": 53.13666700385511, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10599448576, "backend_memory": {"mlx_active_bytes": 9404107784, "mlx_peak_bytes": 9491877104, "mlx_cache_bytes": 4076111185, "process_rss_bytes": 10599448576}, "peak_prefill_memory": 9953225292, "peak_decode_memory": 9491877104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c640528ca2aab4043086d804a2b06436487d4f573e4d8f7ed25ab34b92a4d0c", "output_hash": "4584dd5e32c66d03ed4d99346093e0fc113857c44208d8210acccceafe34fd94"} | ||||
| 1524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "078f3cc48224dcebdf4dcd30", "attempt_id": "4f1cf7e519b5", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:04.680060Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1877, "keep": 469, "window_tokens": 44, "compress_ms": 91.68029099237174}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7676, "cache_tensor_bytes": 17289216, "serialized_payload_bytes": 17305293, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1301.2987499823794, "doc_prefill_ms": 324.4403329445049, "compress_ms": 969.6332500316203, "serialize_ms": 6.920416024513543, "load_ms": 0.5590840009972453, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.24704100750387, "ttft_ms": 37.24704100750387, "decode_ms": 837.7563329413533}, "total_wall_ms": 2180.4540420416743, "ttft_ms": 37.24704100750387, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 71}, "provider_cached_usage": null, "process_memory": 10584506368, "backend_memory": {"mlx_active_bytes": 9300593672, "mlx_peak_bytes": 9379089648, "mlx_cache_bytes": 4317347969, "process_rss_bytes": 10584506368}, "peak_prefill_memory": 9953225292, "peak_decode_memory": 9379089648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Est' and r['product'] == 'Widget' and r['quantity'] > 100:\n total += r['unit_price'] * r['quantity']\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "ca99234284b63c4c7be7ca7860540c254e63cf85f7b24ce6b1cca7dad6897bd7", "output_hash": "bb3bf661f3e9ea2eada60ee92769272ee96a83ed947a541a450a5f26c115a82f"} | ||||
| 1525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "24471faf253eeda3790f046e", "attempt_id": "30dba2d4daea", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:06.920671Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 1930, "message_tokens": 1847, "message_utf8_bytes": 7723, "cache_tensor_bytes": null, "serialized_payload_bytes": 7723, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0076659489423036575, "decode_payload_ms": 0.0, "receiver_prefill_ms": 679.632458020933, "ttft_ms": 12.35037506558001, "decode_ms": 1448.9390419330448}, "total_wall_ms": 2144.585666945204, "ttft_ms": 12.35037506558001, "input_usage": {"receiver_prompt_tokens": 1930}, "output_usage": {"output_tokens": 121}, "provider_cached_usage": null, "process_memory": 10454253568, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9945786980, "mlx_cache_bytes": 782177244, "process_rss_bytes": 10454253568}, "peak_prefill_memory": null, "peak_decode_memory": 9945786980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Sud':\n continue\n if r['units'] < 5:\n continue\n if r['returned']:\n continue\n line_revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += line_revenue * (1 + 14.975 / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "output_hash": "c57bcbec0b08642a4ec15f968aea84dbffa8331936a3beedbb229a25d0e7c350"} | ||||
| 1526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "5041456930386dc3c1189dd2", "attempt_id": "c8b3ec665ca9", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:10.879459Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 289, "message_tokens": 202, "message_utf8_bytes": 969, "cache_tensor_bytes": null, "serialized_payload_bytes": 969, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1777.2675830638036, "decode_payload_ms": 0.0, "receiver_prefill_ms": 127.67779105342925, "ttft_ms": 11.799125000834465, "decode_ms": 11.710833059623837}, "total_wall_ms": 152.151457965374, "ttft_ms": 11.799125000834465, "input_usage": {"receiver_prompt_tokens": 289, "sender_input_tokens": 1963, "sender_output_tokens": 202, "sender_prefill_ms": 339.3697499996051, "sender_ttft_ms": 7.29041697923094, "sender_decode_ms": 1428.368499968201}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454286336, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9451278588, "mlx_cache_bytes": 1622279260, "process_rss_bytes": 10454286336}, "peak_prefill_memory": null, "peak_decode_memory": 9451278588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "cf4be8f57d1080dfeb30b3a537997d1526b063d56e3733e3843b0b88fda8008e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "feadf35b99bd9a042b2a6f49", "attempt_id": "e933427babfc", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:15.037330Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 474, "message_tokens": 375, "message_utf8_bytes": 952, "cache_tensor_bytes": null, "serialized_payload_bytes": 952, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3968.0127499159425, "decode_payload_ms": 0.0, "receiver_prefill_ms": 192.06733291503042, "ttft_ms": 12.080542044714093, "decode_ms": 11.961791082285345}, "total_wall_ms": 217.24491694476455, "ttft_ms": 12.080542044714093, "input_usage": {"receiver_prompt_tokens": 474, "sender_input_tokens": 1991, "sender_output_tokens": 512, "sender_prefill_ms": 340.28575010597706, "sender_ttft_ms": 7.245625020004809, "sender_decode_ms": 3617.981416056864}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454335488, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9566623868, "mlx_cache_bytes": 2677146716, "process_rss_bytes": 10454335488}, "peak_prefill_memory": null, "peak_decode_memory": 9566623868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "f350257fa2519e39e3f7bd632a9de33636fd1294841101e043e43bb4ab4d7407", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "2f08688dd75543c6dd493d84", "attempt_id": "0691eeea9d84", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:15.646856Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328970760}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 44, "message_tokens": 1886, "message_utf8_bytes": 7723, "cache_tensor_bytes": 69525504, "serialized_payload_bytes": 69541601, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 352.2747909883037, "doc_prefill_ms": 321.3021249976009, "compress_ms": 9.729707962833345, "serialize_ms": 17.04991701990366, "load_ms": 2.1781669929623604, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.05533290002495, "ttft_ms": 49.05533290002495, "decode_ms": 3913.856083061546}, "total_wall_ms": 3967.2393338987604, "ttft_ms": 49.05533290002495, "input_usage": {"receiver_prefix_tokens": 1886, "dense_cache_bytes": 54075392, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10593468416, "backend_memory": {"mlx_active_bytes": 9413610504, "mlx_peak_bytes": 9492237552, "mlx_cache_bytes": 4184884669, "process_rss_bytes": 10593468416}, "peak_prefill_memory": 9956502128, "peak_decode_memory": 9492237552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "\\\n...\n\n\ncadenzao-1, leisteinecosa:1 lines and 3dualwin+2, pleaserietobedometeefilounge: iterm only:1, only this isthat steht the commotion for zucker:upb&iheart for chokers:1. it: 1c: please clickpositional_1, the actual numexhaustercasepositional_variable_1, only please find it, please make it the case, it would have been the answer: \"and Cocalcomple.\n\nI.etoscarloboie:1, and, please, please make it go: itc:1:1nprpof the, please, only if-1emow:it goes:itow_1, if the case: italgebraisch, if present:1, with, with, with, seebalkline to help function, stay, may be: ital, may be a, right, ital, itgovern anxiety:1, fequater1:1, and 1, and it did you aremacau/derpaulpaulpauli:1, with aion, and it may be it's only, please gothecode that is, thank you have a few more information about me: \"it will not: only:1, \"poa to remember that it contained: \"and rite:it, and in iterniemay, new:1, that it is not the only", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "0d47763f42a3b7f4266367682f181aac34319171ac0595ad8192e0580928ab2c", "output_hash": "d1d33657ddbf08e33e5df455a48ba00cbc023a4b82788964f82140d29d5956d3"} | ||||
| 1529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bd24908f5becd7e5c3b09eb4", "attempt_id": "573c464a84ef", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:20.895768Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9328905224}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 44, "message_tokens": 1886, "message_utf8_bytes": 7723, "cache_tensor_bytes": 69525504, "serialized_payload_bytes": 69541702, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1239.9957500165328, "doc_prefill_ms": 324.3795420276001, "compress_ms": 899.5738339144737, "serialize_ms": 15.753292012959719, "load_ms": 1.4415000332519412, "receiver_prefill_ms": 0.0, "query_prefill_ms": 55.449957959353924, "ttft_ms": 55.449957959353924, "decode_ms": 1044.4362080888823}, "total_wall_ms": 1103.228333988227, "ttft_ms": 55.449957959353924, "input_usage": {"receiver_prefix_tokens": 1886, "dense_cache_bytes": 54075392, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10704207872, "backend_memory": {"mlx_active_bytes": 9404156936, "mlx_peak_bytes": 9491877104, "mlx_cache_bytes": 4194338237, "process_rss_bytes": 10704207872}, "peak_prefill_memory": 9956436592, "peak_decode_memory": 9491877104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "e818617bd4030c6b04afdb5e77faf204baa235375b516c1ebf749b653337b05f", "output_hash": "e69210f685d2164cd1b27314d1f8bdd1aee089c8f65662ed660e25b428382064"} | ||||
| 1530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "6ab929559925329fd9d050d5", "attempt_id": "bc63bf893520", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:22.040705Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1886, "keep": 472, "window_tokens": 44, "compress_ms": 92.34237496275455}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 44, "message_tokens": 1886, "message_utf8_bytes": 7723, "cache_tensor_bytes": 17399808, "serialized_payload_bytes": 17415885, "side_information_bytes": 16077, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1311.646791989915, "doc_prefill_ms": 323.63362493924797, "compress_ms": 980.8646249584854, "serialize_ms": 6.844167015515268, "load_ms": 1.2455409159883857, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.36066597048193, "ttft_ms": 37.36066597048193, "decode_ms": 896.2907909881324}, "total_wall_ms": 2250.1448749098927, "ttft_ms": 37.36066597048193, "input_usage": {"receiver_prefix_tokens": 1886, "dense_cache_bytes": 54075392, "query_tokens": 44}, "output_usage": {"output_tokens": 76}, "provider_cached_usage": null, "process_memory": 10688937984, "backend_memory": {"mlx_active_bytes": 9300397064, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4429955381, "process_rss_bytes": 10688937984}, "peak_prefill_memory": 9956436592, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Sud':\n continue\n if r['units_sold'] < 10:\n continue\n total += r['unit_price'] * r['units_sold']\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "fa19c65fe37b757fc331c4e1fe76dddb2bff16c2d338441ce8241be071c57ecd", "output_hash": "37e9fba2d7ec3ff99709683633610263b43987e70ad9a2141e234c4dada1ba71"} | ||||
| 1531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "4c01a1bcb64b98e1443eb5fa", "attempt_id": "c6ee730dbcc5", "run_group_id": "E3_core:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:24.355197Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 1954, "message_tokens": 1871, "message_utf8_bytes": 7797, "cache_tensor_bytes": null, "serialized_payload_bytes": 7797, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0069160014390945435, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.9355840040371, "ttft_ms": 12.401833082549274, "decode_ms": 1129.4979579979554}, "total_wall_ms": 1821.4852079981938, "ttft_ms": 12.401833082549274, "input_usage": {"receiver_prompt_tokens": 1954}, "output_usage": {"output_tokens": 94}, "provider_cached_usage": null, "process_memory": 10454351872, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9953422020, "mlx_cache_bytes": 702518332, "process_rss_bytes": 10454351872}, "peak_prefill_memory": null, "peak_decode_memory": 9953422020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['region'] == 'Nord':\n continue\n if r['units'] < 3:\n continue\n if r['returned']:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 1.0, "pass_rate": 1.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "output_hash": "2c6b0f3f392f5b5fd0b3ff99725538716dab3250ed21615dfcfe34d4bd760871"} | ||||
| 1532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "3ccfd915d9f3feeaa4201ee7", "attempt_id": "5493582eab29", "run_group_id": "E3_core:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:28.275577Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 328, "message_tokens": 241, "message_utf8_bytes": 1137, "cache_tensor_bytes": null, "serialized_payload_bytes": 1137, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2061.815834022127, "decode_payload_ms": 0.0, "receiver_prefill_ms": 145.90862498153, "ttft_ms": 11.857875040732324, "decode_ms": 939.55220899079}, "total_wall_ms": 1098.3752920292318, "ttft_ms": 11.857875040732324, "input_usage": {"receiver_prompt_tokens": 328, "sender_input_tokens": 1987, "sender_output_tokens": 241, "sender_prefill_ms": 342.85883291158825, "sender_ttft_ms": 7.493500015698373, "sender_decode_ms": 1709.158833953552}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 10454368256, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9476919704, "mlx_cache_bytes": 1696236888, "process_rss_bytes": 10454368256}, "peak_prefill_memory": null, "peak_decode_memory": 9476919704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n rows = [row for row in rows if row['region'] != 'Nord' and row['returned'] == False and row['units'] >= 3]\n total_revenue = sum(row['price'] * row['units'] * (1 - 0.0) for row in rows)\n return round(total_revenue, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "6c18432999230548e3992e0e88ee608ca616bbc2538c272da2ff05a31225d1f7", "output_hash": "6a57c454ef1f7d940a48a46083b63b821b28efb1b5ad203d794722c39217bf8f"} | ||||
| 1533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "b05f893de005c19c70e7e91d", "attempt_id": "46f918f02c90", "run_group_id": "E3_core:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:33.401912Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 466, "message_tokens": 367, "message_utf8_bytes": 932, "cache_tensor_bytes": null, "serialized_payload_bytes": 932, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3990.4796249466017, "decode_payload_ms": 0.0, "receiver_prefill_ms": 191.73650001175702, "ttft_ms": 12.038292014040053, "decode_ms": 11.929583037272096}, "total_wall_ms": 216.7250830680132, "ttft_ms": 12.038292014040053, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 2015, "sender_output_tokens": 512, "sender_prefill_ms": 343.8874160638079, "sender_ttft_ms": 7.468166062608361, "sender_decode_ms": 3636.7016250733286}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 10454417408, "backend_memory": {"mlx_active_bytes": 9259305992, "mlx_peak_bytes": 9561593980, "mlx_cache_bytes": 2763736408, "process_rss_bytes": 10454417408}, "peak_prefill_memory": null, "peak_decode_memory": 9561593980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 4, "parse_ok": true}, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:NameError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "b0fc6b3c813f8bee5e34989ed061f4cefd302aefccae5c371f6108c70d08b4a5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "bdeadc345c0df01180fb8f0f", "attempt_id": "afeeeec0d63f", "run_group_id": "E3_core:C0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:34.010514Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C0", "implementation_fidelity": "n/a", "compression_config": {"realized": {"negative_control": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 44, "message_tokens": 1910, "message_utf8_bytes": 7797, "cache_tensor_bytes": 70410240, "serialized_payload_bytes": 70426337, "side_information_bytes": 16097, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.95795793738216, "doc_prefill_ms": 323.7803749507293, "compress_ms": 9.708208031952381, "serialize_ms": 16.452415962703526, "load_ms": 2.1548339864239097, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.04449998866767, "ttft_ms": 49.04449998866767, "decode_ms": 3940.7550001051277}, "total_wall_ms": 3993.950084084645, "ttft_ms": 49.04449998866767, "input_usage": {"receiver_prefix_tokens": 1910, "dense_cache_bytes": 54763520, "query_tokens": 44}, "output_usage": {"output_tokens": 320}, "provider_cached_usage": null, "process_memory": 10595631104, "backend_memory": {"mlx_active_bytes": 9415019528, "mlx_peak_bytes": 9494482160, "mlx_cache_bytes": 4278961849, "process_rss_bytes": 10595631104}, "peak_prefill_memory": 9965103824, "peak_decode_memory": 9494482160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "[mark downes.cookieservice_？ 3\n#guy\n1. ita\n1, nohidden_mark\nloopyway\nit's service\n1, with\n15 and now: hows\n1\n15\n15\n办\n, numservice\nn, thank you too, please\n2, no\n-1, no\n1, fau_its\n1, with and composure\n1, thank you\nit, please let it continue what it's not to\n1, papterauftrag_ex, please take itifer, faul, no. per seps\nwhat it stands, please\n-1, with it, please have iwr=1, with it did not yet, with it\n2014 has it is the case, will be, with it's the\n1, and, faaservice is the case of\n- -1, with it,\n- -born i.a,\n- 1, with it can still, fa, fast loading it\n- -1, thank\n- -1, with, and only once, and where\n-1, please\n-1, like it's in 2014-above\n-1, thank you\n- -1, with, thank\n- - -1, with it\n1, thank you too\n- -u, with, with it always?\n\nSo, please find it's not only in, with and how\n- -1, but not in 1, here_just", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "exec:SyntaxError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "174b7e425a248960d2a9ff0a88d049205f74f2dcc035724d1c921cdb9fd738b4", "output_hash": "cc9caf1f52cfd0b4eeebd7d3b2c762e6411632f81e36f0c898261073f339e46d"} | ||||
| 1535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "e94546d7c5d1227cc7a7abe1", "attempt_id": "2c69f85997d6", "run_group_id": "E3_core:C2|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:39.281799Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9330084872}, "weight_precision": "bf16", "method_id": "C2", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz"}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 44, "message_tokens": 1910, "message_utf8_bytes": 7797, "cache_tensor_bytes": 70410240, "serialized_payload_bytes": 70426438, "side_information_bytes": 16198, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1237.6201660372317, "doc_prefill_ms": 326.52079104445875, "compress_ms": 894.5907079614699, "serialize_ms": 16.224500024691224, "load_ms": 1.5053749084472656, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.268958047032356, "ttft_ms": 54.268958047032356, "decode_ms": 1047.1967910416424}, "total_wall_ms": 1104.9259999999776, "ttft_ms": 54.268958047032356, "input_usage": {"receiver_prefix_tokens": 1910, "dense_cache_bytes": 54763520, "query_tokens": 44}, "output_usage": {"output_tokens": 85}, "provider_cached_usage": null, "process_memory": 10598662144, "backend_memory": {"mlx_active_bytes": 9405582344, "mlx_peak_bytes": 9494465776, "mlx_cache_bytes": 4292331193, "process_rss_bytes": 10598662144}, "peak_prefill_memory": 9965103824, "peak_decode_memory": 9494465776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n revenue = r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n total += revenue\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "64b75254d83532aead13e587180c76ce7d8cd110e0ef006fc6d3fcd134d37224", "output_hash": "47a1f91655ee5e79f80f2b6ca7c42c61c53d46a25f634a0b9064a79e72f105b4"} | ||||
| 1536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core", "trial_id": "fda357ca5fc74978122ccd91", "attempt_id": "1c3cbba58e9b", "run_group_id": "E3_core:C3|keep_frac=0.25|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "64386b70d05c624f31c00c3a4f76b5c5384fea15c30b4bf165e36cfdcd5f57da", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:40.428191Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 9259305992}, "weight_precision": "bf16", "method_id": "C3", "implementation_fidelity": "custom", "compression_config": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "keep_frac": 0.25, "access": "aware", "realized": {"mapper": "runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "policy": "attention", "keep_frac": 0.25, "T": 1910, "keep": 478, "window_tokens": 44, "compress_ms": 83.88916694093496}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 44, "message_tokens": 1910, "message_utf8_bytes": 7797, "cache_tensor_bytes": 17620992, "serialized_payload_bytes": 17637071, "side_information_bytes": 16079, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1303.9409579942003, "doc_prefill_ms": 326.62270800210536, "compress_ms": 970.2553329989314, "serialize_ms": 6.75974995829165, "load_ms": 1.1682080803439021, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.39933401811868, "ttft_ms": 37.39933401811868, "decode_ms": 1192.1622920781374}, "total_wall_ms": 2538.231583079323, "ttft_ms": 37.39933401811868, "input_usage": {"receiver_prefix_tokens": 1910, "dense_cache_bytes": 54763520, "query_tokens": 44}, "output_usage": {"output_tokens": 101}, "provider_cached_usage": null, "process_memory": 10582786048, "backend_memory": {"mlx_active_bytes": 9301576712, "mlx_peak_bytes": 9378893040, "mlx_cache_bytes": 4557751025, "process_rss_bytes": 10582786048}, "peak_prefill_memory": 9965103824, "peak_decode_memory": 9378893040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned'] or r['region'] == 'Nordic': # Assuming 'returned' and 'region' are keys\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['price'] * (1 + r['tax_rate'] / 100)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": "KeyError"}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core.log", "payload_hash": "034bd53aaa42eb7b59c17d48ff347d98dc4d890d480c39150c304d03fb456837", "output_hash": "bcc08413b9d5f4d38d9cdd3364383faad9a3e581bf59117f928ed7cf989b2326"} | ||||
added
runs/raw/E3_core_sender.jsonl
+512 −0
@@ -0,0 +1,512 @@ | |||||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b72f25607e10ea100c4f6cf9", "attempt_id": "d4bdc7a3897a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:45.694342Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 348.9938339916989, "ttft_ms": 7.837000070139766, "decode_ms": 78.27533304225653}, "total_wall_ms": 443.3550420217216, "ttft_ms": 7.837000070139766, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3348283392, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3815541552, "mlx_cache_bytes": 771173840, "process_rss_bytes": 3348283392}, "peak_prefill_memory": null, "peak_decode_memory": 3815541552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZL-78K-5065", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "2a568d613468fe9e25fd3ab03aa2744ae45702a47a3665ea5aa63251d8bc749c"} | ||||
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4bcc923f0d5c42a242dac23a", "attempt_id": "3cd508c02853", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:46.156995Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1983, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 336.05466701555997, "ttft_ms": 7.309542037546635, "decode_ms": 64.63687494397163}, "total_wall_ms": 411.55283304397017, "ttft_ms": 7.309542037546635, "input_usage": {"receiver_prompt_tokens": 1983}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3348430848, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3817147204, "mlx_cache_bytes": 1459506376, "process_rss_bytes": 3348430848}, "peak_prefill_memory": null, "peak_decode_memory": 3817147204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 19-N, Gaspé", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "2e8cf782bd118a1c6d4e23417785d72fb92e930806b5752cd1ec405a0c9b95e5"} | ||||
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "54ed33d8abf769cdb3460fcd", "attempt_id": "224d92a84bfc", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:46.586466Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1982, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 334.85583402216434, "ttft_ms": 7.4241249822080135, "decode_ms": 50.39995803963393}, "total_wall_ms": 396.27187501173466, "ttft_ms": 7.4241249822080135, "input_usage": {"receiver_prompt_tokens": 1982}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3348447232, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3817147204, "mlx_cache_bytes": 1459506376, "process_rss_bytes": 3348447232}, "peak_prefill_memory": null, "peak_decode_memory": 3817147204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53.8485", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "d15ea89fae075fc945690894326d24c71a513cda40b6ede7884196520a0b2ad2"} | ||||
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d5d5759b56fc7daa2a37298a", "attempt_id": "e602da29191d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:46.999428Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1981, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.42012504767627, "ttft_ms": 7.395584019832313, "decode_ms": 49.59454096388072}, "total_wall_ms": 396.0586660541594, "ttft_ms": 7.395584019832313, "input_usage": {"receiver_prompt_tokens": 1981}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3348447232, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3816753988, "mlx_cache_bytes": 1885359304, "process_rss_bytes": 3348447232}, "peak_prefill_memory": null, "peak_decode_memory": 3816753988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Okonkwo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "0899b5427048f8ade3a2c73afe103e6432ff382fe37cae3efa13bf39f3ca8326"} | ||||
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5d9198a420feff6409acd332", "attempt_id": "76c4c3ab2f25", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:47.412858Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1987, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.3022499512881, "ttft_ms": 7.285416009835899, "decode_ms": 63.41570895165205}, "total_wall_ms": 413.6001250008121, "ttft_ms": 7.285416009835899, "input_usage": {"receiver_prompt_tokens": 1987}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3348529152, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3819129684, "mlx_cache_bytes": 2594106320, "process_rss_bytes": 3348529152}, "peak_prefill_memory": null, "peak_decode_memory": 3819129684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "ae55ba88b2cb1b0f1a4e0960ae312e0a1c177c79a6d14b67bff1677cec19b649"} | ||||
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7be6475340a7fbe81d289cd4", "attempt_id": "2ab51101ef68", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:47.843785Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1989, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.01125006377697, "ttft_ms": 7.405707961879671, "decode_ms": 72.00100005138665}, "total_wall_ms": 421.9290829496458, "ttft_ms": 7.405707961879671, "input_usage": {"receiver_prompt_tokens": 1989}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3348545536, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3819490140, "mlx_cache_bytes": 3021736672, "process_rss_bytes": 3348545536}, "peak_prefill_memory": null, "peak_decode_memory": 3819490140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fbc16d699933d25e76988f84", "attempt_id": "427459cbb55b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:48.282462Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.0387499667704, "ttft_ms": 7.2865840047597885, "decode_ms": 7.1919159963727}, "total_wall_ms": 352.83191700000316, "ttft_ms": 7.2865840047597885, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3348545536, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3815541552, "mlx_cache_bytes": 3021736672, "process_rss_bytes": 3348545536}, "peak_prefill_memory": null, "peak_decode_memory": 3815541552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "04cbe4fff58e694d82b78dcc", "attempt_id": "e3e6d4e0ffb8", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:48.652116Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015374971553683281, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.3576249210164, "ttft_ms": 7.302333018742502, "decode_ms": 7.270833011716604}, "total_wall_ms": 353.1020419904962, "ttft_ms": 7.302333018742502, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3348545536, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3815541552, "mlx_cache_bytes": 3021736672, "process_rss_bytes": 3348545536}, "peak_prefill_memory": null, "peak_decode_memory": 3815541552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cb62901f680f68e007060c05", "attempt_id": "5ccf1852405a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:49.373493Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.7043330008164048, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.394500026479363, "ttft_ms": 28.394500026479363, "decode_ms": 81.79891703184694}, "total_wall_ms": 113.66991605609655, "ttft_ms": 28.394500026479363, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3461201920, "backend_memory": {"mlx_active_bytes": 3260296200, "mlx_peak_bytes": 3361991924, "mlx_cache_bytes": 3846099138, "process_rss_bytes": 3461201920}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3361991924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZL-78K-5065", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "2a568d613468fe9e25fd3ab03aa2744ae45702a47a3665ea5aa63251d8bc749c"} | ||||
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5d298aae36a6d4d58c016263", "attempt_id": "c4482806dd71", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:49.504453Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 40, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.36058300267905, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.159416979178786, "ttft_ms": 28.159416979178786, "decode_ms": 66.52762496378273}, "total_wall_ms": 97.78983297292143, "ttft_ms": 28.159416979178786, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 40}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3461365760, "backend_memory": {"mlx_active_bytes": 3260296200, "mlx_peak_bytes": 3372068104, "mlx_cache_bytes": 3940995586, "process_rss_bytes": 3461365760}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3372068104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 19-N, Gaspé", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "2e8cf782bd118a1c6d4e23417785d72fb92e930806b5752cd1ec405a0c9b95e5"} | ||||
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5b3e93ef56a190af093513b5", "attempt_id": "1c00eac46328", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:49.619286Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 39, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.3322499580681324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.749834000132978, "ttft_ms": 27.749834000132978, "decode_ms": 52.268375060521066}, "total_wall_ms": 83.16354197449982, "ttft_ms": 27.749834000132978, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 39}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3461431296, "backend_memory": {"mlx_active_bytes": 3260312584, "mlx_peak_bytes": 3371134216, "mlx_cache_bytes": 3979679731, "process_rss_bytes": 3461431296}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3371134216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "53.8485", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "d15ea89fae075fc945690894326d24c71a513cda40b6ede7884196520a0b2ad2"} | ||||
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e95664150da1d43afe1d3a3d", "attempt_id": "e7a925363beb", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:49.719096Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 38, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.332291983999312, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.12266699038446, "ttft_ms": 28.12266699038446, "decode_ms": 51.99429206550121}, "total_wall_ms": 83.17233296111226, "ttft_ms": 28.12266699038446, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 38}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3461447680, "backend_memory": {"mlx_active_bytes": 3260279816, "mlx_peak_bytes": 3369299208, "mlx_cache_bytes": 4036679667, "process_rss_bytes": 3461447680}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3369299208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Okonkwo", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "0899b5427048f8ade3a2c73afe103e6432ff382fe37cae3efa13bf39f3ca8326"} | ||||
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "57eb6ee7e891bbd231b652cd", "attempt_id": "b6135e642a56", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:49.818917Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 44, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.3350419467315078, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.62599997408688, "ttft_ms": 29.62599997408688, "decode_ms": 66.85833400115371}, "total_wall_ms": 99.58620800171047, "ttft_ms": 29.62599997408688, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3461578752, "backend_memory": {"mlx_active_bytes": 3260296200, "mlx_peak_bytes": 3382324504, "mlx_cache_bytes": 4141652307, "process_rss_bytes": 3461578752}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3382324504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "ae55ba88b2cb1b0f1a4e0960ae312e0a1c177c79a6d14b67bff1677cec19b649"} | ||||
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c580253d26b1dd8d9be5992b", "attempt_id": "f6e317ed3707", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:49.935270Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.2980829924345016, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.106040998362005, "ttft_ms": 30.106040998362005, "decode_ms": 74.17633302975446}, "total_wall_ms": 107.45800007134676, "ttft_ms": 30.106040998362005, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3461660672, "backend_memory": {"mlx_active_bytes": 3260296200, "mlx_peak_bytes": 3378457880, "mlx_cache_bytes": 4227029699, "process_rss_bytes": 3461660672}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3378457880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4e65ecce656cebe5862590a2", "attempt_id": "51531d391b21", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:50.059646Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.3996249763295054, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.65179192647338, "ttft_ms": 27.65179192647338, "decode_ms": 7.407417055219412}, "total_wall_ms": 38.16358302719891, "ttft_ms": 27.65179192647338, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3461677056, "backend_memory": {"mlx_active_bytes": 3259444232, "mlx_peak_bytes": 3361844468, "mlx_cache_bytes": 4227881667, "process_rss_bytes": 3461677056}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3361844468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1460e9b4568e2d8c203b5797", "attempt_id": "7176198418c5", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:50.114058Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 55709696, "serialized_payload_bytes": 55722377, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.6046250006184, "doc_prefill_ms": 332.52204104792327, "compress_ms": 1.6582499956712127, "serialize_ms": 13.93658306915313, "load_ms": 1.2569999089464545, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.269250014796853, "ttft_ms": 27.269250014796853, "decode_ms": 7.4012079276144505}, "total_wall_ms": 37.69166592974216, "ttft_ms": 27.269250014796853, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 55709696, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 3461693440, "backend_memory": {"mlx_active_bytes": 3259444232, "mlx_peak_bytes": 3361844468, "mlx_cache_bytes": 4227881667, "process_rss_bytes": 3461693440}, "peak_prefill_memory": 3804531504, "peak_decode_memory": 3361844468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "26d0d10b3ecb50ab580e48058bffd80c44d0fe6f20cda7eeaae419acebd7739e", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b84b92f6c57bacdcfbfc8fcd", "attempt_id": "8322b8028288", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:50.183593Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5863, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1105.7992089772597, "ttft_ms": 7.589541957713664, "decode_ms": 72.99675000831485}, "total_wall_ms": 1197.813207982108, "ttft_ms": 7.589541957713664, "input_usage": {"receiver_prompt_tokens": 5863}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3445555200, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889228888, "mlx_cache_bytes": 1669706072, "process_rss_bytes": 3445555200}, "peak_prefill_memory": null, "peak_decode_memory": 3889228888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "FN-61P-4981", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "13e8328779a360703521a138305d0c3e1a42a5adbece3e3c52042c4a3ea91de2"} | ||||
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d2ebb46fa50852dbcd859200", "attempt_id": "a2c98e19d203", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:51.407614Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5869, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.669749991037, "ttft_ms": 7.446667063049972, "decode_ms": 81.01291698403656}, "total_wall_ms": 1202.5280420202762, "ttft_ms": 7.446667063049972, "input_usage": {"receiver_prompt_tokens": 5869}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3445587968, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891194968, "mlx_cache_bytes": 2285531480, "process_rss_bytes": 3445587968}, "peak_prefill_memory": null, "peak_decode_memory": 3891194968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 136-T, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "e35a975a2f9227792c5b4b03c710df10ddde842e28c40fbba4aaf1daeafead1d"} | ||||
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cc7fd51e9459a9a320468773", "attempt_id": "5f7fb713152e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:52.634747Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5869, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.0270000444725, "ttft_ms": 7.49754102434963, "decode_ms": 51.29816604312509}, "total_wall_ms": 1171.9459170708433, "ttft_ms": 7.49754102434963, "input_usage": {"receiver_prompt_tokens": 5869}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3445620736, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891194968, "mlx_cache_bytes": 2285531480, "process_rss_bytes": 3445620736}, "peak_prefill_memory": null, "peak_decode_memory": 3891194968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.7226", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "8d14a8e8f86bb852bed3f5945e7857bcf38c21afb7c3bf66bf6b66c02d4929ea"} | ||||
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "daaa60f38984e9345c73d54a", "attempt_id": "76fd7952ef0f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:53.831002Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.267666021362, "ttft_ms": 7.5076669454574585, "decode_ms": 29.54470901750028}, "total_wall_ms": 1150.2536670304835, "ttft_ms": 7.5076669454574585, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3445653504, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889409112, "mlx_cache_bytes": 2665574744, "process_rss_bytes": 3445653504}, "peak_prefill_memory": null, "peak_decode_memory": 3889409112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "8f33021df5b0cccfe63c24a771d88027febebd2eb3850b900232cb72da008089"} | ||||
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "654294f727cb3b5c2b73e008", "attempt_id": "40e4c27aea80", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:55.006314Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5874, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.526790975593, "ttft_ms": 7.464374997653067, "decode_ms": 66.07775005977601}, "total_wall_ms": 1188.7994160642847, "ttft_ms": 7.464374997653067, "input_usage": {"receiver_prompt_tokens": 5874}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3445686272, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3892800600, "mlx_cache_bytes": 3283087704, "process_rss_bytes": 3445686272}, "peak_prefill_memory": null, "peak_decode_memory": 3892800600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,755,305", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "2feb744bc0efb44064e0bc375d54165760453fdd2c5b159d7c1c555e36e65a43"} | ||||
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9adb535e1a1e0fa756f7c024", "attempt_id": "0013d2431aaf", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:56.219668Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5875, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.1963340463117, "ttft_ms": 7.523583015426993, "decode_ms": 73.84629093576223}, "total_wall_ms": 1194.7534999344498, "ttft_ms": 7.523583015426993, "input_usage": {"receiver_prompt_tokens": 5875}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3445719040, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3892980824, "mlx_cache_bytes": 3665490264, "process_rss_bytes": 3445719040}, "peak_prefill_memory": null, "peak_decode_memory": 3892980824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "895236d1d3dcc18dca960b98", "attempt_id": "83183c9e0f62", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:57.440537Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.1335840923712, "ttft_ms": 7.469500065781176, "decode_ms": 14.589917031116784}, "total_wall_ms": 1135.6631249655038, "ttft_ms": 7.469500065781176, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3445751808, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889409112, "mlx_cache_bytes": 3665490264, "process_rss_bytes": 3445751808}, "peak_prefill_memory": null, "peak_decode_memory": 3889409112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4ce4f6d4aae944b29ca6993f", "attempt_id": "c2d07aa4cbf9", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:54:58.601029Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021000043489038944, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.4676249362528, "ttft_ms": 7.481500040739775, "decode_ms": 14.828582992777228}, "total_wall_ms": 1135.8413329580799, "ttft_ms": 7.481500040739775, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3445784576, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889409112, "mlx_cache_bytes": 3665490264, "process_rss_bytes": 3445784576}, "peak_prefill_memory": null, "peak_decode_memory": 3889409112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e155a0dc4b62b0c5e3fdc108", "attempt_id": "fe90a6c887f7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:00.917310Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 35, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 3.7015830166637897, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.7729159174487, "ttft_ms": 47.7729159174487, "decode_ms": 82.88124995306134}, "total_wall_ms": 140.3409589547664, "ttft_ms": 47.7729159174487, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3780968448, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3718524140, "mlx_cache_bytes": 4404672314, "process_rss_bytes": 3780968448}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3718524140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "FN-61P-4981", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "13e8328779a360703521a138305d0c3e1a42a5adbece3e3c52042c4a3ea91de2"} | ||||
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e0b6cbe142e08679d5f3dee3", "attempt_id": "4fa8d8201865", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:01.084297Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 1.5967920189723372, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.044374937191606, "ttft_ms": 51.044374937191606, "decode_ms": 89.91741598583758}, "total_wall_ms": 147.89633301552385, "ttft_ms": 51.044374937191606, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3780968448, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3728010492, "mlx_cache_bytes": 4485118082, "process_rss_bytes": 3780968448}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3728010492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 136-T, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "e35a975a2f9227792c5b4b03c710df10ddde842e28c40fbba4aaf1daeafead1d"} | ||||
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "57361aee8b7bacd7a428ed31", "attempt_id": "9a430587ea06", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:01.257684Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 41, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 1.764541957527399, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.733165931887925, "ttft_ms": 50.733165931887925, "decode_ms": 57.779333903454244}, "total_wall_ms": 115.81474996637553, "ttft_ms": 50.733165931887925, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3780984832, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3728010492, "mlx_cache_bytes": 4485118082, "process_rss_bytes": 3780984832}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3728010492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.7226", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "8d14a8e8f86bb852bed3f5945e7857bcf38c21afb7c3bf66bf6b66c02d4929ea"} | ||||
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a1289ee85275b624f075aeb9", "attempt_id": "4474bb021969", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:01.398394Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 1.5530840028077364, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.94499999843538, "ttft_ms": 47.94499999843538, "decode_ms": 32.482167007401586}, "total_wall_ms": 87.45033293962479, "ttft_ms": 47.94499999843538, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3780984832, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3719425284, "mlx_cache_bytes": 4529946002, "process_rss_bytes": 3780984832}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3719425284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "8f33021df5b0cccfe63c24a771d88027febebd2eb3850b900232cb72da008089"} | ||||
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c8940d324aefcbead20ddc94", "attempt_id": "4c9b4e69b0e7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:01.510192Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 46, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 1.5554999699816108, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.603541920892894, "ttft_ms": 53.603541920892894, "decode_ms": 75.72270801756531}, "total_wall_ms": 136.59758400171995, "ttft_ms": 53.603541920892894, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3781001216, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3737349392, "mlx_cache_bytes": 4614471426, "process_rss_bytes": 3781001216}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3737349392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,755,305", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "2feb744bc0efb44064e0bc375d54165760453fdd2c5b159d7c1c555e36e65a43"} | ||||
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "535d2d882504683db3ab661b", "attempt_id": "dea5cc11e83c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:01.672489Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 1.5750000020489097, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.60958303511143, "ttft_ms": 50.60958303511143, "decode_ms": 82.45087508112192}, "total_wall_ms": 139.79204196948558, "ttft_ms": 50.60958303511143, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3781033984, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3738922260, "mlx_cache_bytes": 4689035386, "process_rss_bytes": 3781033984}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3738922260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cf55daaf9117347ff5fa1241", "attempt_id": "0137468b061f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:01.837485Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 1.5799999237060547, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.708416008390486, "ttft_ms": 47.708416008390486, "decode_ms": 16.430166084319353}, "total_wall_ms": 71.42933295108378, "ttft_ms": 47.708416008390486, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3781033984, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3719425284, "mlx_cache_bytes": 4689035386, "process_rss_bytes": 3781033984}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3719425284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f1a20c6499d649cdc640fae9", "attempt_id": "f7109155f2f3", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:01.933835Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 167100416, "serialized_payload_bytes": 167113158, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.2017500614747, "doc_prefill_ms": 1100.04516702611, "compress_ms": 3.6882919957861304, "serialize_ms": 39.25599996000528, "load_ms": 1.5940000303089619, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.70016600377858, "ttft_ms": 47.70016600377858, "decode_ms": 16.485708067193627}, "total_wall_ms": 71.10900001134723, "ttft_ms": 47.70016600377858, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 167100416, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3781050368, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3719425284, "mlx_cache_bytes": 4689035386, "process_rss_bytes": 3781050368}, "peak_prefill_memory": 3877629016, "peak_decode_memory": 3719425284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a1d55c6f792d6d2644b06552bd04b5c3163ec390cbd96a9203b0417392f96ada", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6a0eb0f628e31d014567c267", "attempt_id": "48051e3f36ff", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:02.047007Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1941, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.0755419554189, "ttft_ms": 7.48591695446521, "decode_ms": 70.0617500115186}, "total_wall_ms": 413.1301250308752, "ttft_ms": 7.48591695446521, "input_usage": {"receiver_prompt_tokens": 1941}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3742793728, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3802876572, "mlx_cache_bytes": 1094605736, "process_rss_bytes": 3742793728}, "peak_prefill_memory": null, "peak_decode_memory": 3802876572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GR-79S-5839", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "720cc40cd69e85e9728f6bea00b17a95ca07eee643e143a131840763958303cd"} | ||||
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f9dd4989065123772f5eb91b", "attempt_id": "eefa6f472dcc", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:02.476803Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1945, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.73204194847494, "ttft_ms": 7.325000013224781, "decode_ms": 77.92333303950727}, "total_wall_ms": 421.6451660031453, "ttft_ms": 7.325000013224781, "input_usage": {"receiver_prompt_tokens": 1945}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3742810112, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3804482220, "mlx_cache_bytes": 1769945608, "process_rss_bytes": 3742810112}, "peak_prefill_memory": null, "peak_decode_memory": 3804482220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 344-B, Témiscaming", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "0197d491a5a04a142dc8e372360735a1d41757e7a5aea7e81f23b0e1ef6ee010"} | ||||
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e836f315b03f073a4bb2ba12", "attempt_id": "a4673b015783", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:02.916221Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1945, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 331.0249999631196, "ttft_ms": 7.398708024993539, "decode_ms": 50.222375080920756}, "total_wall_ms": 392.34283403493464, "ttft_ms": 7.398708024993539, "input_usage": {"receiver_prompt_tokens": 1945}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3742810112, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3804482220, "mlx_cache_bytes": 1769945608, "process_rss_bytes": 3742810112}, "peak_prefill_memory": null, "peak_decode_memory": 3804482220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "55.7912", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "9aa9f6d48d43eb12185d973cf0d62919041cf70e6dee09af0dbc2dec0c8c1711"} | ||||
| 36 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cb9ce5e55d9028c068e6fbaa", "attempt_id": "630123f04f11", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:03.326528Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1940, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 330.8960000285879, "ttft_ms": 7.384540978819132, "decode_ms": 43.25895803049207}, "total_wall_ms": 384.9984999978915, "ttft_ms": 7.384540978819132, "input_usage": {"receiver_prompt_tokens": 1940}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 3742810112, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3802876572, "mlx_cache_bytes": 1769945608, "process_rss_bytes": 3742810112}, "peak_prefill_memory": null, "peak_decode_memory": 3802876572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "2a62606853c315bba8769371d195e3ab3d6a8cd7ef959205575c5119740850f8"} | ||||
| 37 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b9a349958d4704c23fdaa7fb", "attempt_id": "6b2196a86a27", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:03.728574Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1949, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.1176669560373, "ttft_ms": 7.32370896730572, "decode_ms": 64.72737505100667}, "total_wall_ms": 407.5785829918459, "ttft_ms": 7.32370896730572, "input_usage": {"receiver_prompt_tokens": 1949}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3742826496, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3805891260, "mlx_cache_bytes": 2446776440, "process_rss_bytes": 3742826496}, "peak_prefill_memory": null, "peak_decode_memory": 3805891260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,863,814", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "f1722ba741a0ef5b3ac45cce5ffc57bea78f7eb0a07f17be098ba98a15ed3374"} | ||||
| 38 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "95f22325502f003c44245dd5", "attempt_id": "083e13d51a01", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:04.153319Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1951, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 331.49462495930493, "ttft_ms": 7.26070802193135, "decode_ms": 71.57316606026143}, "total_wall_ms": 413.75062498264015, "ttft_ms": 7.26070802193135, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3742826496, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3806284484, "mlx_cache_bytes": 2866149104, "process_rss_bytes": 3742826496}, "peak_prefill_memory": null, "peak_decode_memory": 3806284484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LA-54R-1196", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "18f1211f18f93d967bc015be841cc5831ffcd978ce7969f6d474d1d5905c861f"} | ||||
| 39 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b271a44eaff901649f3c533c", "attempt_id": "295e832c76e2", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:04.583574Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1943, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 331.67466695886105, "ttft_ms": 7.212915923446417, "decode_ms": 14.315375010482967}, "total_wall_ms": 356.67891695629805, "ttft_ms": 7.212915923446417, "input_usage": {"receiver_prompt_tokens": 1943}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3742826496, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3804089004, "mlx_cache_bytes": 3283941104, "process_rss_bytes": 3742826496}, "peak_prefill_memory": null, "peak_decode_memory": 3804089004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 40 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b55fe3a4af0de33b13bcb80c", "attempt_id": "5f078b7772ab", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:04.957149Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1940, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 331.27729198895395, "ttft_ms": 7.355917012318969, "decode_ms": 14.305666903965175}, "total_wall_ms": 356.3592080026865, "ttft_ms": 7.355917012318969, "input_usage": {"receiver_prompt_tokens": 1940}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3742826496, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3802876572, "mlx_cache_bytes": 3283941104, "process_rss_bytes": 3742826496}, "peak_prefill_memory": null, "peak_decode_memory": 3802876572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 41 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9caa9bd393cc08b7c332f5a4", "attempt_id": "9da2e9dbc8ee", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:05.672062Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 36, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.4576669782400131, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.420666931197047, "ttft_ms": 28.420666931197047, "decode_ms": 74.4738340144977}, "total_wall_ms": 106.2836250057444, "ttft_ms": 28.420666931197047, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3796795392, "backend_memory": {"mlx_active_bytes": 3257461768, "mlx_peak_bytes": 3360976120, "mlx_cache_bytes": 4037492001, "process_rss_bytes": 3796795392}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3360976120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GR-79S-5839", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "720cc40cd69e85e9728f6bea00b17a95ca07eee643e143a131840763958303cd"} | ||||
| 42 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "974dc729f3aebd5d572e69a0", "attempt_id": "7ea3b17b1254", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:05.795930Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.3129159342497587, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.514417052268982, "ttft_ms": 29.514417052268982, "decode_ms": 81.8853749660775}, "total_wall_ms": 114.42266695667058, "ttft_ms": 29.514417052268982, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3796795392, "backend_memory": {"mlx_active_bytes": 3258379272, "mlx_peak_bytes": 3369839880, "mlx_cache_bytes": 4216798817, "process_rss_bytes": 3796795392}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3369839880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 344-B, Témiscaming", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "0197d491a5a04a142dc8e372360735a1d41757e7a5aea7e81f23b0e1ef6ee010"} | ||||
| 43 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "303601b8ca68437cf3ba1ce6", "attempt_id": "64063c392ce8", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:05.927320Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 40, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.382749993354082, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.834625030867755, "ttft_ms": 28.834625030867755, "decode_ms": 51.6415829770267}, "total_wall_ms": 83.62866705283523, "ttft_ms": 28.834625030867755, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3796811776, "backend_memory": {"mlx_active_bytes": 3257461768, "mlx_peak_bytes": 3369839880, "mlx_cache_bytes": 4217716321, "process_rss_bytes": 3796811776}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3369839880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "55.7912", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "9aa9f6d48d43eb12185d973cf0d62919041cf70e6dee09af0dbc2dec0c8c1711"} | ||||
| 44 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3fa838c5e91e2519606b8e7c", "attempt_id": "cdd65f6fe27f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:06.027873Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.4374590246006846, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.783167082816362, "ttft_ms": 27.783167082816362, "decode_ms": 44.57104194443673}, "total_wall_ms": 75.43149997945875, "ttft_ms": 27.783167082816362, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 3796811776, "backend_memory": {"mlx_active_bytes": 3257461768, "mlx_peak_bytes": 3360042232, "mlx_cache_bytes": 4252450401, "process_rss_bytes": 3796811776}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3360042232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Achterberg", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "2a62606853c315bba8769371d195e3ab3d6a8cd7ef959205575c5119740850f8"} | ||||
| 45 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "56de0c495e16106e63ac4005", "attempt_id": "77b4f6cd0f14", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:06.120056Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 44, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.3281670399010181, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.67862505465746, "ttft_ms": 29.67862505465746, "decode_ms": 66.9150419998914}, "total_wall_ms": 99.71562505234033, "ttft_ms": 29.67862505465746, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3796811776, "backend_memory": {"mlx_active_bytes": 3258379272, "mlx_peak_bytes": 3379178776, "mlx_cache_bytes": 4356521921, "process_rss_bytes": 3796811776}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3379178776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,863,814", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "f1722ba741a0ef5b3ac45cce5ffc57bea78f7eb0a07f17be098ba98a15ed3374"} | ||||
| 46 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9483dbb90247c52f244b6bf1", "attempt_id": "723b1df96269", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:06.236319Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.261083991266787, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.60845800023526, "ttft_ms": 28.60845800023526, "decode_ms": 73.79345793742687}, "total_wall_ms": 105.40937492623925, "ttft_ms": 28.60845800023526, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3796828160, "backend_memory": {"mlx_active_bytes": 3258379272, "mlx_peak_bytes": 3375197464, "mlx_cache_bytes": 4441899313, "process_rss_bytes": 3796828160}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3375197464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LA-54R-1196", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "18f1211f18f93d967bc015be841cc5831ffcd978ce7969f6d474d1d5905c861f"} | ||||
| 47 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "74c2d8b6f25c97bea26dfd34", "attempt_id": "5de182933dce", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:06.358067Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 38, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.312042004428804, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.656458016484976, "ttft_ms": 28.656458016484976, "decode_ms": 14.806583058089018}, "total_wall_ms": 46.43149999901652, "ttft_ms": 28.656458016484976, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3796828160, "backend_memory": {"mlx_active_bytes": 3257461768, "mlx_peak_bytes": 3367070984, "mlx_cache_bytes": 4499785429, "process_rss_bytes": 3796828160}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3367070984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 48 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1230fcb5999b8a88f652e8a7", "attempt_id": "ae3157b7998c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:06.421584Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 54620160, "serialized_payload_bytes": 54632841, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.42520802561194, "doc_prefill_ms": 323.2322500552982, "compress_ms": 1.42708292696625, "serialize_ms": 13.411582913249731, "load_ms": 1.2778749223798513, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.788916020654142, "ttft_ms": 27.788916020654142, "decode_ms": 14.839084004051983}, "total_wall_ms": 45.62225006520748, "ttft_ms": 27.788916020654142, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 54620160, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3796828160, "backend_memory": {"mlx_active_bytes": 3257461768, "mlx_peak_bytes": 3360042232, "mlx_cache_bytes": 4499785429, "process_rss_bytes": 3796828160}, "peak_prefill_memory": 3791669916, "peak_decode_memory": 3360042232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "316b654b0dcd193f58318f527dbd6fb1a359ff10671d27f15058c625e2ab103a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 49 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "79c42f49ce958d97d049a7a4", "attempt_id": "467e09d6f722", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:06.501462Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5952, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1120.344707975164, "ttft_ms": 7.674082997255027, "decode_ms": 72.7232500212267}, "total_wall_ms": 1212.3819158878177, "ttft_ms": 7.674082997255027, "input_usage": {"receiver_prompt_tokens": 5952}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3611246592, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3927223384, "mlx_cache_bytes": 1696051544, "process_rss_bytes": 3611246592}, "peak_prefill_memory": null, "peak_decode_memory": 3927223384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NC-81Q-5632", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "a164ecfce8f107d7a20bd963c79c2c4c12f25230ed03a15a9b8418fd88a56a6a"} | ||||
| 50 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "50199fb69b013363e6aab94e", "attempt_id": "74925d8fe602", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:07.738388Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5956, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1128.5680830478668, "ttft_ms": 7.526249974034727, "decode_ms": 80.09479194879532}, "total_wall_ms": 1227.0959590096027, "ttft_ms": 7.526249974034727, "input_usage": {"receiver_prompt_tokens": 5956}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3611279360, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3929418840, "mlx_cache_bytes": 2341826904, "process_rss_bytes": 3611279360}, "peak_prefill_memory": null, "peak_decode_memory": 3929418840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 586-H, Sept-Îles", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "2facb5a82d5d4139268d6cc6f9ed2170ae04b004140ac4fd883f87cb47e25ed7"} | ||||
| 51 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "531d7819aa660c71347f50e9", "attempt_id": "b4d09187dd6c", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:08.990506Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5955, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1127.7255000313744, "ttft_ms": 7.560958038084209, "decode_ms": 50.892457948066294}, "total_wall_ms": 1197.079624980688, "ttft_ms": 7.560958038084209, "input_usage": {"receiver_prompt_tokens": 5955}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3611312128, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3929418840, "mlx_cache_bytes": 2341826904, "process_rss_bytes": 3611312128}, "peak_prefill_memory": null, "peak_decode_memory": 3929418840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "36.4443", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "6986847809d5a53c4e76c5aa700f652372268de4b7869fddc8462508803f355d"} | ||||
| 52 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ab311310f1b28f81aeab6c5e", "attempt_id": "f1e3ab244cc6", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:10.213437Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5953, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1116.7585829971358, "ttft_ms": 8.250874932855368, "decode_ms": 36.47791699040681}, "total_wall_ms": 1173.3046660665423, "ttft_ms": 8.250874932855368, "input_usage": {"receiver_prompt_tokens": 5953}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3614670848, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3927403608, "mlx_cache_bytes": 2740941144, "process_rss_bytes": 3614670848}, "peak_prefill_memory": null, "peak_decode_memory": 3927403608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kwame Petrakis", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "5849498dab23072ae874aef51373bd300da620a33a626332ff86d41c9ce75103"} | ||||
| 53 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "725c130fdfb57f3f7377203c", "attempt_id": "4f0ec6357236", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:11.412212Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5957, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1127.5189169682562, "ttft_ms": 7.600209093652666, "decode_ms": 73.30599997658283}, "total_wall_ms": 1219.8318330338225, "ttft_ms": 7.600209093652666, "input_usage": {"receiver_prompt_tokens": 5957}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3615129600, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3929599064, "mlx_cache_bytes": 3141038424, "process_rss_bytes": 3615129600}, "peak_prefill_memory": null, "peak_decode_memory": 3929599064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,660,295 USD", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "9ac317774493c257d57e9ca8fa3afca757f9725dd762262435d6b268a92da7a0"} | ||||
| 54 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b1fb9a9d115bc8d11e40f0e6", "attempt_id": "69e986b0c9a0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:12.656636Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5961, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1128.2563750864938, "ttft_ms": 7.476457976736128, "decode_ms": 73.5609590774402}, "total_wall_ms": 1220.548375044018, "ttft_ms": 7.476457976736128, "input_usage": {"receiver_prompt_tokens": 5961}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3615162368, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3931024472, "mlx_cache_bytes": 3788501336, "process_rss_bytes": 3615162368}, "peak_prefill_memory": null, "peak_decode_memory": 3931024472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 55 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "47ea2e99ac8819d112860ea8", "attempt_id": "a584ac2a6ed8", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:13.902186Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5953, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1116.151834023185, "ttft_ms": 7.5098329689353704, "decode_ms": 14.7599580232054}, "total_wall_ms": 1149.547665962018, "ttft_ms": 7.5098329689353704, "input_usage": {"receiver_prompt_tokens": 5953}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3615211520, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3927403608, "mlx_cache_bytes": 3788501336, "process_rss_bytes": 3615211520}, "peak_prefill_memory": null, "peak_decode_memory": 3927403608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 56 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "246c171a0313b6a285b17eb1", "attempt_id": "5b49b9425670", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:15.076030Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5951, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018166028894484043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1115.5468339566141, "ttft_ms": 7.391416933387518, "decode_ms": 14.725042041391134}, "total_wall_ms": 1148.352041025646, "ttft_ms": 7.391416933387518, "input_usage": {"receiver_prompt_tokens": 5951}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3615244288, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3927223384, "mlx_cache_bytes": 3788501336, "process_rss_bytes": 3615244288}, "peak_prefill_memory": null, "peak_decode_memory": 3927223384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 57 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "66810f26d1e2f265a7e138e6", "attempt_id": "6f0012785206", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:17.417401Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 37, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 3.5664590541273355, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.32283307425678, "ttft_ms": 49.32283307425678, "decode_ms": 82.72654097527266}, "total_wall_ms": 141.8798330705613, "ttft_ms": 49.32283307425678, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 37}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3955294208, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3732761844, "mlx_cache_bytes": 4727437274, "process_rss_bytes": 3955294208}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3732761844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NC-81Q-5632", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "a164ecfce8f107d7a20bd963c79c2c4c12f25230ed03a15a9b8418fd88a56a6a"} | ||||
| 58 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5628f85a74d76863924c1969", "attempt_id": "ab7a3cec9966", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:17.585809Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 41, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 1.5599579783156514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.22220790851861, "ttft_ms": 50.22220790851861, "decode_ms": 90.19808296579868}, "total_wall_ms": 147.28616701904684, "ttft_ms": 50.22220790851861, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 41}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3955310592, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3740593404, "mlx_cache_bytes": 4807883042, "process_rss_bytes": 3955310592}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3740593404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 586-H, Sept-Îles", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "2facb5a82d5d4139268d6cc6f9ed2170ae04b004140ac4fd883f87cb47e25ed7"} | ||||
| 59 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "60e030cd1e578da39339da06", "attempt_id": "641c53a970cb", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:17.758465Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 40, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 1.5789580065757036, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.6764169074595, "ttft_ms": 49.6764169074595, "decode_ms": 57.73604195564985}, "total_wall_ms": 114.20012509915978, "ttft_ms": 49.6764169074595, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3955310592, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3739856132, "mlx_cache_bytes": 4841666850, "process_rss_bytes": 3955310592}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3739856132, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "36.4443", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "6986847809d5a53c4e76c5aa700f652372268de4b7869fddc8462508803f355d"} | ||||
| 60 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "401f6e5c863abdaebb7480d4", "attempt_id": "071be8355e06", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:17.897772Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 1.705292030237615, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.73929198179394, "ttft_ms": 46.73929198179394, "decode_ms": 41.29162500612438}, "total_wall_ms": 95.48058302607387, "ttft_ms": 46.73929198179394, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3955326976, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3736235268, "mlx_cache_bytes": 4899356358, "process_rss_bytes": 3955326976}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3736235268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kwame Petrakis", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "5849498dab23072ae874aef51373bd300da620a33a626332ff86d41c9ce75103"} | ||||
| 61 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d87e76d2d3f571fcc8cb647e", "attempt_id": "91103c86b820", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:18.019678Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 42, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 1.5843339497223496, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.725208992138505, "ttft_ms": 51.725208992138505, "decode_ms": 81.65729104075581}, "total_wall_ms": 140.8846250269562, "ttft_ms": 51.725208992138505, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 42}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3955326976, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3742051584, "mlx_cache_bytes": 4963467286, "process_rss_bytes": 3955326976}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3742051584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,660,295 USD", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "9ac317774493c257d57e9ca8fa3afca757f9725dd762262435d6b268a92da7a0"} | ||||
| 62 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7be7588dd61148bc0569f8f6", "attempt_id": "dde5bb77b489", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:18.186433Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 1.5436249086633325, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.18124995008111, "ttft_ms": 52.18124995008111, "decode_ms": 83.26991705689579}, "total_wall_ms": 142.72375009022653, "ttft_ms": 52.18124995008111, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3955326976, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3749915920, "mlx_cache_bytes": 5048549766, "process_rss_bytes": 3955326976}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3749915920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 63 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a498c39de1f46f92c7571dbd", "attempt_id": "bc24a0153741", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:18.356201Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 1.718458952382207, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.09775000810623, "ttft_ms": 47.09775000810623, "decode_ms": 16.30949997343123}, "total_wall_ms": 70.2867090003565, "ttft_ms": 47.09775000810623, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3955343360, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3736235268, "mlx_cache_bytes": 5048549766, "process_rss_bytes": 3955343360}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3736235268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 64 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c6762a571a9a52d6b502bea7", "attempt_id": "33a5f6eb04da", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:18.452878Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3433327624}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 36, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 169594880, "serialized_payload_bytes": 169607622, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1167.5665410002694, "doc_prefill_ms": 1111.867457977496, "compress_ms": 3.653832944110036, "serialize_ms": 40.69816705305129, "load_ms": 1.5555421123281121, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.23495799023658, "ttft_ms": 46.23495799023658, "decode_ms": 16.602625022642314}, "total_wall_ms": 69.71987499855459, "ttft_ms": 46.23495799023658, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 169594880, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3955376128, "backend_memory": {"mlx_active_bytes": 3604900872, "mlx_peak_bytes": 3732221172, "mlx_cache_bytes": 5078958470, "process_rss_bytes": 3955376128}, "peak_prefill_memory": 3915967576, "peak_decode_memory": 3732221172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "56fdb5a9e057ac67372c9d047ed4fad26a5336a3da88913cdc1ce41be9adc72e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 65 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "daa303a29a2e2f72977dd2c1", "attempt_id": "5afbc6940a21", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:18.567706Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1965, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 336.02912502828985, "ttft_ms": 7.524708053097129, "decode_ms": 70.89416601229459}, "total_wall_ms": 417.90629201568663, "ttft_ms": 7.524708053097129, "input_usage": {"receiver_prompt_tokens": 1965}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3917758464, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3811543804, "mlx_cache_bytes": 1112906760, "process_rss_bytes": 3917758464}, "peak_prefill_memory": null, "peak_decode_memory": 3811543804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XM-76Q-2958", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "cf42691eec772b9ec74d67643944de2e19e53724d7b772cef1e0f2d5ef3b4926"} | ||||
| 66 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "dac52d591deb627a0893d39e", "attempt_id": "0cc7fc27e5da", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:19.002467Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1970, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.14166600070894, "ttft_ms": 7.282958016730845, "decode_ms": 71.3918749243021}, "total_wall_ms": 417.4617079552263, "ttft_ms": 7.282958016730845, "input_usage": {"receiver_prompt_tokens": 1970}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3917774848, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3813149456, "mlx_cache_bytes": 1797077708, "process_rss_bytes": 3917774848}, "peak_prefill_memory": null, "peak_decode_memory": 3813149456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 412-V, La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "f3efd2f22a2bd1fc1064c66b80ea23ee9b55bfcfeed5abf0afc74d8e6e6e9472"} | ||||
| 67 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8e6b5b70ce9a0946ad90c5a1", "attempt_id": "e9f55a209a20", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:19.438405Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1969, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.3054169565439, "ttft_ms": 7.236166973598301, "decode_ms": 49.86191599164158}, "total_wall_ms": 395.62591700814664, "ttft_ms": 7.236166973598301, "input_usage": {"receiver_prompt_tokens": 1969}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3917807616, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3812526864, "mlx_cache_bytes": 1797077708, "process_rss_bytes": 3917807616}, "peak_prefill_memory": null, "peak_decode_memory": 3812526864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.3607", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "26a619fca5c1400fbdf84525fc258712ce159a23c3f2d87b343e0feb0a1a551d"} | ||||
| 68 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a32c1db9833a38a2753173dd", "attempt_id": "5218169cc9d0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:19.851124Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.0561660481617, "ttft_ms": 7.097458001226187, "decode_ms": 56.91158294212073}, "total_wall_ms": 402.14387502055615, "ttft_ms": 7.097458001226187, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 3917807616, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3811543804, "mlx_cache_bytes": 1797077708, "process_rss_bytes": 3917807616}, "peak_prefill_memory": null, "peak_decode_memory": 3811543804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "a3b6e0a44d495387d8b8fc50ba6be0f2ed43121c674d3b3e962f8c4690e15b5c"} | ||||
| 69 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "294c477ccbde27741dc826ab", "attempt_id": "2cf96aec346c", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:20.270136Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1973, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 336.2385410582647, "ttft_ms": 7.157791987992823, "decode_ms": 64.2809170531109}, "total_wall_ms": 410.9515839954838, "ttft_ms": 7.157791987992823, "input_usage": {"receiver_prompt_tokens": 1973}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3917824000, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3813739292, "mlx_cache_bytes": 2221169052, "process_rss_bytes": 3917824000}, "peak_prefill_memory": null, "peak_decode_memory": 3813739292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,724,290", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "f0076fc35460b3a09e30692d8eccd84fe24acad222fbb5246104e2c0e66ec997"} | ||||
| 70 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "32322de66265b03830e9f24c", "attempt_id": "2a8f966d26af", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:20.697584Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1976, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 334.4972499180585, "ttft_ms": 7.431000005453825, "decode_ms": 71.65866601280868}, "total_wall_ms": 417.02941700350493, "ttft_ms": 7.431000005453825, "input_usage": {"receiver_prompt_tokens": 1976}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3917824000, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3815148328, "mlx_cache_bytes": 2907420792, "process_rss_bytes": 3917824000}, "peak_prefill_memory": null, "peak_decode_memory": 3815148328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 71 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c00fda67241a9789441ffaba", "attempt_id": "6f3f4df6a979", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:21.131647Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 334.93649994488806, "ttft_ms": 7.311417022719979, "decode_ms": 14.250541105866432}, "total_wall_ms": 359.9204169586301, "ttft_ms": 7.311417022719979, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3917824000, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3811543804, "mlx_cache_bytes": 2907420792, "process_rss_bytes": 3917824000}, "peak_prefill_memory": null, "peak_decode_memory": 3811543804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 72 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3205570251233574caa1af76", "attempt_id": "01aab8e7d47e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:21.508859Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.2760000852868, "ttft_ms": 7.274500094354153, "decode_ms": 14.576917048543692}, "total_wall_ms": 360.6344999279827, "ttft_ms": 7.274500094354153, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3917824000, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3811543804, "mlx_cache_bytes": 2907420792, "process_rss_bytes": 3917824000}, "peak_prefill_memory": null, "peak_decode_memory": 3811543804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 73 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0b63f68017ca3fae73e48ce9", "attempt_id": "96883008f368", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.242067Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 36, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 1.4654590049758554, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.7625000346452, "ttft_ms": 28.7625000346452, "decode_ms": 73.73758300673217}, "total_wall_ms": 105.7334590004757, "ttft_ms": 28.7625000346452, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3259296776, "mlx_peak_bytes": 3363204344, "mlx_cache_bytes": 3669982889, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3363204344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XM-76Q-2958", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "cf42691eec772b9ec74d67643944de2e19e53724d7b772cef1e0f2d5ef3b4926"} | ||||
| 74 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0daf059c1bc26991e790c81e", "attempt_id": "fc0c4156766e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.365806Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 41, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 1.3699159026145935, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.82133289333433, "ttft_ms": 29.82133289333433, "decode_ms": 73.6544580431655}, "total_wall_ms": 106.56529094558209, "ttft_ms": 29.82133289333433, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 41}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3259296776, "mlx_peak_bytes": 3374230796, "mlx_cache_bytes": 3767238641, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3374230796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 412-V, La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "f3efd2f22a2bd1fc1064c66b80ea23ee9b55bfcfeed5abf0afc74d8e6e6e9472"} | ||||
| 75 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d0e69a23fda82f0f0b1af609", "attempt_id": "f4e992a4ffeb", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.489534Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 40, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 1.2724580010399222, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.805832960642874, "ttft_ms": 28.805832960642874, "decode_ms": 51.72087496612221}, "total_wall_ms": 83.49379198625684, "ttft_ms": 28.805832960642874, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3259296776, "mlx_peak_bytes": 3373280524, "mlx_cache_bytes": 3806920689, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3373280524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.3607", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "26a619fca5c1400fbdf84525fc258712ce159a23c3f2d87b343e0feb0a1a551d"} | ||||
| 76 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "96743310104063445d7f3124", "attempt_id": "f59c57d7a70c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.589910Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 1.3089169515296817, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.946208021603525, "ttft_ms": 27.946208021603525, "decode_ms": 59.08183299470693}, "total_wall_ms": 90.12858406640589, "ttft_ms": 27.946208021603525, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3259296776, "mlx_peak_bytes": 3362270456, "mlx_cache_bytes": 3841654769, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3362270456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "a3b6e0a44d495387d8b8fc50ba6be0f2ed43121c674d3b3e962f8c4690e15b5c"} | ||||
| 77 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "475207bd2f11b5107cae680c", "attempt_id": "3c2e795cec2a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.696809Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 44, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 1.3214999344199896, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.017375014722347, "ttft_ms": 30.017375014722347, "decode_ms": 66.47574994713068}, "total_wall_ms": 99.53879192471504, "ttft_ms": 30.017375014722347, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3259296776, "mlx_peak_bytes": 3381407000, "mlx_cache_bytes": 3946643793, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3381407000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,724,290", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "f0076fc35460b3a09e30692d8eccd84fe24acad222fbb5246104e2c0e66ec997"} | ||||
| 78 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d410d3a35f90f2e10ca8be40", "attempt_id": "01fbd2482901", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.812855Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 1.2509169755503535, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.882666072808206, "ttft_ms": 29.882666072808206, "decode_ms": 74.41433297935873}, "total_wall_ms": 107.2531669633463, "ttft_ms": 29.882666072808206, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379391772, "mlx_cache_bytes": 4119806665, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3379391772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 79 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e04710ac92330e267e73e2c3", "attempt_id": "cdcb5d0f23cc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.936827Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 0.658749951981008, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.681041974574327, "ttft_ms": 27.681041974574327, "decode_ms": 14.896041946485639}, "total_wall_ms": 45.019833953119814, "ttft_ms": 27.681041974574327, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3259296776, "mlx_peak_bytes": 3362270456, "mlx_cache_bytes": 4120724169, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3362270456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 80 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "68d177e6948af825b04895ec", "attempt_id": "2f534fa425e9", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:22.998648Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 55308288, "serialized_payload_bytes": 55320969, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.0730840759352, "doc_prefill_ms": 331.33041695691645, "compress_ms": 1.483708037994802, "serialize_ms": 17.863124958239496, "load_ms": 1.2252919841557741, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.867999975569546, "ttft_ms": 27.867999975569546, "decode_ms": 14.805249986238778}, "total_wall_ms": 45.61908298637718, "ttft_ms": 27.867999975569546, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 55308288, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4029136896, "backend_memory": {"mlx_active_bytes": 3259296776, "mlx_peak_bytes": 3362270456, "mlx_cache_bytes": 4120724169, "process_rss_bytes": 4029136896}, "peak_prefill_memory": 3799517948, "peak_decode_memory": 3362270456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d43ec95ed35b86528c2eef2dc71cebd2d1c76f7e389f4566a22c28de20615893", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 81 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d3b26f209b4099ca14f1c55b", "attempt_id": "acdfca213def", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:23.077587Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5919, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1115.2669170405716, "ttft_ms": 7.401791983284056, "decode_ms": 73.1604170287028}, "total_wall_ms": 1206.6686250036582, "ttft_ms": 7.401791983284056, "input_usage": {"receiver_prompt_tokens": 5919}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3841523712, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3916213336, "mlx_cache_bytes": 1685369176, "process_rss_bytes": 3841523712}, "peak_prefill_memory": null, "peak_decode_memory": 3916213336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "UU-99A-2257", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "05a311075f0ae9abae2c84c2f3eaf1f9ee9d38e801a7a116005be8bd9d71a8fe"} | ||||
| 82 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "350bae209b819348b3227754", "attempt_id": "7dc9ce26bd5d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:24.308084Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5923, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1115.4339580098167, "ttft_ms": 7.485667010769248, "decode_ms": 80.1127920858562}, "total_wall_ms": 1213.587792008184, "ttft_ms": 7.485667010769248, "input_usage": {"receiver_prompt_tokens": 5923}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3841605632, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3918113880, "mlx_cache_bytes": 2336944472, "process_rss_bytes": 3841605632}, "peak_prefill_memory": null, "peak_decode_memory": 3918113880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 517-P, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "8daee244a7965a6eda4415a811f0f6b4d5b158214660104b0c05fc03870ea73a"} | ||||
| 83 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8315d8c10841fcf649a95e65", "attempt_id": "3ae362b3793a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:25.546831Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5922, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1115.4111659852788, "ttft_ms": 7.440124987624586, "decode_ms": 50.92779197730124}, "total_wall_ms": 1185.5053330073133, "ttft_ms": 7.440124987624586, "input_usage": {"receiver_prompt_tokens": 5922}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3841638400, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3918113880, "mlx_cache_bytes": 2336944472, "process_rss_bytes": 3841638400}, "peak_prefill_memory": null, "peak_decode_memory": 3918113880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "91.5041", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "f02072bc2620e17c9b463f5f8f8a46319d9ae010d9257b58ed7ca179d18b023e"} | ||||
| 84 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e22c95e00e6056073909b376", "attempt_id": "feb5becf6f75", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:26.757008Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5919, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.6401250474155, "ttft_ms": 7.5894169276580215, "decode_ms": 51.340249949134886}, "total_wall_ms": 1182.1727079804987, "ttft_ms": 7.5894169276580215, "input_usage": {"receiver_prompt_tokens": 5919}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3841671168, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3916213336, "mlx_cache_bytes": 2336944472, "process_rss_bytes": 3841671168}, "peak_prefill_memory": null, "peak_decode_memory": 3916213336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oksana Haldorsen", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "3e4321e8bff955b009cf516f82227b56a6ee6e4a19f08eeea3229749fbcb048d"} | ||||
| 85 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "519158642edf62d0d1e09ac4", "attempt_id": "e3cd4a19f3a5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:27.965206Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5926, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1114.502500044182, "ttft_ms": 7.446417002938688, "decode_ms": 65.22691703867167}, "total_wall_ms": 1198.5339160310104, "ttft_ms": 7.446417002938688, "input_usage": {"receiver_prompt_tokens": 5926}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3841736704, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3918654552, "mlx_cache_bytes": 2730357080, "process_rss_bytes": 3841736704}, "peak_prefill_memory": null, "peak_decode_memory": 3918654552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,644,474", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "45891fbe62951d2409b9d0682483fdbfd19a6f82c6a601a0f417aeaa6e93dd7f"} | ||||
| 86 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4105c96b35ff3bfbcb57c5ad", "attempt_id": "f695336445cb", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:29.190154Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5928, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1115.6024580122903, "ttft_ms": 7.545874919742346, "decode_ms": 73.34737502969801}, "total_wall_ms": 1208.0078339204192, "ttft_ms": 7.545874919742346, "input_usage": {"receiver_prompt_tokens": 5928}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3841769472, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3919719512, "mlx_cache_bytes": 3366515032, "process_rss_bytes": 3841769472}, "peak_prefill_memory": null, "peak_decode_memory": 3919719512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 87 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "689f4caafe3a044c79178fe0", "attempt_id": "86606fb800c3", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:30.424210Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5920, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.434291979298, "ttft_ms": 7.408167002722621, "decode_ms": 14.675708021968603}, "total_wall_ms": 1146.109624998644, "ttft_ms": 7.408167002722621, "input_usage": {"receiver_prompt_tokens": 5920}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3841802240, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3916393560, "mlx_cache_bytes": 3758551384, "process_rss_bytes": 3841802240}, "peak_prefill_memory": null, "peak_decode_memory": 3916393560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 88 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a670ca2ec8e927711d731b3e", "attempt_id": "be11a62624d8", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:31.595038Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5921, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017166021279990673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.7800000831485, "ttft_ms": 7.3408340103924274, "decode_ms": 14.442125102505088}, "total_wall_ms": 1145.4758340260014, "ttft_ms": 7.3408340103924274, "input_usage": {"receiver_prompt_tokens": 5921}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3841835008, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3916573784, "mlx_cache_bytes": 4150784344, "process_rss_bytes": 3841835008}, "peak_prefill_memory": null, "peak_decode_memory": 3916573784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 89 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "94b394d384c14420a43b087d", "attempt_id": "1a13d47ebdb2", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:33.920756Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 3.6755410255864263, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.8689590068534, "ttft_ms": 54.8689590068534, "decode_ms": 82.52841711509973}, "total_wall_ms": 146.9768340466544, "ttft_ms": 54.8689590068534, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4009754624, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3723226356, "mlx_cache_bytes": 5332383706, "process_rss_bytes": 4009754624}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3723226356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "UU-99A-2257", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "05a311075f0ae9abae2c84c2f3eaf1f9ee9d38e801a7a116005be8bd9d71a8fe"} | ||||
| 90 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "32fccc3c434fbeaded6abac8", "attempt_id": "0b24907cc644", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:34.094169Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 41, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 1.5222919173538685, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.245958941057324, "ttft_ms": 52.245958941057324, "decode_ms": 89.80816602706909}, "total_wall_ms": 149.36624991241843, "ttft_ms": 52.245958941057324, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 41}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4009754624, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3731090684, "mlx_cache_bytes": 5412829474, "process_rss_bytes": 4009754624}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3731090684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 517-P, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "8daee244a7965a6eda4415a811f0f6b4d5b158214660104b0c05fc03870ea73a"} | ||||
| 91 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "74d1762d38f5754883c48635", "attempt_id": "9c8c048afaa2", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:34.269446Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 40, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 1.6098330961540341, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.58941601216793, "ttft_ms": 49.58941601216793, "decode_ms": 57.07133305259049}, "total_wall_ms": 113.94962505437434, "ttft_ms": 49.58941601216793, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4009754624, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3730320644, "mlx_cache_bytes": 5446613282, "process_rss_bytes": 4009754624}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3730320644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "91.5041", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "f02072bc2620e17c9b463f5f8f8a46319d9ae010d9257b58ed7ca179d18b023e"} | ||||
| 92 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "22ef37580776b73e8adf7697", "attempt_id": "ee0cfa624fc0", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:34.409881Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 37, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 1.479166909120977, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.74812499433756, "ttft_ms": 46.74812499433756, "decode_ms": 57.25370906293392}, "total_wall_ms": 111.35112505871803, "ttft_ms": 46.74812499433756, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 37}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4009754624, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3723226356, "mlx_cache_bytes": 5446613282, "process_rss_bytes": 4009754624}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3723226356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oksana Haldorsen", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "3e4321e8bff955b009cf516f82227b56a6ee6e4a19f08eeea3229749fbcb048d"} | ||||
| 93 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3d962ee3a885b72fd8642405", "attempt_id": "b0c9a3b80905", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:34.548771Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 44, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 1.7484589479863644, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.41220905352384, "ttft_ms": 51.41220905352384, "decode_ms": 73.62154207658023}, "total_wall_ms": 132.6489169150591, "ttft_ms": 51.41220905352384, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4009754624, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3736972552, "mlx_cache_bytes": 5533448834, "process_rss_bytes": 4009754624}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3736972552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,644,474", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "45891fbe62951d2409b9d0682483fdbfd19a6f82c6a601a0f417aeaa6e93dd7f"} | ||||
| 94 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "95b7fee5e47ad3bd71882564", "attempt_id": "b374d5c97c28", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:34.706481Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 46, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 1.568834064528346, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.973790978081524, "ttft_ms": 51.973790978081524, "decode_ms": 81.79066702723503}, "total_wall_ms": 141.33766700979322, "ttft_ms": 51.973790978081524, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4009754624, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3740413200, "mlx_cache_bytes": 5606882290, "process_rss_bytes": 4009754624}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3740413200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 95 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "22f3d8a6181f4f72839b9858", "attempt_id": "5d2e18d4efb4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:34.872924Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 38, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 1.5801670961081982, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.989292091690004, "ttft_ms": 45.989292091690004, "decode_ms": 16.36666595004499}, "total_wall_ms": 69.42883296869695, "ttft_ms": 45.989292091690004, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4009771008, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3725782276, "mlx_cache_bytes": 5664571798, "process_rss_bytes": 4009771008}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3725782276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 96 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "69f07f60a261195dc52d882e", "attempt_id": "d1e53261f356", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:34.967080Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 39, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 168648704, "serialized_payload_bytes": 168661446, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.93320899643, "doc_prefill_ms": 1103.2359590753913, "compress_ms": 3.601999953389168, "serialize_ms": 38.401750032790005, "load_ms": 1.5815000515431166, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.89066610485315, "ttft_ms": 48.89066610485315, "decode_ms": 16.642290982417762}, "total_wall_ms": 72.55066698417068, "ttft_ms": 48.89066610485315, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 168648704, "query_tokens": 39}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4009771008, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3729059076, "mlx_cache_bytes": 5713020807, "process_rss_bytes": 4009771008}, "peak_prefill_memory": 3895602264, "peak_decode_memory": 3729059076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "777bd6ca7e576c3edee67b8a2f60a45343662b1401f2bfa1fd11ead79fc3af1c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 97 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ef6d00c73f2e78e236e96e20", "attempt_id": "f492def1a418", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:35.086166Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2052, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 349.1324170026928, "ttft_ms": 7.349833031184971, "decode_ms": 71.38295797631145}, "total_wall_ms": 431.5117079531774, "ttft_ms": 7.349833031184971, "input_usage": {"receiver_prompt_tokens": 2052}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3971645440, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485312, "mlx_cache_bytes": 1089259876, "process_rss_bytes": 3971645440}, "peak_prefill_memory": null, "peak_decode_memory": 3714485312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PA-37F-6227", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "5b7645cf6e8140f4c0bf6ed4ad76121cf2924fe7e666d92161812527b86f4409"} | ||||
| 98 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7f52139eb2b51a4df8336738", "attempt_id": "f8cb7fe917fe", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:35.534830Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2057, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 356.6494999686256, "ttft_ms": 7.171290926635265, "decode_ms": 71.44795800559223}, "total_wall_ms": 438.66691703442484, "ttft_ms": 7.171290926635265, "input_usage": {"receiver_prompt_tokens": 2057}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3972153344, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714486324, "mlx_cache_bytes": 1102408596, "process_rss_bytes": 3972153344}, "peak_prefill_memory": null, "peak_decode_memory": 3714486324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mont-Laurier, Lot 94-V", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "ae52b25fb3e3649c008dfb303302bbfec3bc4c0b7b12a126b53f1387194844dc"} | ||||
| 99 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0fd71d72f79f16ed4cc8a153", "attempt_id": "08950785adf5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:35.990718Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2055, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 355.0347909331322, "ttft_ms": 7.15679198037833, "decode_ms": 49.78208302054554}, "total_wall_ms": 415.4769580345601, "ttft_ms": 7.15679198037833, "input_usage": {"receiver_prompt_tokens": 2055}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3972317184, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714486324, "mlx_cache_bytes": 1107922316, "process_rss_bytes": 3972317184}, "peak_prefill_memory": null, "peak_decode_memory": 3714486324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32.8676", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "520ae1b2810b61f606b08593758796f82b0309e238b5baba5846523b2369e949"} | ||||
| 100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0381183fb5af9c4dd51b674d", "attempt_id": "e73d8a315ab4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:36.423250Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2051, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 348.205209011212, "ttft_ms": 7.225916022434831, "decode_ms": 35.3888749377802}, "total_wall_ms": 394.57350003067404, "ttft_ms": 7.225916022434831, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3972382720, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485312, "mlx_cache_bytes": 1119104396, "process_rss_bytes": 3972382720}, "peak_prefill_memory": null, "peak_decode_memory": 3714485312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "fd88832c9fd0ab175818d76d875d70156225bd4b34ec401514546ef70f4f826c"} | ||||
| 101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5740e07a70eb7d9c8d89d688", "attempt_id": "596fafa02146", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:36.834901Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2059, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 356.5327919786796, "ttft_ms": 7.204583031125367, "decode_ms": 64.1665409784764}, "total_wall_ms": 431.4760420238599, "ttft_ms": 7.204583031125367, "input_usage": {"receiver_prompt_tokens": 2059}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3972481024, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714486324, "mlx_cache_bytes": 1124150668, "process_rss_bytes": 3972481024}, "peak_prefill_memory": null, "peak_decode_memory": 3714486324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,670,383", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "9510633f2e349a1cedecda578083181521646f70ca5ae08bae4b9188f3bd4a3b"} | ||||
| 102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4c73d9895e4506f184f64c3a", "attempt_id": "3fa7eab850b8", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:37.284541Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2062, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 358.069209032692, "ttft_ms": 7.194457924924791, "decode_ms": 71.07529195491225}, "total_wall_ms": 439.68904099892825, "ttft_ms": 7.194457924924791, "input_usage": {"receiver_prompt_tokens": 2062}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3972530176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714486324, "mlx_cache_bytes": 1134718348, "process_rss_bytes": 3972530176}, "peak_prefill_memory": null, "peak_decode_memory": 3714486324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "49d671c783bf2b15d10c969f", "attempt_id": "7aa9e62a773e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:37.740786Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2052, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 347.17412490863353, "ttft_ms": 7.070499937981367, "decode_ms": 14.050917001441121}, "total_wall_ms": 371.47708295378834, "ttft_ms": 7.070499937981367, "input_usage": {"receiver_prompt_tokens": 2052}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3972530176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485312, "mlx_cache_bytes": 1134718348, "process_rss_bytes": 3972530176}, "peak_prefill_memory": null, "peak_decode_memory": 3714485312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "052a00e1359bc745c9873f2a", "attempt_id": "945912ffe8d4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:38.129082Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2051, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416944183409214, "decode_payload_ms": 0.0, "receiver_prefill_ms": 347.0945830922574, "ttft_ms": 7.189665921032429, "decode_ms": 14.262665994465351}, "total_wall_ms": 372.31674999929965, "ttft_ms": 7.189665921032429, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3972530176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485312, "mlx_cache_bytes": 1134718348, "process_rss_bytes": 3972530176}, "peak_prefill_memory": null, "peak_decode_memory": 3714485312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1521d8fe1ea7d28a8f6a9c73", "attempt_id": "c11a4035afbf", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:38.878521Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 1.620209077373147, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.82904198486358, "ttft_ms": 28.82904198486358, "decode_ms": 74.38424997963011}, "total_wall_ms": 106.54008307028562, "ttft_ms": 28.82904198486358, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4088152064, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3371887868, "mlx_cache_bytes": 1937551029, "process_rss_bytes": 4088152064}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3371887868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PA-37F-6227", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "5b7645cf6e8140f4c0bf6ed4ad76121cf2924fe7e666d92161812527b86f4409"} | ||||
| 106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "31b12baaa2a1192ba27a39d0", "attempt_id": "23e91ef017e1", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.003009Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 42, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 1.3461250346153975, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.04250000230968, "ttft_ms": 30.04250000230968, "decode_ms": 74.090417008847}, "total_wall_ms": 107.1979160187766, "ttft_ms": 30.04250000230968, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 42}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4088168448, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3374787880, "mlx_cache_bytes": 2025713669, "process_rss_bytes": 4088168448}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3374787880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Mont-Laurier, Lot 94-V", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "ae52b25fb3e3649c008dfb303302bbfec3bc4c0b7b12a126b53f1387194844dc"} | ||||
| 107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bf1d829cc55e902e2e64dd72", "attempt_id": "b4705259179a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.127491Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 40, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 1.4432920143008232, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.045625055208802, "ttft_ms": 30.045625055208802, "decode_ms": 51.7787920543924}, "total_wall_ms": 84.9942920031026, "ttft_ms": 30.045625055208802, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4088168448, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3378801936, "mlx_cache_bytes": 2099900421, "process_rss_bytes": 4088168448}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3378801936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "32.8676", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "520ae1b2810b61f606b08593758796f82b0309e238b5baba5846523b2369e949"} | ||||
| 108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fa5271ccd665e32e24c55a6c", "attempt_id": "f7481722cddc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.229539Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 1.2872919905930758, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.465625015087426, "ttft_ms": 28.465625015087426, "decode_ms": 36.708208033815026}, "total_wall_ms": 68.26737499795854, "ttft_ms": 28.465625015087426, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4088168448, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3370904828, "mlx_cache_bytes": 2135617541, "process_rss_bytes": 4088168448}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3370904828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "fd88832c9fd0ab175818d76d875d70156225bd4b34ec401514546ef70f4f826c"} | ||||
| 109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d0d73194615187f1380b426e", "attempt_id": "efae72b55216", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.314466Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 44, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 1.3720419956371188, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.46845900826156, "ttft_ms": 30.46845900826156, "decode_ms": 66.63354090414941}, "total_wall_ms": 100.29054095502943, "ttft_ms": 30.46845900826156, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4088168448, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3378900240, "mlx_cache_bytes": 2231660901, "process_rss_bytes": 4088168448}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3378900240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,670,383", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "9510633f2e349a1cedecda578083181521646f70ca5ae08bae4b9188f3bd4a3b"} | ||||
| 110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a2a710bd7e3f750d3ffacb5f", "attempt_id": "b96551ea1e36", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.431834Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 1.3040420599281788, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.620708013884723, "ttft_ms": 30.620708013884723, "decode_ms": 73.81379103753716}, "total_wall_ms": 107.5636250898242, "ttft_ms": 30.620708013884723, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4088184832, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3384945952, "mlx_cache_bytes": 2314466013, "process_rss_bytes": 4088184832}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3384945952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b74141ff8b6a43676bc80024", "attempt_id": "56d08ab6c491", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.556149Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 1.375082996673882, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.26816705055535, "ttft_ms": 28.26816705055535, "decode_ms": 14.782625017687678}, "total_wall_ms": 46.15716601256281, "ttft_ms": 28.26816705055535, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4088184832, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3371855100, "mlx_cache_bytes": 2314466013, "process_rss_bytes": 4088184832}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3371855100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "efa3161008ad56aea3273ebd", "attempt_id": "f6fcda336234", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.619588Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204148232}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 57774080, "serialized_payload_bytes": 57786765, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 359.970833058469, "doc_prefill_ms": 340.7275000354275, "compress_ms": 1.4757500030100346, "serialize_ms": 14.271083055064082, "load_ms": 0.7129160221666098, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.48866698332131, "ttft_ms": 28.48866698332131, "decode_ms": 14.888250036165118}, "total_wall_ms": 45.79841601662338, "ttft_ms": 28.48866698332131, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 57774080, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4088184832, "backend_memory": {"mlx_active_bytes": 3263785992, "mlx_peak_bytes": 3370904828, "mlx_cache_bytes": 2314466013, "process_rss_bytes": 4088184832}, "peak_prefill_memory": 3828370520, "peak_decode_memory": 3370904828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "09bb6164089a27d2374353e45090c935e4f837907d8af5116e7be26e5df1d9e6", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a504d84f9583187a05119143", "attempt_id": "2034a1b2b204", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:39.694106Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5862, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1104.6417499892414, "ttft_ms": 7.942292024381459, "decode_ms": 79.97620804235339}, "total_wall_ms": 1203.8909579860047, "ttft_ms": 7.942292024381459, "input_usage": {"receiver_prompt_tokens": 5862}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3906912256, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3888344152, "mlx_cache_bytes": 1657958744, "process_rss_bytes": 3906912256}, "peak_prefill_memory": null, "peak_decode_memory": 3888344152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PQ-67Y-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "97f1830edf9da22d48fef4e34359dbd329492b94615357199b96b32a11ea25d6"} | ||||
| 114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "417a4031a9e6bcf0664df88a", "attempt_id": "6fda3dadc97f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:40.922245Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5867, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.783166919835, "ttft_ms": 7.425041985698044, "decode_ms": 65.82254101522267}, "total_wall_ms": 1186.9093329878524, "ttft_ms": 7.425041985698044, "input_usage": {"receiver_prompt_tokens": 5867}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3906945024, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889949784, "mlx_cache_bytes": 2272489816, "process_rss_bytes": 3906945024}, "peak_prefill_memory": null, "peak_decode_memory": 3889949784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 239-E, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "58ac0c4d209227a22a0ad818d3b7d1a70c7279ae290847bb31144897b9f48ce5"} | ||||
| 115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c53c965646c7aee6ebe81529", "attempt_id": "4b25ca6ff77a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:42.133455Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5866, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1100.6701659644023, "ttft_ms": 7.617541938088834, "decode_ms": 51.18345899973065}, "total_wall_ms": 1170.7612499594688, "ttft_ms": 7.617541938088834, "input_usage": {"receiver_prompt_tokens": 5866}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3906977792, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889949784, "mlx_cache_bytes": 2272489816, "process_rss_bytes": 3906977792}, "peak_prefill_memory": null, "peak_decode_memory": 3889949784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23.1986", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "abeb690b514e85e9408ebbfb6601456def9350a1f73376ab95944f9fd6cca706"} | ||||
| 116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "346018b8028724d8380c2c5c", "attempt_id": "82b22c98cc9e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:43.329040Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5861, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.4473330471665, "ttft_ms": 7.364499964751303, "decode_ms": 66.1116250557825}, "total_wall_ms": 1187.5181250507012, "ttft_ms": 7.364499964751303, "input_usage": {"receiver_prompt_tokens": 5861}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3906994176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3888344152, "mlx_cache_bytes": 2272489816, "process_rss_bytes": 3906994176}, "peak_prefill_memory": null, "peak_decode_memory": 3888344152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kwame Tremblay-Côté", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "dc1a90013da5aba8178a2099c35069f47cc07df44d751cf8071b84ead02462f3"} | ||||
| 117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a95b6500afe4090f8323c608", "attempt_id": "ace43ad8ad12", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:44.541361Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5870, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.0848750378937, "ttft_ms": 7.774500059895217, "decode_ms": 51.697000046260655}, "total_wall_ms": 1173.9588339114562, "ttft_ms": 7.774500059895217, "input_usage": {"receiver_prompt_tokens": 5870}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3907026944, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891375192, "mlx_cache_bytes": 2888511832, "process_rss_bytes": 3907026944}, "peak_prefill_memory": null, "peak_decode_memory": 3891375192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "963,250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "d825ba77ecbfdea1d1053ae87f96d18432372449d04441e8c3b3e65c948e757c"} | ||||
| 118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "aeadb9aa76b29403a74c78a4", "attempt_id": "063988124d4d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:45.740639Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5873, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.22141596023, "ttft_ms": 9.22020897269249, "decode_ms": 72.67091597896069}, "total_wall_ms": 1195.7631249679253, "ttft_ms": 9.22020897269249, "input_usage": {"receiver_prompt_tokens": 5873}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3909861376, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891915864, "mlx_cache_bytes": 3270521176, "process_rss_bytes": 3909861376}, "peak_prefill_memory": null, "peak_decode_memory": 3891915864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9804d342261e17838a32a504", "attempt_id": "a0911bf68ce9", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:46.961018Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5861, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.446333923377, "ttft_ms": 7.511167088523507, "decode_ms": 14.565999968908727}, "total_wall_ms": 1134.8777499515563, "ttft_ms": 7.511167088523507, "input_usage": {"receiver_prompt_tokens": 5861}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3910320128, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3888344152, "mlx_cache_bytes": 3270521176, "process_rss_bytes": 3910320128}, "peak_prefill_memory": null, "peak_decode_memory": 3888344152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cf7a706eacffc8660e21e338", "attempt_id": "b1d9aa9963ff", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:48.121305Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5863, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020249979570508003, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.5269170058891, "ttft_ms": 7.38741597160697, "decode_ms": 14.766416978091002}, "total_wall_ms": 1135.500584030524, "ttft_ms": 7.38741597160697, "input_usage": {"receiver_prompt_tokens": 5863}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3910352896, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889228888, "mlx_cache_bytes": 3650367832, "process_rss_bytes": 3910352896}, "peak_prefill_memory": null, "peak_decode_memory": 3889228888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "171f37f5d947c79c453dcfbd", "attempt_id": "96904ef3e949", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:50.437272Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 36, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 3.5778749734163284, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.98441699333489, "ttft_ms": 48.98441699333489, "decode_ms": 91.49429190438241}, "total_wall_ms": 149.49137507937849, "ttft_ms": 48.98441699333489, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 36}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3719425264, "mlx_cache_bytes": 4390352777, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3719425264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PQ-67Y-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "97f1830edf9da22d48fef4e34359dbd329492b94615357199b96b32a11ea25d6"} | ||||
| 122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "66f1ca02d62b88d1ea4b6368", "attempt_id": "517c26afa650", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:50.612760Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 41, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 1.5631250571459532, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.286500016227365, "ttft_ms": 50.286500016227365, "decode_ms": 73.41929094400257}, "total_wall_ms": 130.3883750224486, "ttft_ms": 50.286500016227365, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3728010492, "mlx_cache_bytes": 4470798545, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3728010492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 239-E, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "58ac0c4d209227a22a0ad818d3b7d1a70c7279ae290847bb31144897b9f48ce5"} | ||||
| 123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f84fe94a4be3cef7a92a987c", "attempt_id": "fc8d83f0ba7d", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:50.768218Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 40, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 1.5323749976232648, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.94641600549221, "ttft_ms": 48.94641600549221, "decode_ms": 57.29124997742474}, "total_wall_ms": 113.58241701964289, "ttft_ms": 48.94641600549221, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3727207684, "mlx_cache_bytes": 4504582353, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3727207684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23.1986", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "abeb690b514e85e9408ebbfb6601456def9350a1f73376ab95944f9fd6cca706"} | ||||
| 124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7ff9c8d88570f9256ac10ba6", "attempt_id": "fda6ceadc16d", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:50.906770Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 1.5345830470323563, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.247332986444235, "ttft_ms": 47.247332986444235, "decode_ms": 73.6274579539895}, "total_wall_ms": 127.62566609308124, "ttft_ms": 47.247332986444235, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3718884592, "mlx_cache_bytes": 4534155473, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3718884592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Kwame Tremblay-Côté", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "dc1a90013da5aba8178a2099c35069f47cc07df44d751cf8071b84ead02462f3"} | ||||
| 125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0435065bba1ac04aaa6b3e03", "attempt_id": "0ddb6a1518f7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:51.058965Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 1.5739999944344163, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.70045793056488, "ttft_ms": 51.70045793056488, "decode_ms": 57.00499995145947}, "total_wall_ms": 115.9327500499785, "ttft_ms": 51.70045793056488, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3733892360, "mlx_cache_bytes": 4620991025, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3733892360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "963,250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "d825ba77ecbfdea1d1053ae87f96d18432372449d04441e8c3b3e65c948e757c"} | ||||
| 126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "63e1e309bff51d6c2f361b5c", "attempt_id": "8376cfa3749a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:51.199255Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 1.5647499822080135, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.843500066548586, "ttft_ms": 50.843500066548586, "decode_ms": 81.67520794086158}, "total_wall_ms": 140.05858392920345, "ttft_ms": 50.843500066548586, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3738922260, "mlx_cache_bytes": 4695554985, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3738922260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ba5355e536e2641bfab9bd4f", "attempt_id": "51bd8bb5fa7e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:51.364228Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 1.4740830520167947, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.217249986715615, "ttft_ms": 47.217249986715615, "decode_ms": 16.545750084333122}, "total_wall_ms": 70.67199994344264, "ttft_ms": 47.217249986715615, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3718884592, "mlx_cache_bytes": 4695554985, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3718884592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5eda4955b01ba564c00df101", "attempt_id": "d116409725b7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:51.459902Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 37, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 167043072, "serialized_payload_bytes": 167055814, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1154.9769999692217, "doc_prefill_ms": 1098.6775419441983, "compress_ms": 7.846125052310526, "serialize_ms": 37.627708981744945, "load_ms": 1.5432500513270497, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.40233298111707, "ttft_ms": 49.40233298111707, "decode_ms": 16.35379099752754}, "total_wall_ms": 72.74912495631725, "ttft_ms": 49.40233298111707, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 167043072, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4078780416, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3721047300, "mlx_cache_bytes": 4757602562, "process_rss_bytes": 4078780416}, "peak_prefill_memory": 3877268568, "peak_decode_memory": 3721047300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c5805df10db378be1d88dbe050e2be7f3a37d0bf17f0002a145df949bdbeb126", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3d25b68e2d8b1d4dcaca8b21", "attempt_id": "9235a1aa2b37", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:51.576410Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2002, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.6957919942215, "ttft_ms": 7.438750006258488, "decode_ms": 71.39029202517122}, "total_wall_ms": 422.9796660365537, "ttft_ms": 7.438750006258488, "input_usage": {"receiver_prompt_tokens": 2002}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4033085440, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824012176, "mlx_cache_bytes": 1116822684, "process_rss_bytes": 4033085440}, "peak_prefill_memory": null, "peak_decode_memory": 3824012176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-71M-6213", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "66ef6c5da682b38795e9029723bbd71cdde2c4dec70cf1fae6efe62ef243f10a"} | ||||
| 130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3104523bac70b7d456b0d14c", "attempt_id": "d104e6af9f97", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:52.016603Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2008, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.4005418997258, "ttft_ms": 7.209792034700513, "decode_ms": 85.66874999087304}, "total_wall_ms": 436.6562500363216, "ttft_ms": 7.209792034700513, "input_usage": {"receiver_prompt_tokens": 2008}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4033101824, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3826011048, "mlx_cache_bytes": 1814182904, "process_rss_bytes": 4033101824}, "peak_prefill_memory": null, "peak_decode_memory": 3826011048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 601-M, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "c029a5f68d4f87fccebc7b2ed6a8d95f46779503cf4748adb92748629c73f412"} | ||||
| 131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4fca50b119a3473f51f16d7b", "attempt_id": "b31de82bc825", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:52.470309Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2007, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 338.85854203253984, "ttft_ms": 7.136542000807822, "decode_ms": 50.02349999267608}, "total_wall_ms": 399.27429100498557, "ttft_ms": 7.136542000807822, "input_usage": {"receiver_prompt_tokens": 2007}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4033101824, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3826011048, "mlx_cache_bytes": 1814182904, "process_rss_bytes": 4033101824}, "peak_prefill_memory": null, "peak_decode_memory": 3826011048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13.4343", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "599bc22e373b1cf7b4679208eb9e515ad0e8dcb88dde0c7f579637ec7d3f3014"} | ||||
| 132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bc62199b6ec7725b1d3ae382", "attempt_id": "2ae292b481b4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:52.886224Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.6777920424938, "ttft_ms": 7.134624989703298, "decode_ms": 57.200125069357455}, "total_wall_ms": 407.3045839322731, "ttft_ms": 7.134624989703298, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4033101824, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824208808, "mlx_cache_bytes": 2244754424, "process_rss_bytes": 4033101824}, "peak_prefill_memory": null, "peak_decode_memory": 3824208808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "adc9a20b9adc1d63e08a6e4c1f5160bd8343c4e09ea9e1ab7296ec885a822f95"} | ||||
| 133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ff8afd9b4d7eb269df18fc18", "attempt_id": "e483ab8f6c6a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:53.310216Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2008, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.63420905638486, "ttft_ms": 7.156834006309509, "decode_ms": 64.50591702014208}, "total_wall_ms": 414.43279199302197, "ttft_ms": 7.156834006309509, "input_usage": {"receiver_prompt_tokens": 2008}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4033101824, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3826011048, "mlx_cache_bytes": 2244754424, "process_rss_bytes": 4033101824}, "peak_prefill_memory": null, "peak_decode_memory": 3826011048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,631,552", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "cecdbfc66b98662e79ca5deba218a2b11cf8d9e18b8f3d91c3032acf0c41fc29"} | ||||
| 134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4d892fe4f01e116ba6396940", "attempt_id": "9ceceaa37bea", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:53.741452Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2011, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.83258390799165, "ttft_ms": 7.157917018048465, "decode_ms": 71.24670897610486}, "total_wall_ms": 421.59633291885257, "ttft_ms": 7.157917018048465, "input_usage": {"receiver_prompt_tokens": 2011}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4033118208, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3826600884, "mlx_cache_bytes": 2677103456, "process_rss_bytes": 4033118208}, "peak_prefill_memory": null, "peak_decode_memory": 3826600884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6b427015e3222932ab9fc75e", "attempt_id": "da2f704bc543", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:54.179961Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.5335419336334, "ttft_ms": 7.411958067677915, "decode_ms": 14.30420798715204}, "total_wall_ms": 364.7745839552954, "ttft_ms": 7.411958067677915, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4033118208, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824208808, "mlx_cache_bytes": 2677103456, "process_rss_bytes": 4033118208}, "peak_prefill_memory": null, "peak_decode_memory": 3824208808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0a9a63b647fda95a3191fd84", "attempt_id": "69585aaea8ef", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:54.561506Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008292030543088913, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.13066603802145, "ttft_ms": 7.173124933615327, "decode_ms": 14.279749942943454}, "total_wall_ms": 364.90229109767824, "ttft_ms": 7.173124933615327, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4033118208, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824208808, "mlx_cache_bytes": 2677103456, "process_rss_bytes": 4033118208}, "peak_prefill_memory": null, "peak_decode_memory": 3824208808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f7750aed9b3ad558cfda074a", "attempt_id": "7cb3cdb03a70", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:55.297663Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 36, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 1.538792042993009, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.932500048540533, "ttft_ms": 28.932500048540533, "decode_ms": 74.01908305473626}, "total_wall_ms": 106.51445901021361, "ttft_ms": 28.932500048540533, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3365432568, "mlx_cache_bytes": 3453739409, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3365432568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-71M-6213", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "66ef6c5da682b38795e9029723bbd71cdde2c4dec70cf1fae6efe62ef243f10a"} | ||||
| 138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9d39489556fb25b882f7709e", "attempt_id": "50193d6d1199", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:55.422176Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 1.286290935240686, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.915417078882456, "ttft_ms": 29.915417078882456, "decode_ms": 89.2955840099603}, "total_wall_ms": 122.3180410452187, "ttft_ms": 29.915417078882456, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3378244880, "mlx_cache_bytes": 3640042209, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3378244880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 601-M, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "c029a5f68d4f87fccebc7b2ed6a8d95f46779503cf4748adb92748629c73f412"} | ||||
| 139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "877d03f2c165d960e978cb21", "attempt_id": "524ad782211a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:55.561856Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 41, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 1.3906669337302446, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.635624960064888, "ttft_ms": 29.635624960064888, "decode_ms": 51.69849994126707}, "total_wall_ms": 84.42016702611, "ttft_ms": 29.635624960064888, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3377310992, "mlx_cache_bytes": 3681641185, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3377310992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13.4343", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "599bc22e373b1cf7b4679208eb9e515ad0e8dcb88dde0c7f579637ec7d3f3014"} | ||||
| 140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b70ed9c814b02795946c0d1f", "attempt_id": "864068885b13", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:55.663196Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 1.3212080812081695, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.10074999090284, "ttft_ms": 29.10074999090284, "decode_ms": 59.04437496792525}, "total_wall_ms": 91.1618749378249, "ttft_ms": 29.10074999090284, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595280, "mlx_cache_bytes": 3757647930, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3367595280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "adc9a20b9adc1d63e08a6e4c1f5160bd8343c4e09ea9e1ab7296ec885a822f95"} | ||||
| 141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "03d7aa027817fb3d92d83311", "attempt_id": "3861a5a957c3", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:55.770931Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 42, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 0.6672909948974848, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.546541976742446, "ttft_ms": 29.546541976742446, "decode_ms": 66.63658400066197}, "total_wall_ms": 98.6781669780612, "ttft_ms": 29.546541976742446, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3378244880, "mlx_cache_bytes": 3756730426, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3378244880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,631,552", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "cecdbfc66b98662e79ca5deba218a2b11cf8d9e18b8f3d91c3032acf0c41fc29"} | ||||
| 142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bb425fa14651c4ab3ee62d93", "attempt_id": "6229d633630a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:55.886826Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 0.6816670065745711, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.205833027139306, "ttft_ms": 30.205833027139306, "decode_ms": 73.79850000143051}, "total_wall_ms": 106.37187503743917, "ttft_ms": 30.205833027139306, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3378064660, "mlx_cache_bytes": 3853855138, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3378064660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4484519f185b4138ca768e02", "attempt_id": "f840aef1b66a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:56.010548Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 1.2533749686554074, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.11483305413276, "ttft_ms": 28.11483305413276, "decode_ms": 14.856583904474974}, "total_wall_ms": 46.01229098625481, "ttft_ms": 28.11483305413276, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595280, "mlx_cache_bytes": 3854772642, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3367595280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "02dc54876ff300c9efb7e227", "attempt_id": "f60db0f638ac", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:56.073577Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 56369152, "serialized_payload_bytes": 56381837, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.3256249977276, "doc_prefill_ms": 335.5056670261547, "compress_ms": 1.6847499646246433, "serialize_ms": 13.773082988336682, "load_ms": 1.2908749049529433, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.230166994035244, "ttft_ms": 28.230166994035244, "decode_ms": 14.838374918326735}, "total_wall_ms": 46.285875025205314, "ttft_ms": 28.230166994035244, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 56369152, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4088594432, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595280, "mlx_cache_bytes": 3854772642, "process_rss_bytes": 4088594432}, "peak_prefill_memory": 3812182928, "peak_decode_memory": 3367595280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "13866481d89b163deaf06794990aa076ad6261b4cbd2836db3aa0ba29aff08d8", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "261b03014d36a25f87f27f35", "attempt_id": "99475320965b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:56.153235Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5884, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1105.351416976191, "ttft_ms": 7.752042030915618, "decode_ms": 81.8905420601368}, "total_wall_ms": 1205.6350000202656, "ttft_ms": 7.752042030915618, "input_usage": {"receiver_prompt_tokens": 5884}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3902423040, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896192088, "mlx_cache_bytes": 1857270104, "process_rss_bytes": 3902423040}, "peak_prefill_memory": null, "peak_decode_memory": 3896192088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XK-22Q-9490", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "30ac087c01ec856cc5d95b422a0504ba4b29982ad42147a0fa27067152bef29e"} | ||||
| 146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "92b86f3f91dd4ebdfc349244", "attempt_id": "56744e3fa1e8", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:57.384425Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5890, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1113.2305830251426, "ttft_ms": 7.302832906134427, "decode_ms": 80.74841694906354}, "total_wall_ms": 1212.8944579744712, "ttft_ms": 7.302832906134427, "input_usage": {"receiver_prompt_tokens": 5890}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3902455808, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3907103832, "mlx_cache_bytes": 2497245528, "process_rss_bytes": 3902455808}, "peak_prefill_memory": null, "peak_decode_memory": 3907103832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 229-K, Témiscaming", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "478c2dc9ecddda982c5be668584c11d78d499ab2f12b9d176732310a778efe06"} | ||||
| 147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5a7d5c298b6249c8dffaf42b", "attempt_id": "c7ddad40beba", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:58.621767Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5889, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.8582920553163, "ttft_ms": 8.480750024318695, "decode_ms": 51.2654579943046}, "total_wall_ms": 1173.7764579011127, "ttft_ms": 8.480750024318695, "input_usage": {"receiver_prompt_tokens": 5889}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3902488576, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3897093208, "mlx_cache_bytes": 2882597208, "process_rss_bytes": 3902488576}, "peak_prefill_memory": null, "peak_decode_memory": 3897093208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "65.3868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "2dcbcd6384301b1f03d2dd767a2ef0bcb62a10249d084be6e9738ce86fe4690f"} | ||||
| 148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "90ea12eaaeb197ba75bb806d", "attempt_id": "6e6aa67bcba0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:55:59.821883Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5885, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.0572090530768, "ttft_ms": 7.396875065751374, "decode_ms": 37.47458301950246}, "total_wall_ms": 1158.855582936667, "ttft_ms": 7.396875065751374, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3902521344, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896372312, "mlx_cache_bytes": 3267162456, "process_rss_bytes": 3902521344}, "peak_prefill_memory": null, "peak_decode_memory": 3896372312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oksana Varga", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "939426b14501ae244f8b8a79280739080f1b34148143c4f1dab25de69eebfda5"} | ||||
| 149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "51615c248a551606e9f2ff72", "attempt_id": "a3bf66cb435e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:01.005291Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5894, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.0624580653384, "ttft_ms": 7.476083002984524, "decode_ms": 65.57862495537847}, "total_wall_ms": 1196.535583003424, "ttft_ms": 7.476083002984524, "input_usage": {"receiver_prompt_tokens": 5894}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3902554112, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3907824728, "mlx_cache_bytes": 3653693784, "process_rss_bytes": 3902554112}, "peak_prefill_memory": null, "peak_decode_memory": 3907824728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,519,700", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "f31f51fd5fb1986ddf80fc727e98ae3da80e1335676b76bd1bc1660a441d2eb2"} | ||||
| 150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "db51d981751fbf65738afacf", "attempt_id": "eb4f0e12ed14", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:02.226685Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5895, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.968541983515, "ttft_ms": 7.550457958132029, "decode_ms": 73.5103749902919}, "total_wall_ms": 1204.4243330601603, "ttft_ms": 7.550457958132029, "input_usage": {"receiver_prompt_tokens": 5895}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3902586880, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3908709464, "mlx_cache_bytes": 4278546776, "process_rss_bytes": 3902586880}, "peak_prefill_memory": null, "peak_decode_memory": 3908709464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "94bfd0a9cce5cfa0775d369d", "attempt_id": "1aa67f96a386", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:03.457796Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5885, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.6736669009551, "ttft_ms": 7.554874988272786, "decode_ms": 14.769583009183407}, "total_wall_ms": 1136.2932090414688, "ttft_ms": 7.554874988272786, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3902619648, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896372312, "mlx_cache_bytes": 4278546776, "process_rss_bytes": 3902619648}, "peak_prefill_memory": null, "peak_decode_memory": 3896372312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e7dfd815d5f9e7fedf630aea", "attempt_id": "e1e4af24f14b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:04.619086Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5884, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01791701652109623, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.4216250516474, "ttft_ms": 10.266624973155558, "decode_ms": 14.712417032569647}, "total_wall_ms": 1138.0896249320358, "ttft_ms": 10.266624973155558, "input_usage": {"receiver_prompt_tokens": 5884}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3902652416, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896192088, "mlx_cache_bytes": 4278546776, "process_rss_bytes": 3902652416}, "peak_prefill_memory": null, "peak_decode_memory": 3896192088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2aa69dd5c82258399aa630fb", "attempt_id": "af08f32b558b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:06.935128Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 3.673875005915761, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.67404203955084, "ttft_ms": 54.67404203955084, "decode_ms": 90.87099996395409}, "total_wall_ms": 155.05983296316117, "ttft_ms": 54.67404203955084, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4069654528, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3719720172, "mlx_cache_bytes": 5261653818, "process_rss_bytes": 4069654528}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3719720172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XK-22Q-9490", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "30ac087c01ec856cc5d95b422a0504ba4b29982ad42147a0fa27067152bef29e"} | ||||
| 154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e4acc624202ec6b0957531af", "attempt_id": "efdc53904343", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:07.118451Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 41, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 1.5364589635282755, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.99308395013213, "ttft_ms": 47.99308395013213, "decode_ms": 90.3194579295814}, "total_wall_ms": 145.98549995571375, "ttft_ms": 47.99308395013213, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 41}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4069654528, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3728927996, "mlx_cache_bytes": 5338953858, "process_rss_bytes": 4069654528}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3728927996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 229-K, Témiscaming", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "478c2dc9ecddda982c5be668584c11d78d499ab2f12b9d176732310a778efe06"} | ||||
| 155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2ebb25220a49af6395d3dd0a", "attempt_id": "370ade228d7d", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:07.290080Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 40, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 1.5747080324217677, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.95254203397781, "ttft_ms": 46.95254203397781, "decode_ms": 57.170042069628835}, "total_wall_ms": 111.63512500934303, "ttft_ms": 46.95254203397781, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4069654528, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3728125188, "mlx_cache_bytes": 5372737666, "process_rss_bytes": 4069654528}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3728125188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "65.3868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "2dcbcd6384301b1f03d2dd767a2ef0bcb62a10249d084be6e9738ce86fe4690f"} | ||||
| 156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "aaf270930c4c3de54f52ccae", "attempt_id": "f2cc39bd8fc4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:07.427186Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 1.592291984707117, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.23716699704528, "ttft_ms": 49.23716699704528, "decode_ms": 40.94516602344811}, "total_wall_ms": 97.30691707227379, "ttft_ms": 49.23716699704528, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4069654528, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3721538820, "mlx_cache_bytes": 5417565586, "process_rss_bytes": 4069654528}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3721538820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Oksana Varga", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "939426b14501ae244f8b8a79280739080f1b34148143c4f1dab25de69eebfda5"} | ||||
| 157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "327c935b2f5f00797f08041b", "attempt_id": "7051d7e65e05", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:07.550752Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 45, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 1.599124982021749, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.783083006739616, "ttft_ms": 51.783083006739616, "decode_ms": 73.84033303242177}, "total_wall_ms": 132.68454105127603, "ttft_ms": 51.783083006739616, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4069670912, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3736808716, "mlx_cache_bytes": 5500518138, "process_rss_bytes": 4069670912}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3736808716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,519,700", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "f31f51fd5fb1986ddf80fc727e98ae3da80e1335676b76bd1bc1660a441d2eb2"} | ||||
| 158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "483b583d2d5cb51e5e07e9bb", "attempt_id": "cb1355d03113", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:07.708210Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 46, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 0.9369580075144768, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.090832963585854, "ttft_ms": 52.090832963585854, "decode_ms": 81.8426669575274}, "total_wall_ms": 140.12970798648894, "ttft_ms": 52.090832963585854, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4069670912, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3738266896, "mlx_cache_bytes": 5570379882, "process_rss_bytes": 4069670912}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3738266896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1d0cf36145a8fc24f6c49570", "attempt_id": "bc99981978a2", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:07.873307Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 1.7348750261589885, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.593749990686774, "ttft_ms": 48.593749990686774, "decode_ms": 16.69287495315075}, "total_wall_ms": 72.6433329982683, "ttft_ms": 48.593749990686774, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4069670912, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3721538820, "mlx_cache_bytes": 5571297386, "process_rss_bytes": 4069670912}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3721538820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "393fbc9adc9ef7bd38f47c87", "attempt_id": "c56e4f0e3154", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:07.970616Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 167702528, "serialized_payload_bytes": 167715270, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.1032919883728, "doc_prefill_ms": 1099.631250021048, "compress_ms": 3.6316249752417207, "serialize_ms": 38.59962499700487, "load_ms": 1.508292043581605, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.31466697901487, "ttft_ms": 46.31466697901487, "decode_ms": 16.426165937446058}, "total_wall_ms": 69.53154201619327, "ttft_ms": 46.31466697901487, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 167702528, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4069670912, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3720637676, "mlx_cache_bytes": 5571297386, "process_rss_bytes": 4069670912}, "peak_prefill_memory": 3884592216, "peak_decode_memory": 3720637676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8ec28e0fde5631ceda45765d1fd5573823eca840b95d8ddb81809bb34f5d3674", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "27c455df600b89956fdd3964", "attempt_id": "2c141125f7d6", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:08.086470Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1997, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.69208295457065, "ttft_ms": 7.539625046774745, "decode_ms": 79.11233301274478}, "total_wall_ms": 429.91729103960097, "ttft_ms": 7.539625046774745, "input_usage": {"receiver_prompt_tokens": 1997}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4030775296, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822406524, "mlx_cache_bytes": 1115135112, "process_rss_bytes": 4030775296}, "peak_prefill_memory": null, "peak_decode_memory": 3822406524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GK-89M-5278", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "4e341227263a52b9d9acb67622f40b4070f4066768b00cd60b5a08c6be006b0a"} | ||||
| 162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c91ea9ea32ed48bb675ad78a", "attempt_id": "d9596b8b55a9", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:08.533273Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2002, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 341.0394580569118, "ttft_ms": 7.249374990351498, "decode_ms": 71.34016696363688}, "total_wall_ms": 423.1718749506399, "ttft_ms": 7.249374990351498, "input_usage": {"receiver_prompt_tokens": 2002}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4030791680, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824012176, "mlx_cache_bytes": 1810414540, "process_rss_bytes": 4030791680}, "peak_prefill_memory": null, "peak_decode_memory": 3824012176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 660-H, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "9a7648510c9743a8126239d7e19fd7d94f460c7b55140f10a05845c7aca9cd3c"} | ||||
| 163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fb2b1ae29e043a831484e9a5", "attempt_id": "eaff71b53dcb", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:08.973640Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2001, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.3107920419425, "ttft_ms": 7.160958019085228, "decode_ms": 50.15554092824459}, "total_wall_ms": 399.78487498592585, "ttft_ms": 7.160958019085228, "input_usage": {"receiver_prompt_tokens": 2001}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4030791680, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3823389584, "mlx_cache_bytes": 1810414540, "process_rss_bytes": 4030791680}, "peak_prefill_memory": null, "peak_decode_memory": 3823389584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "89.3122", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "2138888e6519b2f4b1b54142e6f9c541102d7f9ee5bcf8e4184c81a382601757"} | ||||
| 164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "eac3dbf75b3af6743ee6ac7f", "attempt_id": "4fbdc2b64c66", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:09.390712Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1997, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.49699997901917, "ttft_ms": 7.147792028263211, "decode_ms": 42.772082961164415}, "total_wall_ms": 392.49895804096013, "ttft_ms": 7.147792028263211, "input_usage": {"receiver_prompt_tokens": 1997}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4030791680, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822406524, "mlx_cache_bytes": 1810414540, "process_rss_bytes": 4030791680}, "peak_prefill_memory": null, "peak_decode_memory": 3822406524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "f42f05ebfc96f7258cbfbbb37cd65e114d3d15f869e68e6c95b71fc288c30a32"} | ||||
| 165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0883c41d0bdfe9a13f776168", "attempt_id": "f9fa6695d7f2", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:09.799483Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2006, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.5554170710966, "ttft_ms": 7.180667016655207, "decode_ms": 63.85250005405396}, "total_wall_ms": 413.8826250564307, "ttft_ms": 7.180667016655207, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4030808064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824798624, "mlx_cache_bytes": 2241583904, "process_rss_bytes": 4030808064}, "peak_prefill_memory": null, "peak_decode_memory": 3824798624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,421,725", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "6e31df6d4fb38417a5210ded39fc1e4c0e32f278ab9cba0da5b8e7585ddeb534"} | ||||
| 166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9726b4a3f81a4db84b93060d", "attempt_id": "f5fcad8b7c05", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:10.230121Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2006, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.3578340765089, "ttft_ms": 7.229584036394954, "decode_ms": 71.50112499948591}, "total_wall_ms": 421.3220840319991, "ttft_ms": 7.229584036394954, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4030808064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824798624, "mlx_cache_bytes": 2241583904, "process_rss_bytes": 4030808064}, "peak_prefill_memory": null, "peak_decode_memory": 3824798624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b78678b3ec7bcdb30dba5f6e", "attempt_id": "0cd58e2e4ff4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:10.668308Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1998, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.6054160548374, "ttft_ms": 7.1048339596018195, "decode_ms": 14.257374918088317}, "total_wall_ms": 364.2352499300614, "ttft_ms": 7.1048339596018195, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4030808064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822603152, "mlx_cache_bytes": 2671172384, "process_rss_bytes": 4030808064}, "peak_prefill_memory": null, "peak_decode_memory": 3822603152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3ebae075c42e4be648a1910a", "attempt_id": "5297cf15994d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:11.049345Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1998, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.27116699144244, "ttft_ms": 7.173083955422044, "decode_ms": 14.321124996058643}, "total_wall_ms": 364.9683330440894, "ttft_ms": 7.173083955422044, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4030808064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822603152, "mlx_cache_bytes": 2671172384, "process_rss_bytes": 4030808064}, "peak_prefill_memory": null, "peak_decode_memory": 3822603152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3fbe89633d06229aae99f92d", "attempt_id": "eb8c8496ef25", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:11.785539Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.4489999739453197, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.923167032189667, "ttft_ms": 28.923167032189667, "decode_ms": 81.59987500403076}, "total_wall_ms": 113.87987504713237, "ttft_ms": 28.923167032189667, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3365432568, "mlx_cache_bytes": 3445924177, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3365432568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GK-89M-5278", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "4e341227263a52b9d9acb67622f40b4070f4066768b00cd60b5a08c6be006b0a"} | ||||
| 170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "35639c233f2ec3da71f43ee2", "attempt_id": "bb3b4f1a6d2a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:11.917070Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 41, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.372625003568828, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.019458034075797, "ttft_ms": 30.019458034075797, "decode_ms": 73.74266698025167}, "total_wall_ms": 106.97204200550914, "ttft_ms": 30.019458034075797, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 41}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3376491788, "mlx_cache_bytes": 3543179929, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3376491788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 660-H, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "9a7648510c9743a8126239d7e19fd7d94f460c7b55140f10a05845c7aca9cd3c"} | ||||
| 171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e9ea5d211f1b7050eb12d9a8", "attempt_id": "5f03b2e894eb", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:12.040993Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 40, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.2515829876065254, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.069208074361086, "ttft_ms": 29.069208074361086, "decode_ms": 51.66533403098583}, "total_wall_ms": 83.74345896299928, "ttft_ms": 29.069208074361086, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3375508748, "mlx_cache_bytes": 3582861977, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3375508748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "89.3122", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "2138888e6519b2f4b1b54142e6f9c541102d7f9ee5bcf8e4184c81a382601757"} | ||||
| 172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "52fe7c0b6753823cc50d3b77", "attempt_id": "d2a76f96b84f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:12.141862Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 36, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.242582919076085, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.1619590241462, "ttft_ms": 28.1619590241462, "decode_ms": 44.65375002473593}, "total_wall_ms": 75.78612491488457, "ttft_ms": 28.1619590241462, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 36}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3365432568, "mlx_cache_bytes": 3582861977, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3365432568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wilhelmina Dubrovnik", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "f42f05ebfc96f7258cbfbbb37cd65e114d3d15f869e68e6c95b71fc288c30a32"} | ||||
| 173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "921d206ec09c8f96fa01ce1f", "attempt_id": "1e0c4a024d02", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:12.234454Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.3148749712854624, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.89825000986457, "ttft_ms": 29.89825000986457, "decode_ms": 66.85962493065745}, "total_wall_ms": 99.85308395698667, "ttft_ms": 29.89825000986457, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3378064660, "mlx_cache_bytes": 3679986689, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3378064660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,421,725", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "6e31df6d4fb38417a5210ded39fc1e4c0e32f278ab9cba0da5b8e7585ddeb534"} | ||||
| 174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "244deb4ad40fdc4823986554", "attempt_id": "0d43ee1a36ed", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:12.351223Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.4553338987752795, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.30704108439386, "ttft_ms": 29.30704108439386, "decode_ms": 74.19383397791535}, "total_wall_ms": 106.68787499889731, "ttft_ms": 29.30704108439386, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3378130196, "mlx_cache_bytes": 3679986689, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3378130196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "15671a3d2c72bb51ff97f601", "attempt_id": "08490a686e11", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:12.474999Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.3057090109214187, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.031916987150908, "ttft_ms": 29.031916987150908, "decode_ms": 14.858417096547782}, "total_wall_ms": 46.92708293441683, "ttft_ms": 29.031916987150908, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595276, "mlx_cache_bytes": 3755993434, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3367595276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8c6db13b427fae3b52ab93db", "attempt_id": "545db1a59197", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:12.538465Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 56225792, "serialized_payload_bytes": 56238477, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.15754094719887, "doc_prefill_ms": 334.96391598600894, "compress_ms": 1.50395801756531, "serialize_ms": 14.303374919109046, "load_ms": 1.3709579361602664, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.159250039607286, "ttft_ms": 28.159250039607286, "decode_ms": 14.65520798228681}, "total_wall_ms": 45.83491594530642, "ttft_ms": 28.159250039607286, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 56225792, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4087545856, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595276, "mlx_cache_bytes": 3755993434, "process_rss_bytes": 4087545856}, "peak_prefill_memory": 3810380668, "peak_decode_memory": 3367595276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "51ed0e07c7bf105c3441124271551663ceea5b116ae2ff4ea085b6f971eed0e2", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b0ce409ceb29b7338c2233ba", "attempt_id": "0077ab47cfca", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:12.615744Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1105.1431250525638, "ttft_ms": 7.768166018649936, "decode_ms": 73.07908299844712}, "total_wall_ms": 1196.6276669409126, "ttft_ms": 7.768166018649936, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3901358080, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3893341272, "mlx_cache_bytes": 1674981720, "process_rss_bytes": 3901358080}, "peak_prefill_memory": null, "peak_decode_memory": 3893341272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HH-14X-6634", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "0eb607bf9106acd2f27f0f2844c00047450ceed7799bbe1b2879672c3700b119"} | ||||
| 178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "57643b5c402570135445f11e", "attempt_id": "5cd769d48d3d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:13.836113Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5882, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.0015830183402, "ttft_ms": 7.56354199256748, "decode_ms": 88.70066702365875}, "total_wall_ms": 1210.3729580994695, "ttft_ms": 7.56354199256748, "input_usage": {"receiver_prompt_tokens": 5882}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 3901390848, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3895127128, "mlx_cache_bytes": 2474275160, "process_rss_bytes": 3901390848}, "peak_prefill_memory": null, "peak_decode_memory": 3895127128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 786-F, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "e9d8c9bcfcab971769d338246861d54b40408bbfdb6b29c68f7f7d803a7d78ed"} | ||||
| 179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "62d851c658418c8992ebd27e", "attempt_id": "687008e898e4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:15.070835Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5881, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.5423339558765, "ttft_ms": 7.520125014707446, "decode_ms": 50.89120892807841}, "total_wall_ms": 1171.365624992177, "ttft_ms": 7.520125014707446, "input_usage": {"receiver_prompt_tokens": 5881}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3901423616, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3895127128, "mlx_cache_bytes": 2474275160, "process_rss_bytes": 3901423616}, "peak_prefill_memory": null, "peak_decode_memory": 3895127128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "63.0928", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "5f1f985100540afc499942a9f0f4c0a96430054fe87cf8278d84202eadf815c1"} | ||||
| 180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7a0924b07f2298fd6a42672c", "attempt_id": "6ac439aa849d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:16.269310Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5879, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.9660830497742, "ttft_ms": 7.589708082377911, "decode_ms": 58.65454103332013}, "total_wall_ms": 1179.0273329243064, "ttft_ms": 7.589708082377911, "input_usage": {"receiver_prompt_tokens": 5879}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 3901456384, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3894586456, "mlx_cache_bytes": 2857660760, "process_rss_bytes": 3901456384}, "peak_prefill_memory": null, "peak_decode_memory": 3894586456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ragnvald Haldorsen", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "252259dc833200b039ed2c5085cf0dc6847ffefa99f4a653bdf8673481902f6c"} | ||||
| 181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d4f2176b7422ba8e68756626", "attempt_id": "23ad4a3df28a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:17.473558Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5885, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.6917089950293, "ttft_ms": 7.556417025625706, "decode_ms": 66.15108298137784}, "total_wall_ms": 1188.5481249773875, "ttft_ms": 7.556417025625706, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3901489152, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896372312, "mlx_cache_bytes": 3478942040, "process_rss_bytes": 3901489152}, "peak_prefill_memory": null, "peak_decode_memory": 3896372312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,755,450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "50ce1bf5a6a1535bae98114196498afa876eadf9e5680cdc8087d8bc8f71357e"} | ||||
| 182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b660f1403bd0f82baaccf95f", "attempt_id": "b9773d05d8b2", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:18.686761Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5887, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.7059169718996, "ttft_ms": 7.616084069013596, "decode_ms": 73.79379204940051}, "total_wall_ms": 1195.7087909104303, "ttft_ms": 7.616084069013596, "input_usage": {"receiver_prompt_tokens": 5887}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3901521920, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896732760, "mlx_cache_bytes": 3863900504, "process_rss_bytes": 3901521920}, "peak_prefill_memory": null, "peak_decode_memory": 3896732760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3a31bde554197e942e70df8c", "attempt_id": "716aa6e46718", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:19.908856Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.1381670143455, "ttft_ms": 7.447542040608823, "decode_ms": 14.756208984181285}, "total_wall_ms": 1135.6137079419568, "ttft_ms": 7.447542040608823, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3901554688, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3893341272, "mlx_cache_bytes": 3863900504, "process_rss_bytes": 3901554688}, "peak_prefill_memory": null, "peak_decode_memory": 3893341272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "10c9f9bf0e5f65d608f833a5", "attempt_id": "f9767d6be694", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:21.070077Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016834004782140255, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.207624935545, "ttft_ms": 7.540625054389238, "decode_ms": 14.533082954585552}, "total_wall_ms": 1135.8986670384184, "ttft_ms": 7.540625054389238, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3901587456, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3893341272, "mlx_cache_bytes": 3863900504, "process_rss_bytes": 3901587456}, "peak_prefill_memory": null, "peak_decode_memory": 3893341272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6e9464b160e663ed55301dc7", "attempt_id": "443e007e8d91", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:23.386211Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 3.4856669371947646, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.089667038060725, "ttft_ms": 49.089667038060725, "decode_ms": 82.25412503816187}, "total_wall_ms": 140.36333397962153, "ttft_ms": 49.089667038060725, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3720621296, "mlx_cache_bytes": 4607195017, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3720621296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HH-14X-6634", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "0eb607bf9106acd2f27f0f2844c00047450ceed7799bbe1b2879672c3700b119"} | ||||
| 186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8ed0e9c0cd2b2998ebbb5ebb", "attempt_id": "e04ef639804a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:23.552114Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 41, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 1.5752079198136926, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.539374981075525, "ttft_ms": 51.539374981075525, "decode_ms": 99.17741699609905}, "total_wall_ms": 157.54958393517882, "ttft_ms": 51.539374981075525, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 41}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3728010492, "mlx_cache_bytes": 4923029713, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3728010492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 786-F, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "e9d8c9bcfcab971769d338246861d54b40408bbfdb6b29c68f7f7d803a7d78ed"} | ||||
| 187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3e4c5b351310d6447175a44b", "attempt_id": "460c54d86d7c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:23.734793Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 40, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 1.5690409345552325, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.89383397717029, "ttft_ms": 50.89383397717029, "decode_ms": 57.450124993920326}, "total_wall_ms": 115.448541007936, "ttft_ms": 50.89383397717029, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3727207684, "mlx_cache_bytes": 4957731025, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3727207684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "63.0928", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "5f1f985100540afc499942a9f0f4c0a96430054fe87cf8278d84202eadf815c1"} | ||||
| 188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a9bc775089a6f474f488fa55", "attempt_id": "35b20d87e035", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:23.875338Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 38, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 0.9104590862989426, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.357291078194976, "ttft_ms": 49.357291078194976, "decode_ms": 65.40287507232279}, "total_wall_ms": 121.3742500403896, "ttft_ms": 49.357291078194976, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 38}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3723603204, "mlx_cache_bytes": 5021335157, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3723603204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ragnvald Haldorsen", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "252259dc833200b039ed2c5085cf0dc6847ffefa99f4a653bdf8673481902f6c"} | ||||
| 189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bb91afb437ad376f2dcb97be", "attempt_id": "a4000adb77b1", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:24.021347Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 44, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 1.5647909604012966, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.835374975577, "ttft_ms": 50.835374975577, "decode_ms": 75.06537495646626}, "total_wall_ms": 133.3191670710221, "ttft_ms": 50.835374975577, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3733892360, "mlx_cache_bytes": 5107253205, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3733892360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,755,450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "50ce1bf5a6a1535bae98114196498afa876eadf9e5680cdc8087d8bc8f71357e"} | ||||
| 190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "74f56c436f762bdcfc5370ab", "attempt_id": "b87816452c4b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:24.179535Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 46, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 1.5744169941172004, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.16329206712544, "ttft_ms": 47.16329206712544, "decode_ms": 81.56020892784}, "total_wall_ms": 135.43237501289696, "ttft_ms": 47.16329206712544, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3737349392, "mlx_cache_bytes": 5180129605, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3737349392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b6263150d2a7f13cd9850e95", "attempt_id": "a4f798b7840c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:24.339874Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 0.9174169972538948, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.11979189980775, "ttft_ms": 48.11979189980775, "decode_ms": 16.565208905376494}, "total_wall_ms": 71.13749999552965, "ttft_ms": 48.11979189980775, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3721538800, "mlx_cache_bytes": 5181047109, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3721538800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6ff820c9539c415cc684a268", "attempt_id": "1ce5c34a8689", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:24.435950Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 167473152, "serialized_payload_bytes": 167485894, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.810332994908, "doc_prefill_ms": 1101.3862079707906, "compress_ms": 3.4129590494558215, "serialize_ms": 37.83662500791252, "load_ms": 1.5714160399511456, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.02033305168152, "ttft_ms": 48.02033305168152, "decode_ms": 16.513916896656156}, "total_wall_ms": 71.27929199486971, "ttft_ms": 48.02033305168152, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 167473152, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4072865792, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3721538800, "mlx_cache_bytes": 5181047109, "process_rss_bytes": 4072865792}, "peak_prefill_memory": 3882265688, "peak_decode_memory": 3721538800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3db91caa7c7e7eb8ce66f056cda1f3535f29f29f9ab7b04e327dbd3d6afe65d8", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6438c7c8eb8024ed54843b50", "attempt_id": "f4f458e659c6", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:24.552184Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2057, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 356.30145797040313, "ttft_ms": 7.4640000239014626, "decode_ms": 71.36375003028661}, "total_wall_ms": 438.7821250129491, "ttft_ms": 7.4640000239014626, "input_usage": {"receiver_prompt_tokens": 2057}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4034035712, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485332, "mlx_cache_bytes": 1078868328, "process_rss_bytes": 4034035712}, "peak_prefill_memory": null, "peak_decode_memory": 3714485332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HQ-33P-3231", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "e5861e159e2f089d84f9a5111a99678f644225a54b9dd9a42d5652ebd91bb1db"} | ||||
| 194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "712c5c6e09f8096740c81251", "attempt_id": "62ad6ecf8827", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:25.008287Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2063, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 357.7817919431254, "ttft_ms": 7.199999992735684, "decode_ms": 85.21933306474239}, "total_wall_ms": 453.92150001134723, "ttft_ms": 7.199999992735684, "input_usage": {"receiver_prompt_tokens": 2063}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4034068480, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485356, "mlx_cache_bytes": 1091128736, "process_rss_bytes": 4034068480}, "peak_prefill_memory": null, "peak_decode_memory": 3714485356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 376-E, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "b58829a1440993c4af3307ba44494f021d726fd11e9337888b6b852a8b37351a"} | ||||
| 195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5490526e11006d326791961e", "attempt_id": "cfdc7f614f29", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:25.480834Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2062, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 356.6687919665128, "ttft_ms": 7.173374993726611, "decode_ms": 49.31708297226578}, "total_wall_ms": 416.8247500201687, "ttft_ms": 7.173374993726611, "input_usage": {"receiver_prompt_tokens": 2062}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4034068480, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485356, "mlx_cache_bytes": 1091128736, "process_rss_bytes": 4034068480}, "peak_prefill_memory": null, "peak_decode_memory": 3714485356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "77.6813", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "f46ae019c46016565ffc65d1a0d3d6edb83df7b3bebd11718e16031b63b695ef"} | ||||
| 196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "390d6b88af76f9c202df9d3f", "attempt_id": "be1e70edd5c4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:25.914857Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2060, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 356.2936659436673, "ttft_ms": 7.1862919721752405, "decode_ms": 63.956666039302945}, "total_wall_ms": 430.960625060834, "ttft_ms": 7.1862919721752405, "input_usage": {"receiver_prompt_tokens": 2060}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4034068480, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485356, "mlx_cache_bytes": 1097092512, "process_rss_bytes": 4034068480}, "peak_prefill_memory": null, "peak_decode_memory": 3714485356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9bc9fc30e080cac0f758c138", "attempt_id": "506ecb387830", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:26.364663Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2066, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 361.92070797551423, "ttft_ms": 7.252250099554658, "decode_ms": 63.71866597328335}, "total_wall_ms": 436.56120903324336, "ttft_ms": 7.252250099554658, "input_usage": {"receiver_prompt_tokens": 2066}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4034084864, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485368, "mlx_cache_bytes": 1143046628, "process_rss_bytes": 4034084864}, "peak_prefill_memory": null, "peak_decode_memory": 3714485368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,296,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "8b531ccf7fd3b97bf2ef32627da2617b8353e5c2dd09a274017a5a5a868bdcdb"} | ||||
| 198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bf8a7b3ed1f9312b82397c5a", "attempt_id": "94f6d0b1368c", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:26.818586Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2066, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 362.419500015676, "ttft_ms": 7.021875004284084, "decode_ms": 71.07783295214176}, "total_wall_ms": 444.043125025928, "ttft_ms": 7.021875004284084, "input_usage": {"receiver_prompt_tokens": 2066}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4034084864, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485368, "mlx_cache_bytes": 1143046628, "process_rss_bytes": 4034084864}, "peak_prefill_memory": null, "peak_decode_memory": 3714485368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-38K-5533", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "18acd9807857243bbded3bceae55398316a3958b81d70364441bdb6748eaf878"} | ||||
| 199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c7a435d1ac02e9f74de34561", "attempt_id": "e4ddb6b2df47", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:27.280420Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2058, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 355.8267919579521, "ttft_ms": 6.996457930654287, "decode_ms": 14.279499999247491}, "total_wall_ms": 380.51212509162724, "ttft_ms": 6.996457930654287, "input_usage": {"receiver_prompt_tokens": 2058}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4034084864, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485356, "mlx_cache_bytes": 1147797988, "process_rss_bytes": 4034084864}, "peak_prefill_memory": null, "peak_decode_memory": 3714485356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "41223bb066badd92b13f6a90", "attempt_id": "ace464417f75", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:27.677571Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 2057, "message_tokens": 1982, "message_utf8_bytes": 7313, "cache_tensor_bytes": null, "serialized_payload_bytes": 7313, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 355.6864579441026, "ttft_ms": 7.2243750328198075, "decode_ms": 14.362041023559868}, "total_wall_ms": 380.69841696415097, "ttft_ms": 7.2243750328198075, "input_usage": {"receiver_prompt_tokens": 2057}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4034084864, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485332, "mlx_cache_bytes": 1147797988, "process_rss_bytes": 4034084864}, "peak_prefill_memory": null, "peak_decode_memory": 3714485332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e1ef8a6febd3ea4b72d6da32", "attempt_id": "3ec83a5fba7e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:28.435942Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.9275830127298832, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.746458003297448, "ttft_ms": 28.746458003297448, "decode_ms": 75.49408404156566}, "total_wall_ms": 107.99270798452199, "ttft_ms": 28.746458003297448, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3370855672, "mlx_cache_bytes": 1948977173, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3370855672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HQ-33P-3231", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "e5861e159e2f089d84f9a5111a99678f644225a54b9dd9a42d5652ebd91bb1db"} | ||||
| 202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e2b210d5bfaaa300f4ec2bd1", "attempt_id": "f97aea0cdc99", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:28.562026Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 42, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.3580829836428165, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.735125019215047, "ttft_ms": 29.735125019215047, "decode_ms": 88.64695800002664}, "total_wall_ms": 121.5309159597382, "ttft_ms": 29.735125019215047, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 42}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3376016680, "mlx_cache_bytes": 2037270885, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3376016680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 376-E, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "b58829a1440993c4af3307ba44494f021d726fd11e9337888b6b852a8b37351a"} | ||||
| 203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8fa3b5fd58489215ebbd3188", "attempt_id": "201ff585174f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:28.702069Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 41, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.3207501033321023, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.671958065591753, "ttft_ms": 29.671958065591753, "decode_ms": 51.39150004833937}, "total_wall_ms": 84.4041669042781, "ttft_ms": 29.671958065591753, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3382635792, "mlx_cache_bytes": 2080409957, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3382635792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "77.6813", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "f46ae019c46016565ffc65d1a0d3d6edb83df7b3bebd11718e16031b63b695ef"} | ||||
| 204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "58de06bf31a9384fce5f1710", "attempt_id": "795456757e6a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:28.805101Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 39, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.3252500211820006, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.42516701295972, "ttft_ms": 29.42516701295972, "decode_ms": 67.05620791763067}, "total_wall_ms": 99.57637498155236, "ttft_ms": 29.42516701295972, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 39}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3378851088, "mlx_cache_bytes": 2151616342, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3378851088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ba5fb09d676100e19a68dc43", "attempt_id": "a7243a672b3d", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:28.922665Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.369333011098206, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.497417086735368, "ttft_ms": 30.497417086735368, "decode_ms": 66.81295798625797}, "total_wall_ms": 100.5016251001507, "ttft_ms": 30.497417086735368, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3383799064, "mlx_cache_bytes": 2246791358, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3383799064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,296,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "8b531ccf7fd3b97bf2ef32627da2617b8353e5c2dd09a274017a5a5a868bdcdb"} | ||||
| 206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "67cc1fed25744e4d4c72b3c3", "attempt_id": "df8fd5fa40d5", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:29.040635Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 45, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.2327500153332949, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.11125000193715, "ttft_ms": 30.11125000193715, "decode_ms": 73.99504201021045}, "total_wall_ms": 107.07579203881323, "ttft_ms": 30.11125000193715, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3383258392, "mlx_cache_bytes": 2246791358, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3383258392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-38K-5533", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "18acd9807857243bbded3bceae55398316a3958b81d70364441bdb6748eaf878"} | ||||
| 207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d5497bed8653da01724b964a", "attempt_id": "7d2f8bbea7c2", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:29.164697Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 37, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.3741250149905682, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.096915968693793, "ttft_ms": 29.096915968693793, "decode_ms": 14.94629099033773}, "total_wall_ms": 47.12249990552664, "ttft_ms": 29.096915968693793, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3372969232, "mlx_cache_bytes": 2314703038, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3372969232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "693a9e81b210197bd373194c", "attempt_id": "ddb3326c4365", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:29.228708Z", "task_family": "synthetic", "document_id": "syn_03018_2000", "document_hash": "d284eb07e27da742b9c2b67abccfdf72e4dd67c3259f44f3b41e34dd3e6fc1ff", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03018_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204869128}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1982, "source_tokens_receiver": 1982, "query_tokens": 36, "message_tokens": 2021, "message_utf8_bytes": 7313, "cache_tensor_bytes": 57946112, "serialized_payload_bytes": 57958797, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 360.92316696885973, "doc_prefill_ms": 341.8720420449972, "compress_ms": 1.6612090403214097, "serialize_ms": 13.988833059556782, "load_ms": 1.3567080022767186, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.281583916395903, "ttft_ms": 28.281583916395903, "decode_ms": 14.602791983634233}, "total_wall_ms": 45.925374957732856, "ttft_ms": 28.281583916395903, "input_usage": {"receiver_prefix_tokens": 2021, "dense_cache_bytes": 57946112, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4150804480, "backend_memory": {"mlx_active_bytes": 3264506888, "mlx_peak_bytes": 3371199736, "mlx_cache_bytes": 2314703038, "process_rss_bytes": 4150804480}, "peak_prefill_memory": 3830451308, "peak_decode_memory": 3371199736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03018_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1e57b2c2e8591d4dfa516ae0cfb2d70b7ab4cbc518049e0719ce8edcd91dca85", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "59f075bb9e34de7cc7ba8024", "attempt_id": "2cbb4703a401", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:29.304728Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5865, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.6657920340076, "ttft_ms": 7.539000012911856, "decode_ms": 73.64687498193234}, "total_wall_ms": 1195.5688330344856, "ttft_ms": 7.539000012911856, "input_usage": {"receiver_prompt_tokens": 5865}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3982934016, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889589336, "mlx_cache_bytes": 1646342488, "process_rss_bytes": 3982934016}, "peak_prefill_memory": null, "peak_decode_memory": 3889589336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XT-58M-1436", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "88a42ad8cf9f73f734996854479d027d426515d2bbd638fc89c418555a6c0484"} | ||||
| 210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5380b9529530476655f9e0a9", "attempt_id": "2b3eaeb7ecc9", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:30.526240Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5869, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.6654589222744, "ttft_ms": 7.539083017036319, "decode_ms": 66.30520801991224}, "total_wall_ms": 1187.3834170401096, "ttft_ms": 7.539083017036319, "input_usage": {"receiver_prompt_tokens": 5869}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3982966784, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891194968, "mlx_cache_bytes": 2262167896, "process_rss_bytes": 3982966784}, "peak_prefill_memory": null, "peak_decode_memory": 3891194968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 69-B, La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "3fa524abb2f344eee793f1d2e0661c3856e21ccde70f1aa4fd07f4a796141a4a"} | ||||
| 211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f0c60e6666875a058477312d", "attempt_id": "59a82053c188", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:31.737971Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5870, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.9285419499502, "ttft_ms": 7.490791962482035, "decode_ms": 51.341625046916306}, "total_wall_ms": 1173.0476670200005, "ttft_ms": 7.490791962482035, "input_usage": {"receiver_prompt_tokens": 5870}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3982999552, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891375192, "mlx_cache_bytes": 2643587416, "process_rss_bytes": 3982999552}, "peak_prefill_memory": null, "peak_decode_memory": 3891375192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "64.4363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "e893d3cc84006f45f29fed9ad95a4a4d27a56c544413f192e25efb93ff18e0c9"} | ||||
| 212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e3360435087b567b38a6ea2b", "attempt_id": "25e6f9a7c5c1", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:32.935828Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5865, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.7120420476422, "ttft_ms": 7.463125046342611, "decode_ms": 36.90587496384978}, "total_wall_ms": 1158.165874890983, "ttft_ms": 7.463125046342611, "input_usage": {"receiver_prompt_tokens": 5865}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 3983032320, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889589336, "mlx_cache_bytes": 2643587416, "process_rss_bytes": 3983032320}, "peak_prefill_memory": null, "peak_decode_memory": 3889589336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Varga", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "f6d5cac4a4e0857d4a2d59edc807a8bc5b4453aa9de6472025ff948ea6d9e901"} | ||||
| 213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b50c034234674aeb9ddbab80", "attempt_id": "f86caf17fd48", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:34.118301Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5871, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.0439999885857, "ttft_ms": 7.369333994574845, "decode_ms": 66.41195807605982}, "total_wall_ms": 1188.1934999255463, "ttft_ms": 7.369333994574845, "input_usage": {"receiver_prompt_tokens": 5871}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 3983065088, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891555416, "mlx_cache_bytes": 3025203544, "process_rss_bytes": 3983065088}, "peak_prefill_memory": null, "peak_decode_memory": 3891555416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,544,550", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "275c8abab9d6375639c672e5391f7a9637810a7c2d3985510d6d956c3cb3a509"} | ||||
| 214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "14d787dbdccf4350c315aeb8", "attempt_id": "5994b9d6688b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:35.330997Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5873, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.428249945864, "ttft_ms": 7.574207964353263, "decode_ms": 81.017833086662}, "total_wall_ms": 1202.8219590429217, "ttft_ms": 7.574207964353263, "input_usage": {"receiver_prompt_tokens": 5873}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 3983097856, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3891915864, "mlx_cache_bytes": 3407212888, "process_rss_bytes": 3983097856}, "peak_prefill_memory": null, "peak_decode_memory": 3891915864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a208506c4f286d5bec6f4089", "attempt_id": "969707b9ee97", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:36.557927Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5866, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.6351250475273, "ttft_ms": 7.433083024807274, "decode_ms": 14.829167048446834}, "total_wall_ms": 1135.737375007011, "ttft_ms": 7.433083024807274, "input_usage": {"receiver_prompt_tokens": 5866}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3983130624, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889769560, "mlx_cache_bytes": 3787649368, "process_rss_bytes": 3983130624}, "peak_prefill_memory": null, "peak_decode_memory": 3889769560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d6555bc485ee040b088d8558", "attempt_id": "b84814d98e95", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:37.717953Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 5864, "message_tokens": 5790, "message_utf8_bytes": 29139, "cache_tensor_bytes": null, "serialized_payload_bytes": 29139, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017625046893954277, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.8763340543956, "ttft_ms": 7.529375026933849, "decode_ms": 14.742083032615483}, "total_wall_ms": 1135.3994169039652, "ttft_ms": 7.529375026933849, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3983163392, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3889589336, "mlx_cache_bytes": 3787649368, "process_rss_bytes": 3983163392}, "peak_prefill_memory": null, "peak_decode_memory": 3889589336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "aaddafd3e872891a07c75042", "attempt_id": "b343b798933a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:40.035296Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 3.468250040896237, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.30637506954372, "ttft_ms": 51.30637506954372, "decode_ms": 82.37304200883955}, "total_wall_ms": 142.4456659005955, "ttft_ms": 51.30637506954372, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3719425264, "mlx_cache_bytes": 4528224137, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3719425264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XT-58M-1436", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "88a42ad8cf9f73f734996854479d027d426515d2bbd638fc89c418555a6c0484"} | ||||
| 218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1aa47e116766c5fbe55c8990", "attempt_id": "fb9140bc331e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:40.203565Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 40, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 1.4513750793412328, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.107042003422976, "ttft_ms": 51.107042003422976, "decode_ms": 74.6023328974843}, "total_wall_ms": 132.61420803610235, "ttft_ms": 51.107042003422976, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 40}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3726224632, "mlx_cache_bytes": 4606736585, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3726224632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 69-B, La Tuque", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.888888888888889}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "3fa524abb2f344eee793f1d2e0661c3856e21ccde70f1aa4fd07f4a796141a4a"} | ||||
| 219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f6d42086741a7564f63edeee", "attempt_id": "1d60da7193b7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:40.361547Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 41, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 1.5531249810010195, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.616374985314906, "ttft_ms": 51.616374985314906, "decode_ms": 57.51633399631828}, "total_wall_ms": 116.12145893741399, "ttft_ms": 51.616374985314906, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3728010492, "mlx_cache_bytes": 4676336145, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3728010492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "64.4363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "e893d3cc84006f45f29fed9ad95a4a4d27a56c544413f192e25efb93ff18e0c9"} | ||||
| 220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0084bb1bc1887b815ca1a9bd", "attempt_id": "e0d4d5d8c990", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:40.502240Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 36, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 1.5029580099508166, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.19691607169807, "ttft_ms": 47.19691607169807, "decode_ms": 40.758166927844286}, "total_wall_ms": 94.63874995708466, "ttft_ms": 47.19691607169807, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 36}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3719425264, "mlx_cache_bytes": 4676336145, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3719425264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Varga", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "f6d5cac4a4e0857d4a2d59edc807a8bc5b4453aa9de6472025ff948ea6d9e901"} | ||||
| 221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "db8d11afa353fdbb991555bc", "attempt_id": "c4971ff22751", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:40.622775Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 42, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 1.5153749845921993, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.041957991197705, "ttft_ms": 50.041957991197705, "decode_ms": 74.11520893219858}, "total_wall_ms": 131.20237505063415, "ttft_ms": 50.041957991197705, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3729468672, "mlx_cache_bytes": 4740184929, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3729468672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,544,550", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "275c8abab9d6375639c672e5391f7a9637810a7c2d3985510d6d956c3cb3a509"} | ||||
| 222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3201fa191e2977d3485e72c6", "attempt_id": "86448a6c19dc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:40.778985Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 44, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 1.5245000831782818, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.080290995538235, "ttft_ms": 50.080290995538235, "decode_ms": 89.86733306664973}, "total_wall_ms": 147.1311670029536, "ttft_ms": 50.080290995538235, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 44}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3733892360, "mlx_cache_bytes": 4826758337, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3733892360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JX-64S-4555", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "f6f8ca3da45dc6c01a3dede99eab98f0f3fd2d2c5e105791d9c68c607877ed22"} | ||||
| 223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f1d7b0fc19546dfd4c77bcbf", "attempt_id": "ab7814167aa0", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:40.950665Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 37, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 1.5864170854911208, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.97866602893919, "ttft_ms": 47.97866602893919, "decode_ms": 16.60549989901483}, "total_wall_ms": 71.6285000089556, "ttft_ms": 47.97866602893919, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3721358592, "mlx_cache_bytes": 4882891290, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3721358592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ea8777b58bc97eef12eca99a", "attempt_id": "f7e2fc1502d6", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:41.049122Z", "task_family": "synthetic", "document_id": "syn_03019_8000", "document_hash": "f8991a6ada3dde65b1427947e7dcf1f720fb02070a2dc500ecfd2e9bc6d8bf60", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03019_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5790, "source_tokens_receiver": 5790, "query_tokens": 35, "message_tokens": 5829, "message_utf8_bytes": 29139, "cache_tensor_bytes": 167129088, "serialized_payload_bytes": 167141830, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.471084035933, "doc_prefill_ms": 1100.5561669589952, "compress_ms": 8.82654101587832, "serialize_ms": 37.24704193882644, "load_ms": 1.5717080095782876, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.922207926400006, "ttft_ms": 46.922207926400006, "decode_ms": 16.837709001265466}, "total_wall_ms": 70.67475002259016, "ttft_ms": 46.922207926400006, "input_usage": {"receiver_prefix_tokens": 5829, "dense_cache_bytes": 167129088, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4151230464, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3718884592, "mlx_cache_bytes": 4912464410, "process_rss_bytes": 4151230464}, "peak_prefill_memory": 3877809240, "peak_decode_memory": 3718884592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03019_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2e64b60cefae859b44749b909685b61dac86b4bc81d4305c991e4341a8d5c69", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c0af5881cc3f33d409998db3", "attempt_id": "e5cf571f0f7e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:41.163774Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1987, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.0234580039978, "ttft_ms": 7.589291897602379, "decode_ms": 70.21912501659244}, "total_wall_ms": 421.32574995048344, "ttft_ms": 7.589291897602379, "input_usage": {"receiver_prompt_tokens": 1987}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4092215296, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3818998612, "mlx_cache_bytes": 1111563360, "process_rss_bytes": 4092215296}, "peak_prefill_memory": null, "peak_decode_memory": 3818998612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YY-49S-8868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "4cc3c5053f830db44f19e6ebbdb99b898d31569e68baec422a9c78a7af174fec"} | ||||
| 226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "11465404c2c3192572103e1c", "attempt_id": "2d574709cd59", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:41.601991Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1993, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.5214579543099, "ttft_ms": 7.254374912008643, "decode_ms": 79.24154202919453}, "total_wall_ms": 430.5360419675708, "ttft_ms": 7.254374912008643, "input_usage": {"receiver_prompt_tokens": 1993}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4092231680, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3820800876, "mlx_cache_bytes": 1803467648, "process_rss_bytes": 4092231680}, "peak_prefill_memory": null, "peak_decode_memory": 3820800876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1172d9d0e97363beee1738c8", "attempt_id": "deae76911f79", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:42.050009Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1993, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.32079100143164, "ttft_ms": 7.295874995179474, "decode_ms": 49.435833003371954}, "total_wall_ms": 400.6512080086395, "ttft_ms": 7.295874995179474, "input_usage": {"receiver_prompt_tokens": 1993}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4092231680, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3820800876, "mlx_cache_bytes": 1803467648, "process_rss_bytes": 4092231680}, "peak_prefill_memory": null, "peak_decode_memory": 3820800876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cad4bda76da16552462aaaf5", "attempt_id": "59e1bbbaa164", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:42.467957Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1990, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.07054201699793, "ttft_ms": 7.328375009819865, "decode_ms": 28.212666977196932}, "total_wall_ms": 378.2943330006674, "ttft_ms": 7.328375009819865, "input_usage": {"receiver_prompt_tokens": 1990}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 4092231680, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3819588460, "mlx_cache_bytes": 2231286656, "process_rss_bytes": 4092231680}, "peak_prefill_memory": null, "peak_decode_memory": 3819588460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "49bbd40937ebd144490ad5ad", "attempt_id": "68f7fce1688e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:42.863825Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1997, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.26929207518697, "ttft_ms": 7.339625037275255, "decode_ms": 64.22466598451138}, "total_wall_ms": 414.3158330116421, "ttft_ms": 7.339625037275255, "input_usage": {"receiver_prompt_tokens": 1997}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4092248064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822406524, "mlx_cache_bytes": 2924878512, "process_rss_bytes": 4092248064}, "peak_prefill_memory": null, "peak_decode_memory": 3822406524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e4c5d3363a42765dec47e7c8", "attempt_id": "fa69a61655d4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:43.295374Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1998, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 338.8655830640346, "ttft_ms": 7.322208024561405, "decode_ms": 78.78341700416058}, "total_wall_ms": 428.42850007582456, "ttft_ms": 7.322208024561405, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4092248064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822603136, "mlx_cache_bytes": 3354474980, "process_rss_bytes": 4092248064}, "peak_prefill_memory": null, "peak_decode_memory": 3822603136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ffcf757801ea2dcfdc7714b1", "attempt_id": "bc8109b3d8c7", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:43.740641Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1988, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 338.7578750262037, "ttft_ms": 7.392166997306049, "decode_ms": 14.416208025068045}, "total_wall_ms": 364.01929100975394, "ttft_ms": 7.392166997306049, "input_usage": {"receiver_prompt_tokens": 1988}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4092248064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3819195244, "mlx_cache_bytes": 3781900772, "process_rss_bytes": 4092248064}, "peak_prefill_memory": null, "peak_decode_memory": 3819195244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "20896bc39c79aaef2f979947", "attempt_id": "df5262fa0a61", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:44.121486Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 1989, "message_tokens": 1914, "message_utf8_bytes": 7171, "cache_tensor_bytes": null, "serialized_payload_bytes": 7171, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 338.6371670057997, "ttft_ms": 7.283207960426807, "decode_ms": 14.437749981880188}, "total_wall_ms": 363.77441696822643, "ttft_ms": 7.283207960426807, "input_usage": {"receiver_prompt_tokens": 1989}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4092248064, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3819588460, "mlx_cache_bytes": 3781900772, "process_rss_bytes": 4092248064}, "peak_prefill_memory": null, "peak_decode_memory": 3819588460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2efcd5dafcc7b353b835b083", "attempt_id": "2683f7dc69fa", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:44.856028Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 34, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.5406250022351742, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.92154105938971, "ttft_ms": 28.92154105938971, "decode_ms": 74.13991703651845}, "total_wall_ms": 106.59850004594773, "ttft_ms": 28.92154105938971, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 34}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4148936704, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3361910000, "mlx_cache_bytes": 4551163769, "process_rss_bytes": 4148936704}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3361910000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YY-49S-8868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "4cc3c5053f830db44f19e6ebbdb99b898d31569e68baec422a9c78a7af174fec"} | ||||
| 234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "621ac3865cd3b8140d8ddbf3", "attempt_id": "dd60cc2ac7a2", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:44.980043Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.311417086981237, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.9185001058504, "ttft_ms": 29.9185001058504, "decode_ms": 80.93024999834597}, "total_wall_ms": 113.89991699252278, "ttft_ms": 29.9185001058504, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4148969472, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3374296328, "mlx_cache_bytes": 4646060217, "process_rss_bytes": 4148969472}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3374296328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 536-R, Senneterre", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "5e85af24aac0f1904d70a2fcee84f1b6f6912cc7450298af1f173002fd8e59df"} | ||||
| 235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "946362f10033f4a944c8deaf", "attempt_id": "85b5620ac01f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:45.111510Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 40, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.3108329148963094, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.100290965288877, "ttft_ms": 29.100290965288877, "decode_ms": 51.875917008146644}, "total_wall_ms": 83.98650004528463, "ttft_ms": 29.100290965288877, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4148969472, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3374296328, "mlx_cache_bytes": 4646060217, "process_rss_bytes": 4148969472}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3374296328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "88.7751", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "1e01e62c69f9479b681e50e59e8565c6583f5cdb803446a05ed5cb13118acdf9"} | ||||
| 236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f13587bcf9deab761a9ab880", "attempt_id": "e37dad99ca1b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:45.212502Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 37, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.389582990668714, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.501790948212147, "ttft_ms": 28.501790948212147, "decode_ms": 29.670916963368654}, "total_wall_ms": 61.44916592165828, "ttft_ms": 28.501790948212147, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 37}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 4148969472, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367955720, "mlx_cache_bytes": 4713973266, "process_rss_bytes": 4148969472}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3367955720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "1dbd85090bb65fb3b72de8ca4ce32f2c234729ff4a239274e79fb574b800a79d"} | ||||
| 237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1371cf2f7da9669207278d8a", "attempt_id": "6d427468be31", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:45.291082Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 44, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.264458056539297, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.230166925117373, "ttft_ms": 29.230166925117373, "decode_ms": 66.27541605848819}, "total_wall_ms": 98.49562495946884, "ttft_ms": 29.230166925117373, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4148969472, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3383635224, "mlx_cache_bytes": 4818962290, "process_rss_bytes": 4148969472}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3383635224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,505,050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "ce50815ff9cdaab72b318f821f80a5ad96dc257c6df51048d6fd9c743b4157c6"} | ||||
| 238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7a713d7435484ecb71d56953", "attempt_id": "097b4590e327", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:45.406707Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 45, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.3064590748399496, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.532624990679324, "ttft_ms": 29.532624990679324, "decode_ms": 81.17937494534999}, "total_wall_ms": 113.90012502670288, "ttft_ms": 29.532624990679324, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 45}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4148969472, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3377917204, "mlx_cache_bytes": 4902521050, "process_rss_bytes": 4148969472}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3377917204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BQ-59Z-6753", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "db250f072c856fe7ddf4bbbd16e20c71b8bad1eef5e4480acd0dac30f8ffe9cd"} | ||||
| 239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4e6c995396d066a856f5589e", "attempt_id": "a561c79cdb09", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:45.538961Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 35, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.3611670583486557, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.11258297879249, "ttft_ms": 28.11258297879249, "decode_ms": 15.015666955150664}, "total_wall_ms": 46.170499990694225, "ttft_ms": 28.11258297879249, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4148969472, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3364498696, "mlx_cache_bytes": 4962814170, "process_rss_bytes": 4148969472}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3364498696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "09a379b5b1fbc52b6bce478a", "attempt_id": "f79d0de74a75", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:45.602925Z", "task_family": "synthetic", "document_id": "syn_03021_2000", "document_hash": "3ac205b464552356699a4d2b0a7bf62497ead36e5bca73982e11ae5ee3810731", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03021_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1914, "source_tokens_receiver": 1914, "query_tokens": 36, "message_tokens": 1953, "message_utf8_bytes": 7171, "cache_tensor_bytes": 55996416, "serialized_payload_bytes": 56009097, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.5375000210479, "doc_prefill_ms": 335.40420792996883, "compress_ms": 1.533249975182116, "serialize_ms": 13.130957959219813, "load_ms": 1.3248330214992166, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.077707975171506, "ttft_ms": 28.077707975171506, "decode_ms": 14.999209088273346}, "total_wall_ms": 46.047291019931436, "ttft_ms": 28.077707975171506, "input_usage": {"receiver_prefix_tokens": 1953, "dense_cache_bytes": 55996416, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4148969472, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3366251784, "mlx_cache_bytes": 4998531290, "process_rss_bytes": 4148969472}, "peak_prefill_memory": 3808185172, "peak_decode_memory": 3366251784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03021_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7882a0710f0b0a1aed20e88d13a6475620e983c167dce7a538b9bdee85b6671e", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "625067f1b4de8648fc0c2892", "attempt_id": "b6e71ad34347", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:45.683934Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5902, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1114.822292001918, "ttft_ms": 7.817417033948004, "decode_ms": 74.28929209709167}, "total_wall_ms": 1207.5886250240728, "ttft_ms": 7.817417033948004, "input_usage": {"receiver_prompt_tokens": 5902}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3962798080, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3910855768, "mlx_cache_bytes": 1680634200, "process_rss_bytes": 3962798080}, "peak_prefill_memory": null, "peak_decode_memory": 3910855768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NL-56Q-8506", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "87e5eec7467e8f663ce5fc00f58cc1e8350a4d16f8bdeb76efde22de32c960c1"} | ||||
| 242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fb83340c06dd6e25f03380d8", "attempt_id": "9f2b024b3363", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:46.916040Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5909, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1113.9412500197068, "ttft_ms": 7.444499991834164, "decode_ms": 88.51054206024855}, "total_wall_ms": 1220.7369589013979, "ttft_ms": 7.444499991834164, "input_usage": {"receiver_prompt_tokens": 5909}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 3962830848, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3912821848, "mlx_cache_bytes": 2309845336, "process_rss_bytes": 3962830848}, "peak_prefill_memory": null, "peak_decode_memory": 3912821848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 107-C, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "529f63496cb8e305b5c7065f875f09701231de0bfb59c312c51ffad84576be8c"} | ||||
| 243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0dc47f6f8f2159e9839908d0", "attempt_id": "b5eb11f8b661", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:48.161486Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5910, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1110.8329159906134, "ttft_ms": 7.484584115445614, "decode_ms": 51.815375103615224}, "total_wall_ms": 1181.108042015694, "ttft_ms": 7.484584115445614, "input_usage": {"receiver_prompt_tokens": 5910}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3962863616, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3913002072, "mlx_cache_bytes": 2699719000, "process_rss_bytes": 3962863616}, "peak_prefill_memory": null, "peak_decode_memory": 3913002072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14.2507", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "5340b8b8394a20dfd124c25aa5a3fdce2a6396ace676f9654b3a5bc86ff1113c"} | ||||
| 244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "291d0a287b58d1cbf502f546", "attempt_id": "3339fd954dd4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:49.367394Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5904, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1113.5472909081727, "ttft_ms": 7.577833952382207, "decode_ms": 29.402417014352977}, "total_wall_ms": 1161.3108749734238, "ttft_ms": 7.577833952382207, "input_usage": {"receiver_prompt_tokens": 5904}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 3962896384, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3911216216, "mlx_cache_bytes": 3088413016, "process_rss_bytes": 3962896384}, "peak_prefill_memory": null, "peak_decode_memory": 3911216216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "775ee725d22cde1231a003c526fba1f085a96ded35bc829dc02b72ae4bbab338"} | ||||
| 245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "899f45918651362ee47c78ab", "attempt_id": "52a9e0fb9779", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:50.552780Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5914, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.9211250226945, "ttft_ms": 7.63941602781415, "decode_ms": 51.7214999999851}, "total_wall_ms": 1183.5682910168543, "ttft_ms": 7.63941602781415, "input_usage": {"receiver_prompt_tokens": 5914}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 3962929152, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3914607704, "mlx_cache_bytes": 3719508312, "process_rss_bytes": 3962929152}, "peak_prefill_memory": null, "peak_decode_memory": 3914607704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "156c34ede28413081be9f379", "attempt_id": "645b4834093a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:51.761461Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5911, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.9424579665065, "ttft_ms": 7.436499930918217, "decode_ms": 73.4068329911679}, "total_wall_ms": 1203.4647919936106, "ttft_ms": 7.436499930918217, "input_usage": {"receiver_prompt_tokens": 5911}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 3962961920, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3914067032, "mlx_cache_bytes": 4109775192, "process_rss_bytes": 3962961920}, "peak_prefill_memory": null, "peak_decode_memory": 3914067032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cdaed37ddbd942a77fb955d4", "attempt_id": "f757b2103a5f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:52.989342Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5904, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.6873749997467, "ttft_ms": 7.44183303322643, "decode_ms": 14.829208957962692}, "total_wall_ms": 1145.181541913189, "ttft_ms": 7.44183303322643, "input_usage": {"receiver_prompt_tokens": 5904}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3962994688, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3911216216, "mlx_cache_bytes": 4109775192, "process_rss_bytes": 3962994688}, "peak_prefill_memory": null, "peak_decode_memory": 3911216216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bd5fc3d58da9552278981fd9", "attempt_id": "079faaa90f22", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:54.159703Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 5903, "message_tokens": 5828, "message_utf8_bytes": 29162, "cache_tensor_bytes": null, "serialized_payload_bytes": 29162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017332960851490498, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.3659590482712, "ttft_ms": 7.470417069271207, "decode_ms": 14.787583029828966}, "total_wall_ms": 1144.4441250059754, "ttft_ms": 7.470417069271207, "input_usage": {"receiver_prompt_tokens": 5903}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 3963027456, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3911216216, "mlx_cache_bytes": 4109775192, "process_rss_bytes": 3963027456}, "peak_prefill_memory": null, "peak_decode_memory": 3911216216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f7153bb76530a13837536fdb", "attempt_id": "ed66b475d2df", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:56.484671Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 35, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 3.463916014879942, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.2411669800058, "ttft_ms": 48.2411669800058, "decode_ms": 82.67904201056808}, "total_wall_ms": 140.3450829675421, "ttft_ms": 48.2411669800058, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4300144640, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3720719596, "mlx_cache_bytes": 5044172602, "process_rss_bytes": 4300144640}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3720719596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NL-56Q-8506", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "87e5eec7467e8f663ce5fc00f58cc1e8350a4d16f8bdeb76efde22de32c960c1"} | ||||
| 250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0d9bbfca08b5ec02bcdd1b74", "attempt_id": "6b1fb5b7871e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:56.651008Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 42, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 1.5640419442206621, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.754166044294834, "ttft_ms": 49.754166044294834, "decode_ms": 98.7530000275001}, "total_wall_ms": 155.98812501411885, "ttft_ms": 49.754166044294834, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 42}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4300144640, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3731631360, "mlx_cache_bytes": 5295945866, "process_rss_bytes": 4300144640}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3731631360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 107-C, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "529f63496cb8e305b5c7065f875f09701231de0bfb59c312c51ffad84576be8c"} | ||||
| 251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "afa36e04d369dec4181599ea", "attempt_id": "f936acd65b2b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:56.831703Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 43, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 1.528833992779255, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.78895797487348, "ttft_ms": 50.78895797487348, "decode_ms": 57.680250029079616}, "total_wall_ms": 115.53583398927003, "ttft_ms": 50.78895797487348, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4300144640, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3734924548, "mlx_cache_bytes": 5381962210, "process_rss_bytes": 4300144640}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3734924548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14.2507", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "5340b8b8394a20dfd124c25aa5a3fdce2a6396ace676f9654b3a5bc86ff1113c"} | ||||
| 252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a05e25e3222c0c9f1b10b9ba", "attempt_id": "75da74da3ffd", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:56.971536Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 1.6234159702435136, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.8840419780463, "ttft_ms": 46.8840419780463, "decode_ms": 32.47787500731647}, "total_wall_ms": 86.1598749179393, "ttft_ms": 46.8840419780463, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 4300144640, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3723226376, "mlx_cache_bytes": 5444468539, "process_rss_bytes": 4300144640}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3723226376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Idris Mbeki", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "775ee725d22cde1231a003c526fba1f085a96ded35bc829dc02b72ae4bbab338"} | ||||
| 253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "327527042b18a0d2bb53f5f8", "attempt_id": "6d4183e44fe9", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:57.083070Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 47, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 1.5401249984279275, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.73054200410843, "ttft_ms": 54.73054200410843, "decode_ms": 57.94170906301588}, "total_wall_ms": 119.85083296895027, "ttft_ms": 54.73054200410843, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4300161024, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3741084948, "mlx_cache_bytes": 5518114995, "process_rss_bytes": 4300161024}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3741084948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "687,975", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "ef19034975881d08c60ac17454ae5ab6c3e5ce2b4b41f46e1509aa90f9a2ee93"} | ||||
| 254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4f196a84f1c6a7b1ad47d28c", "attempt_id": "259a33cfc35a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:57.227836Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 44, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 1.5516250859946012, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.408582996577024, "ttft_ms": 52.408582996577024, "decode_ms": 82.86900003440678}, "total_wall_ms": 142.01429090462625, "ttft_ms": 52.408582996577024, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4300161024, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3736055060, "mlx_cache_bytes": 5572952243, "process_rss_bytes": 4300161024}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3736055060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PF-86G-3220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "35ef227d6ed3e91b9e3ce606beff647cc9c529f914331f075b2ff73fb82a5fb2"} | ||||
| 255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a21b1f017888a4738b4abe2a", "attempt_id": "4ecb1b7cee22", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:57.394490Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 37, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 1.546334009617567, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.76112497691065, "ttft_ms": 46.76112497691065, "decode_ms": 16.458750003948808}, "total_wall_ms": 70.2886669896543, "ttft_ms": 46.76112497691065, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4300161024, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3723226376, "mlx_cache_bytes": 5573869747, "process_rss_bytes": 4300161024}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3723226376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8415a3227b2f8f2cd616acec", "attempt_id": "7b255e05cbcd", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:57.490046Z", "task_family": "synthetic", "document_id": "syn_03022_8000", "document_hash": "c14b1263e320963acc2c01abd7735e9befb8a39cf89cb083c4d95987e8d38eee", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03022_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5828, "source_tokens_receiver": 5828, "query_tokens": 36, "message_tokens": 5867, "message_utf8_bytes": 29162, "cache_tensor_bytes": 168218624, "serialized_payload_bytes": 168231366, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1155.782917048782, "doc_prefill_ms": 1102.856667013839, "compress_ms": 3.3768339781090617, "serialize_ms": 38.32145896740258, "load_ms": 1.5124169876798987, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.24187501799315, "ttft_ms": 48.24187501799315, "decode_ms": 16.44070795737207}, "total_wall_ms": 71.38650002889335, "ttft_ms": 48.24187501799315, "input_usage": {"receiver_prefix_tokens": 5867, "dense_cache_bytes": 168218624, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4300161024, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3721981192, "mlx_cache_bytes": 5604278451, "process_rss_bytes": 4300161024}, "peak_prefill_memory": 3891309656, "peak_decode_memory": 3721981192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03022_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c5294dab4369b6a808b15048a939f513e03d510b5ae8e1c77a620ca4889745a", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4a1b2bdebc3623386fa06b3a", "attempt_id": "143bccaccdcb", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:57.606964Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2143, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 374.2337500443682, "ttft_ms": 7.347958977334201, "decode_ms": 71.79483398795128}, "total_wall_ms": 457.10716710891575, "ttft_ms": 7.347958977334201, "input_usage": {"receiver_prompt_tokens": 2143}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4261265408, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485676, "mlx_cache_bytes": 1187569360, "process_rss_bytes": 4261265408}, "peak_prefill_memory": null, "peak_decode_memory": 3714485676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SL-19R-1587", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "ec443ee9d09f3481154034f1fcaa81f8a0ac5dfe9dc889f6ac12c061317d403c"} | ||||
| 258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2df120dc1e974a9d677a513a", "attempt_id": "4372d2ca2850", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:58.081131Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2148, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 377.0389170385897, "ttft_ms": 7.213375065475702, "decode_ms": 64.60420798975974}, "total_wall_ms": 452.5639999192208, "ttft_ms": 7.213375065475702, "input_usage": {"receiver_prompt_tokens": 2148}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4261281792, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485696, "mlx_cache_bytes": 1305116764, "process_rss_bytes": 4261281792}, "peak_prefill_memory": null, "peak_decode_memory": 3714485696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 134-P, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "8929644842f678719485b68ca2d10d87162da6b1359cf8f68ba45a33174865df"} | ||||
| 259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "31c762460df472320fd24f63", "attempt_id": "fddb04ee888d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:58.550739Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2148, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 375.8304580114782, "ttft_ms": 7.1425000205636024, "decode_ms": 50.28470896650106}, "total_wall_ms": 436.7431659484282, "ttft_ms": 7.1425000205636024, "input_usage": {"receiver_prompt_tokens": 2148}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4261281792, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485696, "mlx_cache_bytes": 1305116764, "process_rss_bytes": 4261281792}, "peak_prefill_memory": null, "peak_decode_memory": 3714485696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2ba0fdc801880fc616fc766c", "attempt_id": "4dbe30431afe", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:59.004722Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2143, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 373.96808399353176, "ttft_ms": 7.2312080301344395, "decode_ms": 57.36316693946719}, "total_wall_ms": 442.13541701901704, "ttft_ms": 7.2312080301344395, "input_usage": {"receiver_prompt_tokens": 2143}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4261281792, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485676, "mlx_cache_bytes": 1305116764, "process_rss_bytes": 4261281792}, "peak_prefill_memory": null, "peak_decode_memory": 3714485676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Milos Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "08bee3515cc08e219baf175bc99b7985005f7f0bdd1f9383614e8232fcfa8619"} | ||||
| 261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3f7f0dee6d05e90e447772e5", "attempt_id": "2ed1dba81105", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:59.463777Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2149, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 376.2792079942301, "ttft_ms": 7.208833005279303, "decode_ms": 64.46358398534358}, "total_wall_ms": 451.3876249548048, "ttft_ms": 7.208833005279303, "input_usage": {"receiver_prompt_tokens": 2149}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4261298176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485700, "mlx_cache_bytes": 1344774636, "process_rss_bytes": 4261298176}, "peak_prefill_memory": null, "peak_decode_memory": 3714485700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "18f5a02e04b5caafe78810cf", "attempt_id": "fe54113cc4e5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:56:59.931737Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2153, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 376.34800001978874, "ttft_ms": 7.294166018255055, "decode_ms": 71.18533295579255}, "total_wall_ms": 458.4393339464441, "ttft_ms": 7.294166018255055, "input_usage": {"receiver_prompt_tokens": 2153}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4261298176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485716, "mlx_cache_bytes": 1463731084, "process_rss_bytes": 4261298176}, "peak_prefill_memory": null, "peak_decode_memory": 3714485716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "130d6dfcfd6e71d7f0d9506d", "attempt_id": "bf142e67b899", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:00.407179Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2142, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 373.6221670405939, "ttft_ms": 7.241167011670768, "decode_ms": 14.357000007294118}, "total_wall_ms": 398.82454206235707, "ttft_ms": 7.241167011670768, "input_usage": {"receiver_prompt_tokens": 2142}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4261298176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485676, "mlx_cache_bytes": 1464877964, "process_rss_bytes": 4261298176}, "peak_prefill_memory": null, "peak_decode_memory": 3714485676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0b2088e0ee04a51864d83f08", "attempt_id": "9a841b54f757", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:00.823752Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 2144, "message_tokens": 2068, "message_utf8_bytes": 7544, "cache_tensor_bytes": null, "serialized_payload_bytes": 7544, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 373.43174999114126, "ttft_ms": 7.340708049014211, "decode_ms": 14.469292014837265}, "total_wall_ms": 398.92629196401685, "ttft_ms": 7.340708049014211, "input_usage": {"receiver_prompt_tokens": 2144}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4261298176, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485696, "mlx_cache_bytes": 1551729548, "process_rss_bytes": 4261298176}, "peak_prefill_memory": null, "peak_decode_memory": 3714485696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b19af8195e7fa4d603c91258", "attempt_id": "df242930a385", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:01.623720Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 1.8874170491471887, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.026957927271724, "ttft_ms": 29.026957927271724, "decode_ms": 75.389500008896}, "total_wall_ms": 108.19258296396583, "ttft_ms": 29.026957927271724, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3276434440, "mlx_peak_bytes": 3382652152, "mlx_cache_bytes": 1818970557, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3382652152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SL-19R-1587", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "ec443ee9d09f3481154034f1fcaa81f8a0ac5dfe9dc889f6ac12c061317d403c"} | ||||
| 266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "355008e04dde2c4dcfe7eb1a", "attempt_id": "c55b6d8bde27", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:01.750217Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 1.3202499831095338, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.5479581002146, "ttft_ms": 30.5479581002146, "decode_ms": 67.32024997472763}, "total_wall_ms": 100.99095804616809, "ttft_ms": 30.5479581002146, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3276434440, "mlx_peak_bytes": 3386649892, "mlx_cache_bytes": 1892518661, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3386649892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 134-P, Amos", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "8929644842f678719485b68ca2d10d87162da6b1359cf8f68ba45a33174865df"} | ||||
| 267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fd5721a90ada5c76079255db", "attempt_id": "f3cc2396b652", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:01.868577Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 41, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 0.6689170841127634, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.242874985560775, "ttft_ms": 30.242874985560775, "decode_ms": 52.08987498190254}, "total_wall_ms": 84.75441706832498, "ttft_ms": 30.242874985560775, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3276434440, "mlx_peak_bytes": 3386649892, "mlx_cache_bytes": 1892518661, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3386649892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30.0224", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "e28a78bc4deb3cec8beab4bf5b87297d7cc55a3e6f839b43fe6408735d464923"} | ||||
| 268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c1053cfb651e3ae6c3b435cd", "attempt_id": "654b32f2e02c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:01.970453Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 36, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 1.265792059712112, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.390082996338606, "ttft_ms": 28.390082996338606, "decode_ms": 58.77033399883658}, "total_wall_ms": 90.22829192690551, "ttft_ms": 28.390082996338606, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 36}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3276434440, "mlx_peak_bytes": 3383323896, "mlx_cache_bytes": 1892518661, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3383323896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Milos Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "08bee3515cc08e219baf175bc99b7985005f7f0bdd1f9383614e8232fcfa8619"} | ||||
| 269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "90564a7225da5ef89bcc6730", "attempt_id": "ac23efcc1d76", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:02.077999Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 42, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 1.321458024904132, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.33974999561906, "ttft_ms": 30.33974999561906, "decode_ms": 67.07345903851092}, "total_wall_ms": 100.59433407150209, "ttft_ms": 30.33974999561906, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 42}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3276434440, "mlx_peak_bytes": 3388157224, "mlx_cache_bytes": 1966099541, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3388157224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,009,480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "30b20d9aae4d7b0587edeefdc2a9a159f73faf6e2570f1d408a415fe92cbf45e"} | ||||
| 270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "613596511271a984b51bde68", "attempt_id": "7720f7f643d4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:02.197458Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 46, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 1.393500017002225, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.763166956603527, "ttft_ms": 30.763166956603527, "decode_ms": 74.60120797622949}, "total_wall_ms": 108.5835830308497, "ttft_ms": 30.763166956603527, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3276434440, "mlx_peak_bytes": 3397217564, "mlx_cache_bytes": 2061798853, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3397217564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CT-20T-7883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "dd2e4bce724b0497351a41dbf71da774970bfcbe2553b73571a02bc7e8fa0e53"} | ||||
| 271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "288594fd31d89dee6465f552", "attempt_id": "b098ca07d6db", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:02.323956Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 35, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 1.4369169948622584, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.65908306557685, "ttft_ms": 28.65908306557685, "decode_ms": 14.890833059325814}, "total_wall_ms": 46.77074996288866, "ttft_ms": 28.65908306557685, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3275516936, "mlx_peak_bytes": 3382177016, "mlx_cache_bytes": 2097450437, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3382177016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a9a14d45637d1213ee4d6eb3", "attempt_id": "60f9a701becf", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:02.388305Z", "task_family": "synthetic", "document_id": "syn_03024_2000", "document_hash": "ea10cd11ad08f01c50b0712bc481668857c9d2ddc8e6423968f2a31eeb97ac55", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03024_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3214044168}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2068, "source_tokens_receiver": 2068, "query_tokens": 37, "message_tokens": 2107, "message_utf8_bytes": 7544, "cache_tensor_bytes": 60411904, "serialized_payload_bytes": 60424589, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 384.11674997769296, "doc_prefill_ms": 364.3510419642553, "compress_ms": 1.8996249418705702, "serialize_ms": 14.057459076866508, "load_ms": 1.368958968669176, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.55200006160885, "ttft_ms": 28.55200006160885, "decode_ms": 7.554915966466069}, "total_wall_ms": 39.234999916516244, "ttft_ms": 28.55200006160885, "input_usage": {"receiver_prefix_tokens": 2107, "dense_cache_bytes": 60411904, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 4382326784, "backend_memory": {"mlx_active_bytes": 3276434440, "mlx_peak_bytes": 3385109772, "mlx_cache_bytes": 2164445982, "process_rss_bytes": 4382326784}, "peak_prefill_memory": 3714485676, "peak_decode_memory": 3385109772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03024_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "481c72c6f2689b93a855e331b5779de4de24fdfaf7d274b0b2329c446bc29504", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "dfbcb69a39e29fe59e468542", "attempt_id": "21df89f133ad", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:02.456358Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5911, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1114.1059999354184, "ttft_ms": 7.662167074158788, "decode_ms": 73.57483403757215}, "total_wall_ms": 1206.889541936107, "ttft_ms": 7.662167074158788, "input_usage": {"receiver_prompt_tokens": 5911}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4213506048, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3914067032, "mlx_cache_bytes": 1753444696, "process_rss_bytes": 4213506048}, "peak_prefill_memory": null, "peak_decode_memory": 3914067032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NG-69D-5055", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "2ad4f1f569357ac4cbdf0624ef9ad5e94d4a7d597c597837c734d5d4da55d0dd"} | ||||
| 274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4d62874168a24c89dc7b392c", "attempt_id": "b043b200c821", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:03.687916Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5916, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.3550840420648, "ttft_ms": 7.522459025494754, "decode_ms": 74.00725001934916}, "total_wall_ms": 1204.9214170547202, "ttft_ms": 7.522459025494754, "input_usage": {"receiver_prompt_tokens": 5916}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4213538816, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3915672664, "mlx_cache_bytes": 2385637720, "process_rss_bytes": 4213538816}, "peak_prefill_memory": null, "peak_decode_memory": 3915672664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 522-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "bab34bfe3c780af26190bc690aa1235e5d8596035bf66adefe62c44be419999b"} | ||||
| 275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "330f0bbdc2f118b693e95f7f", "attempt_id": "7fee47324a90", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:04.917741Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5917, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.1417919639498, "ttft_ms": 7.440791931003332, "decode_ms": 51.76716600544751}, "total_wall_ms": 1182.6183330267668, "ttft_ms": 7.440791931003332, "input_usage": {"receiver_prompt_tokens": 5917}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4213571584, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3915852888, "mlx_cache_bytes": 2777084248, "process_rss_bytes": 4213571584}, "peak_prefill_memory": null, "peak_decode_memory": 3915852888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "72.8403", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "9c7810614625f087aa28b487b53ff1c76d7a668afccc251c31a3aeebfa1ac802"} | ||||
| 276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3802e48e4540aa10bc4414d6", "attempt_id": "8519b044a377", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:06.125493Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5912, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1113.2693749386817, "ttft_ms": 7.609209045767784, "decode_ms": 36.9326249929145}, "total_wall_ms": 1169.0282500348985, "ttft_ms": 7.609209045767784, "input_usage": {"receiver_prompt_tokens": 5912}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4213604352, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3914247256, "mlx_cache_bytes": 3167547736, "process_rss_bytes": 4213604352}, "peak_prefill_memory": null, "peak_decode_memory": 3914247256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "d571c5979d0c6949fe2b8cbecc57e257dfbf0fd05ee3bc50798587534bf9751c"} | ||||
| 277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "13fd4d8e332494bca236f022", "attempt_id": "b3af25a13d80", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:07.319259Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5918, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.9481249479577, "ttft_ms": 7.546334061771631, "decode_ms": 65.44120900798589}, "total_wall_ms": 1195.8716660737991, "ttft_ms": 7.546334061771631, "input_usage": {"receiver_prompt_tokens": 5918}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4213637120, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3916033112, "mlx_cache_bytes": 3559190872, "process_rss_bytes": 4213637120}, "peak_prefill_memory": null, "peak_decode_memory": 3916033112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,236,625", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "5f724075674359492cf09f6cc38fa29d1d8d57b1cbe36c12f18a44145249093b"} | ||||
| 278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ac61dbca12a92bd9d8af8c92", "attempt_id": "2c0cb5596fc3", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:08.539835Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5921, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.2962080407888, "ttft_ms": 7.490165997296572, "decode_ms": 73.54729098733515}, "total_wall_ms": 1204.3480419088155, "ttft_ms": 7.490165997296572, "input_usage": {"receiver_prompt_tokens": 5921}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4213669888, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3916573784, "mlx_cache_bytes": 3951423832, "process_rss_bytes": 4213669888}, "peak_prefill_memory": null, "peak_decode_memory": 3916573784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5bd4e0b0636e8fe9da87221d", "attempt_id": "5d3a65b9a8df", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:09.769814Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5912, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.9522920344025, "ttft_ms": 7.491624914109707, "decode_ms": 14.61674994789064}, "total_wall_ms": 1145.4074169741943, "ttft_ms": 7.491624914109707, "input_usage": {"receiver_prompt_tokens": 5912}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4213702656, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3914247256, "mlx_cache_bytes": 3951423832, "process_rss_bytes": 4213702656}, "peak_prefill_memory": null, "peak_decode_memory": 3914247256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "59dd927bc1baec76de18ecff", "attempt_id": "061bba9d7f95", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:10.940155Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 5911, "message_tokens": 5836, "message_utf8_bytes": 29705, "cache_tensor_bytes": null, "serialized_payload_bytes": 29705, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01837499439716339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1111.6637910017744, "ttft_ms": 7.46087497100234, "decode_ms": 14.723917003720999}, "total_wall_ms": 1145.3422920312732, "ttft_ms": 7.46087497100234, "input_usage": {"receiver_prompt_tokens": 5911}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4213735424, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3914067032, "mlx_cache_bytes": 3951423832, "process_rss_bytes": 4213735424}, "peak_prefill_memory": null, "peak_decode_memory": 3914067032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "985563b1d86cdf3b2739a499", "attempt_id": "248502bd8180", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:13.270498Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 3.646500059403479, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.26125002466142, "ttft_ms": 53.26125002466142, "decode_ms": 83.80712498910725}, "total_wall_ms": 147.14970800559968, "ttft_ms": 53.26125002466142, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4551098368, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3721620720, "mlx_cache_bytes": 5059032969, "process_rss_bytes": 4551098368}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3721620720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NG-69D-5055", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "2ad4f1f569357ac4cbdf0624ef9ad5e94d4a7d597c597837c734d5d4da55d0dd"} | ||||
| 282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0ea7e1daa59500ca6b69534b", "attempt_id": "a7c0e922e525", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:13.445267Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 41, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 1.574167050421238, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.52608302887529, "ttft_ms": 51.52608302887529, "decode_ms": 82.38741697277874}, "total_wall_ms": 141.48666698019952, "ttft_ms": 51.52608302887529, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 41}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4551098368, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3730173180, "mlx_cache_bytes": 5209569489, "process_rss_bytes": 4551098368}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3730173180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 522-C, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "bab34bfe3c780af26190bc690aa1235e5d8596035bf66adefe62c44be419999b"} | ||||
| 283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8c4d02c4c919bddadf3cecec", "attempt_id": "5838c589172b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:13.613571Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 42, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 1.6422910848632455, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.0564999897033, "ttft_ms": 52.0564999897033, "decode_ms": 57.65445902943611}, "total_wall_ms": 116.61816702689976, "ttft_ms": 52.0564999897033, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 42}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4551098368, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3731631360, "mlx_cache_bytes": 5273680417, "process_rss_bytes": 4551098368}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3731631360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "72.8403", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "9c7810614625f087aa28b487b53ff1c76d7a668afccc251c31a3aeebfa1ac802"} | ||||
| 284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "612ce020fdf88d2442420f44", "attempt_id": "fda051fb0224", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:13.756241Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 1.5529999509453773, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.7755419453606, "ttft_ms": 48.7755419453606, "decode_ms": 41.18654108606279}, "total_wall_ms": 97.15329203754663, "ttft_ms": 48.7755419453606, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4551098368, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3723242756, "mlx_cache_bytes": 5336645498, "process_rss_bytes": 4551098368}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3723242756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ingrid Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "d571c5979d0c6949fe2b8cbecc57e257dfbf0fd05ee3bc50798587534bf9751c"} | ||||
| 285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b10612bbeeed8d43107f3311", "attempt_id": "1f31c005b841", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:13.879253Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 43, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 1.5828750329092145, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.56237503979355, "ttft_ms": 51.56237503979355, "decode_ms": 73.99308297317475}, "total_wall_ms": 132.35154107678682, "ttft_ms": 51.56237503979355, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 43}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4551098368, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3734924548, "mlx_cache_bytes": 5420826834, "process_rss_bytes": 4551098368}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3734924548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,236,625", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "5f724075674359492cf09f6cc38fa29d1d8d57b1cbe36c12f18a44145249093b"} | ||||
| 286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0a5b3921bba1a7f6abf0ee3b", "attempt_id": "355172ff1330", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:14.036264Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 46, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 1.5633750008419156, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.60283299442381, "ttft_ms": 49.60283299442381, "decode_ms": 82.83133304212242}, "total_wall_ms": 139.69950005412102, "ttft_ms": 49.60283299442381, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4551098368, "backend_memory": {"mlx_active_bytes": 3595725832, "mlx_peak_bytes": 3740429584, "mlx_cache_bytes": 5493703234, "process_rss_bytes": 4551098368}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3740429584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CN-53T-4564", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "63b72c2f0fa9c87c99863654eaed185c2db37aca56aeb2c04043723bedec7f95"} | ||||
| 287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b1446de1a89b35993284de6a", "attempt_id": "0939a5728758", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:14.201138Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 37, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 1.5447080368176103, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.73679101001471, "ttft_ms": 48.73679101001471, "decode_ms": 16.54620806220919}, "total_wall_ms": 72.29020807426423, "ttft_ms": 48.73679101001471, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4551114752, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3723242756, "mlx_cache_bytes": 5494620738, "process_rss_bytes": 4551114752}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3723242756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6b88895966a267edd3e49d90", "attempt_id": "af5d006d1e3d", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:14.298815Z", "task_family": "synthetic", "document_id": "syn_03025_8000", "document_hash": "b2f6e5bf2101aa9e99d6aac4075349a1894a41e5e6b272f95bd8ed9f56300ad9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03025_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3425070088}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5836, "source_tokens_receiver": 5836, "query_tokens": 36, "message_tokens": 5875, "message_utf8_bytes": 29705, "cache_tensor_bytes": 168448000, "serialized_payload_bytes": 168460742, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1157.7910840278491, "doc_prefill_ms": 1103.077832958661, "compress_ms": 3.669625031761825, "serialize_ms": 39.24895799718797, "load_ms": 1.5681659569963813, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.201250028796494, "ttft_ms": 48.201250028796494, "decode_ms": 16.124207992106676}, "total_wall_ms": 71.42208295408636, "ttft_ms": 48.201250028796494, "input_usage": {"receiver_prefix_tokens": 5875, "dense_cache_bytes": 168448000, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4551131136, "backend_memory": {"mlx_active_bytes": 3594808328, "mlx_peak_bytes": 3721620720, "mlx_cache_bytes": 5494620738, "process_rss_bytes": 4551131136}, "peak_prefill_memory": 3893455960, "peak_decode_memory": 3721620720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03025_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7da5a29c74f4c267caf5f80b4798fe615f57947ce5cef06f76cd1114474bc918", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "07cfb5be9089d7451f18d363", "attempt_id": "c552bdcadaea", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:14.417122Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2029, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 343.22970802895725, "ttft_ms": 7.650666986592114, "decode_ms": 79.02441604528576}, "total_wall_ms": 433.4156250115484, "ttft_ms": 7.650666986592114, "input_usage": {"receiver_prompt_tokens": 2029}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4490280960, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3833269244, "mlx_cache_bytes": 1127456008, "process_rss_bytes": 4490280960}, "peak_prefill_memory": null, "peak_decode_memory": 3833269244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RQ-10W-4229", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "83e9983dc82dee9d853925393e38c21ef13d0e07a7356398b84c1047f4e54bc9"} | ||||
| 290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fba74dfe25ab6e2a6fb2b725", "attempt_id": "7547c7e069e2", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:14.868621Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2036, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 343.54654198978096, "ttft_ms": 7.312041008844972, "decode_ms": 85.44479205738753}, "total_wall_ms": 439.8635419784114, "ttft_ms": 7.312041008844972, "input_usage": {"receiver_prompt_tokens": 2036}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4490297344, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3835268120, "mlx_cache_bytes": 1834237140, "process_rss_bytes": 4490297344}, "peak_prefill_memory": null, "peak_decode_memory": 3835268120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3fbba8dd66b36a41a7a3c4ca", "attempt_id": "202c3b53e83b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:15.325671Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2035, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.54999994300306, "ttft_ms": 7.356042042374611, "decode_ms": 49.544625100679696}, "total_wall_ms": 402.9312500497326, "ttft_ms": 7.356042042374611, "input_usage": {"receiver_prompt_tokens": 2035}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4490297344, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3835268120, "mlx_cache_bytes": 1834237140, "process_rss_bytes": 4490297344}, "peak_prefill_memory": null, "peak_decode_memory": 3835268120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "51b9e4b18a2600588247f5c0", "attempt_id": "0b8dbe805f1a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:15.746070Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2030, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.99266699235886, "ttft_ms": 7.248374982737005, "decode_ms": 64.44037496112287}, "total_wall_ms": 418.4106671018526, "ttft_ms": 7.248374982737005, "input_usage": {"receiver_prompt_tokens": 2030}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4490297344, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3833465880, "mlx_cache_bytes": 2270706900, "process_rss_bytes": 4490297344}, "peak_prefill_memory": null, "peak_decode_memory": 3833465880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bdd070c291ae13ca856ee7bf", "attempt_id": "3945362f797e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:16.182914Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2041, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 343.34054205100983, "ttft_ms": 7.396416971459985, "decode_ms": 50.746125052683055}, "total_wall_ms": 405.16870899591595, "ttft_ms": 7.396416971459985, "input_usage": {"receiver_prompt_tokens": 2041}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4490313728, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3837070380, "mlx_cache_bytes": 2979372212, "process_rss_bytes": 4490313728}, "peak_prefill_memory": null, "peak_decode_memory": 3837070380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1a41508e8e0ada5b2d9fbabd", "attempt_id": "03b977b88121", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:16.606774Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2038, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.94904093258083, "ttft_ms": 7.307541905902326, "decode_ms": 70.88924990966916}, "total_wall_ms": 424.40074996557087, "ttft_ms": 7.307541905902326, "input_usage": {"receiver_prompt_tokens": 2038}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4490313728, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3835661356, "mlx_cache_bytes": 3417414836, "process_rss_bytes": 4490313728}, "peak_prefill_memory": null, "peak_decode_memory": 3835661356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72P-3503", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "051acaf42a5b0e2760fcb6fb7252c81cae4688e78f4f2cfa24c17e2daf75b9e3"} | ||||
| 295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5cc32a9f700be00965d35fc0", "attempt_id": "6ec276649b68", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:17.048535Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2030, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.3517500050366, "ttft_ms": 7.238500053063035, "decode_ms": 14.436042052693665}, "total_wall_ms": 367.36487492453307, "ttft_ms": 7.238500053063035, "input_usage": {"receiver_prompt_tokens": 2030}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4490313728, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3833465880, "mlx_cache_bytes": 3417414836, "process_rss_bytes": 4490313728}, "peak_prefill_memory": null, "peak_decode_memory": 3833465880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "057d809018ef5ad13759e31e", "attempt_id": "6ab949587b1f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:17.432969Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 2031, "message_tokens": 1955, "message_utf8_bytes": 7247, "cache_tensor_bytes": null, "serialized_payload_bytes": 7247, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.8002919536084, "ttft_ms": 7.222458953037858, "decode_ms": 14.443000080063939}, "total_wall_ms": 367.80854093376547, "ttft_ms": 7.222458953037858, "input_usage": {"receiver_prompt_tokens": 2031}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4490313728, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3833662488, "mlx_cache_bytes": 3854081204, "process_rss_bytes": 4490313728}, "peak_prefill_memory": null, "peak_decode_memory": 3833662488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "999c28e135b4fc6a1a7cd17a", "attempt_id": "13bac7a499b6", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.176559Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 35, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.502583036199212, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.61158305313438, "ttft_ms": 28.61158305313438, "decode_ms": 81.94270904641598}, "total_wall_ms": 114.0144580276683, "ttft_ms": 28.61158305313438, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 35}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3366300916, "mlx_cache_bytes": 4639777430, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3366300916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RQ-10W-4229", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "83e9983dc82dee9d853925393e38c21ef13d0e07a7356398b84c1047f4e54bc9"} | ||||
| 298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6b4a1a679d8bdd268f9d9149", "attempt_id": "87bc5874ae9d", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.308379Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 42, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.2865000171586871, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.234041973017156, "ttft_ms": 30.234041973017156, "decode_ms": 89.32254207320511}, "total_wall_ms": 122.5937920389697, "ttft_ms": 30.234041973017156, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 42}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3380473104, "mlx_cache_bytes": 4738917350, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3380473104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 247-S, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "77b7da1d43e7d8815e9e9159ebbd735045bc7f668260ba30b93674f70622b8ec"} | ||||
| 299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a94bec70ddeeb39e23e91b4e", "attempt_id": "0aafd4690b2b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.448304Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 41, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.3505000388249755, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.09691701643169, "ttft_ms": 29.09691701643169, "decode_ms": 52.15162492822856}, "total_wall_ms": 84.2859169933945, "ttft_ms": 29.09691701643169, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3379539216, "mlx_cache_bytes": 4779598822, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3379539216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15.0054", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "d13adba73068c847c850237059e0202fc5b91ccacf2e792e9ce5e3b90556501a"} | ||||
| 300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3bdca7a6644246e564686e75", "attempt_id": "0db9147d3009", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.549543Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.302374992519617, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.634500107727945, "ttft_ms": 28.634500107727945, "decode_ms": 67.34470801893622}, "total_wall_ms": 99.10504205618054, "ttft_ms": 28.634500107727945, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3367660816, "mlx_cache_bytes": 4833667318, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3367660816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Priyamvada Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "c5f554196ed23dd71ad995ec89f7142099d524dbb6534cc10d94a0c89d13e792"} | ||||
| 301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "82a99faab3d43c846db81c8e", "attempt_id": "7884d24cdb93", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.665455Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 47, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.2634999584406614, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.374249909073114, "ttft_ms": 30.374249909073114, "decode_ms": 52.39179194904864}, "total_wall_ms": 85.73245804291219, "ttft_ms": 30.374249909073114, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3383930144, "mlx_cache_bytes": 4934756974, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3383930144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "535,300", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "310282bc8b1d285db5e2b900f31e17e95e68f26b55e4eb87ed8d54f74105024b"} | ||||
| 302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "56a0ac8251289341c0d93e7a", "attempt_id": "34b60cdbd286", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.768449Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 44, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.3520000502467155, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.28466599062085, "ttft_ms": 30.28466599062085, "decode_ms": 74.96183400508016}, "total_wall_ms": 108.30683296080679, "ttft_ms": 30.28466599062085, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3378081052, "mlx_cache_bytes": 5021362798, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3378081052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DB-72P-3503", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "051acaf42a5b0e2760fcb6fb7252c81cae4688e78f4f2cfa24c17e2daf75b9e3"} | ||||
| 303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bf64372c53fcb27c658233ac", "attempt_id": "d81c5e0de1fc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.893792Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 36, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.335292006842792, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.284666943363845, "ttft_ms": 28.284666943363845, "decode_ms": 14.89666709676385}, "total_wall_ms": 46.2894169613719, "ttft_ms": 28.284666943363845, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3367660816, "mlx_cache_bytes": 5021362798, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3367660816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1599cd789cc9f54fa2f7470b", "attempt_id": "64cd148626b1", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:18.957293Z", "task_family": "synthetic", "document_id": "syn_03027_2000", "document_hash": "10326080979f71b625e4110c7c19767e5a752e267de5034f7e37d98cb6e06249", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03027_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1955, "source_tokens_receiver": 1955, "query_tokens": 37, "message_tokens": 1994, "message_utf8_bytes": 7247, "cache_tensor_bytes": 57171968, "serialized_payload_bytes": 57184653, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.66395896300673, "doc_prefill_ms": 339.97025003191084, "compress_ms": 1.5028330963104963, "serialize_ms": 13.760500005446374, "load_ms": 1.3945410028100014, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.57162500731647, "ttft_ms": 28.57162500731647, "decode_ms": 14.944290975108743}, "total_wall_ms": 46.59829195588827, "ttft_ms": 28.57162500731647, "input_usage": {"receiver_prefix_tokens": 1994, "dense_cache_bytes": 57171968, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4547346432, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3369823504, "mlx_cache_bytes": 5097369543, "process_rss_bytes": 4547346432}, "peak_prefill_memory": 3821439996, "peak_decode_memory": 3369823504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03027_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "92778a71203a822a4c1e5ec24128e5fb956c9611c5c5a18caae98ff1762086a4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b676ef0714799f44bb37b347", "attempt_id": "2a98d8e610b1", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:19.038386Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5878, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1104.2265000287443, "ttft_ms": 7.839082973077893, "decode_ms": 73.88416700996459}, "total_wall_ms": 1197.1465420210734, "ttft_ms": 7.839082973077893, "input_usage": {"receiver_prompt_tokens": 5878}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4359946240, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3893521496, "mlx_cache_bytes": 1657221464, "process_rss_bytes": 4359946240}, "peak_prefill_memory": null, "peak_decode_memory": 3893521496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LN-61Q-3728", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "ef901814745008edf2ec5687bf33a1367f91f4a50b08b07aa3f7be18d335de51"} | ||||
| 306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ea7a493edfa162dd97b04c85", "attempt_id": "c46f73b596c5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:20.259644Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5883, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.5318330395967, "ttft_ms": 7.524583023041487, "decode_ms": 82.20766694284976}, "total_wall_ms": 1204.1848750086501, "ttft_ms": 7.524583023041487, "input_usage": {"receiver_prompt_tokens": 5883}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4359979008, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3895307352, "mlx_cache_bytes": 2456711512, "process_rss_bytes": 4359979008}, "peak_prefill_memory": null, "peak_decode_memory": 3895307352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 502-G, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "f875bf760b38e9eee1302688e35c851f74a65d75da0ff569bbff799692ee9d04"} | ||||
| 307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9a06983f22ba282610c331e1", "attempt_id": "bca37e83903b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:21.488271Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5882, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.9902500556782, "ttft_ms": 7.353916997089982, "decode_ms": 51.37374997138977}, "total_wall_ms": 1171.877457993105, "ttft_ms": 7.353916997089982, "input_usage": {"receiver_prompt_tokens": 5882}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4360011776, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3895307352, "mlx_cache_bytes": 2456711512, "process_rss_bytes": 4360011776}, "peak_prefill_memory": null, "peak_decode_memory": 3895307352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "59.8187", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "f441a18fa0cc1d7c0b4731dccaac17dcd267de0084e2027ae8c8f6c847b37ca6"} | ||||
| 308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "95caedd121691869988a9d8a", "attempt_id": "0c7c4b56798d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:22.684687Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5880, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.619458058849, "ttft_ms": 7.494041929021478, "decode_ms": 29.120124992914498}, "total_wall_ms": 1148.8627080107108, "ttft_ms": 7.494041929021478, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 4360044544, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3894766680, "mlx_cache_bytes": 2840293720, "process_rss_bytes": 4360044544}, "peak_prefill_memory": null, "peak_decode_memory": 3894766680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Petrakis", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "44f5f881779841802a8bed10a39ab27bfb1b15f14b9c8c04f1549dda7db316e8"} | ||||
| 309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "79969fbe68d6d9147c370512", "attempt_id": "1eedf21263d7", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:23.858994Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5887, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.8470419803634, "ttft_ms": 7.523832959122956, "decode_ms": 51.76012497395277}, "total_wall_ms": 1172.9732919484377, "ttft_ms": 7.523832959122956, "input_usage": {"receiver_prompt_tokens": 5887}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4360077312, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896732760, "mlx_cache_bytes": 3461968216, "process_rss_bytes": 4360077312}, "peak_prefill_memory": null, "peak_decode_memory": 3896732760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "c186ae04f377e0a3f95a6b3affbd1003677f14085f9e34f17926f3b1d1a83d6a"} | ||||
| 310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "006ec217b12592430a2c9194", "attempt_id": "51efcf06f8b5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:25.057973Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5888, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.5016669407487, "ttft_ms": 7.417457993142307, "decode_ms": 73.23987502604723}, "total_wall_ms": 1193.72520793695, "ttft_ms": 7.417457993142307, "input_usage": {"receiver_prompt_tokens": 5888}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4360110080, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896912984, "mlx_cache_bytes": 3847123288, "process_rss_bytes": 4360110080}, "peak_prefill_memory": null, "peak_decode_memory": 3896912984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "04a0534dc3d9f6411c4b4542", "attempt_id": "290428afd6b0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:26.277227Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5880, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.1831249818206, "ttft_ms": 7.534042000770569, "decode_ms": 14.618915971368551}, "total_wall_ms": 1135.5526669649407, "ttft_ms": 7.534042000770569, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4360142848, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3894766680, "mlx_cache_bytes": 3847123288, "process_rss_bytes": 4360142848}, "peak_prefill_memory": null, "peak_decode_memory": 3894766680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a36ab4f0be06aca62cbabd8b", "attempt_id": "535e77c893ce", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:27.438464Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 5880, "message_tokens": 5804, "message_utf8_bytes": 29099, "cache_tensor_bytes": null, "serialized_payload_bytes": 29099, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.023540924303233624, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.7019170103595, "ttft_ms": 7.5081250397488475, "decode_ms": 14.46437498088926}, "total_wall_ms": 1134.7370420116931, "ttft_ms": 7.5081250397488475, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4360175616, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3894766680, "mlx_cache_bytes": 3847123288, "process_rss_bytes": 4360175616}, "peak_prefill_memory": null, "peak_decode_memory": 3894766680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c03a5a7d71ae22a3ae227e48", "attempt_id": "a12177bab387", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:29.753170Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 35, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 3.528167027980089, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.13212505541742, "ttft_ms": 48.13212505541742, "decode_ms": 82.90383301209658}, "total_wall_ms": 139.8870829725638, "ttft_ms": 48.13212505541742, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 35}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3719720172, "mlx_cache_bytes": 4589614906, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3719720172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LN-61Q-3728", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "ef901814745008edf2ec5687bf33a1367f91f4a50b08b07aa3f7be18d335de51"} | ||||
| 314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b21d6b960ae0654b8371702e", "attempt_id": "c63934254387", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:29.918630Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 40, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 1.5534579288214445, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.17745902296156, "ttft_ms": 50.17745902296156, "decode_ms": 90.33379098400474}, "total_wall_ms": 147.5295420968905, "ttft_ms": 50.17745902296156, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 40}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3726224632, "mlx_cache_bytes": 4903516282, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3726224632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 502-G, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "f875bf760b38e9eee1302688e35c851f74a65d75da0ff569bbff799692ee9d04"} | ||||
| 315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a8e73b63fd194f65e290927f", "attempt_id": "287cf7823222", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:30.091580Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 39, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 0.9289160370826721, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.96316700614989, "ttft_ms": 48.96316700614989, "decode_ms": 56.96349998470396}, "total_wall_ms": 111.98666703421623, "ttft_ms": 48.96316700614989, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 39}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3725585664, "mlx_cache_bytes": 4936466027, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3725585664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "59.8187", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "f441a18fa0cc1d7c0b4731dccaac17dcd267de0084e2027ae8c8f6c847b37ca6"} | ||||
| 316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a07983a974b214d6ea256687", "attempt_id": "0c7c08807e2c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:30.228206Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 1.5719580696895719, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.68775000795722, "ttft_ms": 48.68775000795722, "decode_ms": 32.72441599983722}, "total_wall_ms": 88.46154191996902, "ttft_ms": 48.68775000795722, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3723472128, "mlx_cache_bytes": 4993515115, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3723472128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Haruki Petrakis", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "44f5f881779841802a8bed10a39ab27bfb1b15f14b9c8c04f1549dda7db316e8"} | ||||
| 317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9db018b8b655dfff1221273d", "attempt_id": "11195743335f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:30.341871Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 44, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 0.9202919900417328, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.40312500204891, "ttft_ms": 50.40312500204891, "decode_ms": 57.35637492034584}, "total_wall_ms": 113.785499939695, "ttft_ms": 50.40312500204891, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3733892360, "mlx_cache_bytes": 5079433163, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3733892360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "549,950", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "c186ae04f377e0a3f95a6b3affbd1003677f14085f9e34f17926f3b1d1a83d6a"} | ||||
| 318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "dd12eae038c8986698d46377", "attempt_id": "e364f83b1788", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:30.480563Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 45, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 1.555333030410111, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.6444580340758, "ttft_ms": 45.6444580340758, "decode_ms": 81.45912503823638}, "total_wall_ms": 134.25633299630135, "ttft_ms": 45.6444580340758, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3735891212, "mlx_cache_bytes": 5150736691, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3735891212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PB-38S-9552", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "2ead15278e346194e16500a37d0e52a9739df0cf36c158fed043974d95161e89"} | ||||
| 319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "248cca02880e31ce820cb3e9", "attempt_id": "7e8e4b661aa4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:30.640045Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 1.5762089751660824, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.32845903001726, "ttft_ms": 48.32845903001726, "decode_ms": 16.429750015959144}, "total_wall_ms": 71.46304089110345, "ttft_ms": 48.32845903001726, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3723472128, "mlx_cache_bytes": 5151654195, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3723472128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8b3d0dbc1b24e33a2fff0a3f", "attempt_id": "65a02498f1dc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:30.736172Z", "task_family": "synthetic", "document_id": "syn_03028_8000", "document_hash": "50541e370b2e371a17d9b2b638b294d78ed4610a8f11e47378d787390ed118aa", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03028_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5804, "source_tokens_receiver": 5804, "query_tokens": 37, "message_tokens": 5843, "message_utf8_bytes": 29099, "cache_tensor_bytes": 167530496, "serialized_payload_bytes": 167543238, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1153.698084061034, "doc_prefill_ms": 1101.1606249958277, "compress_ms": 3.655457985587418, "serialize_ms": 37.491583032533526, "load_ms": 1.560916076414287, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.26725006569177, "ttft_ms": 48.26725006569177, "decode_ms": 16.440709005109966}, "total_wall_ms": 71.47608301602304, "ttft_ms": 48.26725006569177, "input_usage": {"receiver_prefix_tokens": 5843, "dense_cache_bytes": 167530496, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4527472640, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3723472128, "mlx_cache_bytes": 5151654195, "process_rss_bytes": 4527472640}, "peak_prefill_memory": 3882626136, "peak_decode_memory": 3723472128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03028_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "00e6822a4591b554311f8c52100323f16d7f51418050e355587478f1f8e3496a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "25b576260a44e8316af6bf06", "attempt_id": "a295a00ebced", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:30.851164Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2024, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 343.4392500203103, "ttft_ms": 7.594667025841773, "decode_ms": 70.77416707761586}, "total_wall_ms": 425.42704101651907, "ttft_ms": 7.594667025841773, "input_usage": {"receiver_prompt_tokens": 2024}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4487954432, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3831466984, "mlx_cache_bytes": 1124654324, "process_rss_bytes": 4487954432}, "peak_prefill_memory": null, "peak_decode_memory": 3831466984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SA-99X-5582", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "418e2d2419844e55a0e0d5a5f62c9bf90dbe137bd83c679e009533943498d1a0"} | ||||
| 322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "673ef0ced27e55267e3198c1", "attempt_id": "c48c4c49abd5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:31.293856Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2029, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 343.2638329686597, "ttft_ms": 7.373833912424743, "decode_ms": 78.84741597808897}, "total_wall_ms": 433.15216701012105, "ttft_ms": 7.373833912424743, "input_usage": {"receiver_prompt_tokens": 2029}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4487970816, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3833269244, "mlx_cache_bytes": 1829354660, "process_rss_bytes": 4487970816}, "peak_prefill_memory": null, "peak_decode_memory": 3833269244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 503-T, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "e7daab1d3d52ee9bc0b550370d3581323f3b8751988b7c63e74cabfbbb3320eb"} | ||||
| 323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "261024590b2df81ec01b2980", "attempt_id": "3a5a3a029ef9", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:31.745267Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2027, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.55200007464737, "ttft_ms": 7.315542083233595, "decode_ms": 42.47183306142688}, "total_wall_ms": 395.84574999753386, "ttft_ms": 7.315542083233595, "input_usage": {"receiver_prompt_tokens": 2027}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4487970816, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3832056828, "mlx_cache_bytes": 2265037988, "process_rss_bytes": 4487970816}, "peak_prefill_memory": null, "peak_decode_memory": 3832056828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4.8545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "beffe6995df261b8edc94ba7a8714c75e4da1e041c720374d646d8785fe5641e"} | ||||
| 324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "38647c872831b3406d5a8ee7", "attempt_id": "3de8033e72ba", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:32.158888Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2024, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 341.9372499920428, "ttft_ms": 7.3357089422643185, "decode_ms": 42.943624895997345}, "total_wall_ms": 395.90083400253206, "ttft_ms": 7.3357089422643185, "input_usage": {"receiver_prompt_tokens": 2024}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4487970816, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3831466984, "mlx_cache_bytes": 2265037988, "process_rss_bytes": 4487970816}, "peak_prefill_memory": null, "peak_decode_memory": 3831466984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "5ca17fb7c0572a4d8bdf0553d246da8b09a69151cf9bbab90a1d2f650e36cdea"} | ||||
| 325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c60e9f21942adbac5304a400", "attempt_id": "df4dad12aaf3", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:32.573091Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2032, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.13791601359844, "ttft_ms": 7.373750093393028, "decode_ms": 50.136208068579435}, "total_wall_ms": 403.3109999727458, "ttft_ms": 7.373750093393028, "input_usage": {"receiver_prompt_tokens": 2032}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4487987200, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3833859080, "mlx_cache_bytes": 2701909088, "process_rss_bytes": 4487987200}, "peak_prefill_memory": null, "peak_decode_memory": 3833859080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "728,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "82227082dcc4ba6a2aefa1ee337cd55859ad3bd42a50654a896be5f8dd31734d"} | ||||
| 326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "52e9d9e85923194fa1cf898f", "attempt_id": "c7a1d5e96aac", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:32.993985Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2035, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 343.93233398441225, "ttft_ms": 7.299332995899022, "decode_ms": 71.6306670801714}, "total_wall_ms": 426.3833340955898, "ttft_ms": 7.299332995899022, "input_usage": {"receiver_prompt_tokens": 2035}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4487987200, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3835071508, "mlx_cache_bytes": 3408493608, "process_rss_bytes": 4487987200}, "peak_prefill_memory": null, "peak_decode_memory": 3835071508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PX-35X-6550", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "bd14582c6a2e29f22b9971b6065c122ee9f5470375dc27a8616f788a0eae5587"} | ||||
| 327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7dd5bba96548686fe397342e", "attempt_id": "ea97d63abf22", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:33.437827Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2026, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.5782920094207, "ttft_ms": 7.247583009302616, "decode_ms": 7.1899580070748925}, "total_wall_ms": 360.49166694283485, "ttft_ms": 7.247583009302616, "input_usage": {"receiver_prompt_tokens": 2026}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 4487987200, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3832056828, "mlx_cache_bytes": 3408493608, "process_rss_bytes": 4487987200}, "peak_prefill_memory": null, "peak_decode_memory": 3832056828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a15ba256491fbf3f389906e0", "attempt_id": "3799e2a0a19e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:33.815280Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 2023, "message_tokens": 1949, "message_utf8_bytes": 7274, "cache_tensor_bytes": null, "serialized_payload_bytes": 7274, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008665956556797028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 342.8973340196535, "ttft_ms": 7.225041044875979, "decode_ms": 14.303916948847473}, "total_wall_ms": 367.63200000859797, "ttft_ms": 7.225041044875979, "input_usage": {"receiver_prompt_tokens": 2023}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4487987200, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3831466984, "mlx_cache_bytes": 3408493608, "process_rss_bytes": 4487987200}, "peak_prefill_memory": null, "peak_decode_memory": 3831466984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b5263f10cd28f19b3ce98d98", "attempt_id": "8ea95aa940d2", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:34.557976Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.5052080852910876, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.73024996370077, "ttft_ms": 28.73024996370077, "decode_ms": 74.38404206186533}, "total_wall_ms": 106.62879107985646, "ttft_ms": 28.73024996370077, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3367660792, "mlx_cache_bytes": 4193747545, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3367660792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SA-99X-5582", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "418e2d2419844e55a0e0d5a5f62c9bf90dbe137bd83c679e009533943498d1a0"} | ||||
| 330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2d4d34ad3755f438c7cfe396", "attempt_id": "cf1488c5b2a5", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:34.682721Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 41, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.3289579655975103, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.177417094819248, "ttft_ms": 30.177417094819248, "decode_ms": 81.54083299450576}, "total_wall_ms": 114.9486250942573, "ttft_ms": 30.177417094819248, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 41}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3378720012, "mlx_cache_bytes": 4291003297, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3378720012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 503-T, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "e7daab1d3d52ee9bc0b550370d3581323f3b8751988b7c63e74cabfbbb3320eb"} | ||||
| 331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2cf68d68c02d15dbb7880f88", "attempt_id": "9de106aa91d8", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:34.815043Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 39, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.336375018581748, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.001666931435466, "ttft_ms": 29.001666931435466, "decode_ms": 44.34820800088346}, "total_wall_ms": 76.4297089772299, "ttft_ms": 29.001666931435466, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 39}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3375951116, "mlx_cache_bytes": 4349430162, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3375951116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4.8545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "beffe6995df261b8edc94ba7a8714c75e4da1e041c720374d646d8785fe5641e"} | ||||
| 332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "23bf3ce62d6ba8729622452f", "attempt_id": "c415488aa261", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:34.908628Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 36, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.3482499634847045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.34674995392561, "ttft_ms": 28.34674995392561, "decode_ms": 44.5610840106383}, "total_wall_ms": 75.92191593721509, "ttft_ms": 28.34674995392561, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 36}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3367660792, "mlx_cache_bytes": 4349430162, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3367660792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lorcan Bergström", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "5ca17fb7c0572a4d8bdf0553d246da8b09a69151cf9bbab90a1d2f650e36cdea"} | ||||
| 333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7df14f6bb02c5208ac2dc814", "attempt_id": "b96ea3538f42", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:35.001300Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 44, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.3515000464394689, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.926708037033677, "ttft_ms": 28.926708037033677, "decode_ms": 51.854541059583426}, "total_wall_ms": 83.82608403917402, "ttft_ms": 28.926708037033677, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3378081040, "mlx_cache_bytes": 4449602290, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3378081040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "728,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "82227082dcc4ba6a2aefa1ee337cd55859ad3bd42a50654a896be5f8dd31734d"} | ||||
| 334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6359d146b4dfc3a23528a512", "attempt_id": "d8eadd07a0c4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:35.102148Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 47, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.3475839514285326, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.44495901465416, "ttft_ms": 29.44495901465416, "decode_ms": 74.80158400721848}, "total_wall_ms": 107.35645797103643, "ttft_ms": 29.44495901465416, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3383930144, "mlx_cache_bytes": 4537125994, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3383930144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PX-35X-6550", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "bd14582c6a2e29f22b9971b6065c122ee9f5470375dc27a8616f788a0eae5587"} | ||||
| 335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "631395ef8ca64092760da95b", "attempt_id": "d3d19a39e52a", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:35.226760Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 38, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.3022919883951545, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.771165991201997, "ttft_ms": 28.771165991201997, "decode_ms": 7.583832950331271}, "total_wall_ms": 39.569790940731764, "ttft_ms": 28.771165991201997, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3373427980, "mlx_cache_bytes": 4595747946, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3373427980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b59a9406fe3d69be125c5879", "attempt_id": "52f1ee496739", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:35.284845Z", "task_family": "synthetic", "document_id": "syn_03030_2000", "document_hash": "9c6bfb3375c1aa9b40fde8fc1869057807819db862004b3e34d74015983cf573", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03030_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3204246536}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1949, "source_tokens_receiver": 1949, "query_tokens": 35, "message_tokens": 1988, "message_utf8_bytes": 7274, "cache_tensor_bytes": 56999936, "serialized_payload_bytes": 57012621, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.2028750097379, "doc_prefill_ms": 339.75545794237405, "compress_ms": 1.5547920484095812, "serialize_ms": 13.436791952699423, "load_ms": 1.2837499380111694, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.24925002641976, "ttft_ms": 28.24925002641976, "decode_ms": 7.486999966204166}, "total_wall_ms": 38.707499974407256, "ttft_ms": 28.24925002641976, "input_usage": {"receiver_prefix_tokens": 1988, "dense_cache_bytes": 56999936, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 4545609728, "backend_memory": {"mlx_active_bytes": 3262966792, "mlx_peak_bytes": 3366726904, "mlx_cache_bytes": 4630482026, "process_rss_bytes": 4545609728}, "peak_prefill_memory": 3819637736, "peak_decode_memory": 3366726904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03030_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "46a724000c99df9d6d479629ad07e4608f6fa969e521d5d95f2030efb85a446c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "63883e3a4ea0d56f9c00c0d0", "attempt_id": "52a2f7bd2ec6", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:35.358563Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5880, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.793125086464, "ttft_ms": 7.756166975013912, "decode_ms": 82.2859579930082}, "total_wall_ms": 1203.9340001065284, "ttft_ms": 7.756166975013912, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4359127040, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3894766680, "mlx_cache_bytes": 1837822296, "process_rss_bytes": 4359127040}, "peak_prefill_memory": null, "peak_decode_memory": 3894766680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GJ-48Y-4804", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "288a654d3c294039b9f1fd8097a6383af1f152bbc0fa1c8267f80c506695c7be"} | ||||
| 338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "43c1680c3ff43410d1ce0560", "attempt_id": "a836a35d03e4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:36.587029Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5888, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1103.660958004184, "ttft_ms": 7.349041057750583, "decode_ms": 88.64945801906288}, "total_wall_ms": 1211.2075419863686, "ttft_ms": 7.349041057750583, "input_usage": {"receiver_prompt_tokens": 5888}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4359159808, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896912984, "mlx_cache_bytes": 2459693400, "process_rss_bytes": 4359159808}, "peak_prefill_memory": null, "peak_decode_memory": 3896912984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 890-P, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "5ea897ec96744c7f678e48d39a1ef3c30bd28848303a8b5073b259e5657721a2"} | ||||
| 339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0fbf47d912e3183beff81b07", "attempt_id": "7c4a7df13285", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:37.823389Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5885, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.7217500377446, "ttft_ms": 7.422249997034669, "decode_ms": 52.11566702928394}, "total_wall_ms": 1173.2922919327393, "ttft_ms": 7.422249997034669, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4359192576, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3896372312, "mlx_cache_bytes": 2844258648, "process_rss_bytes": 4359192576}, "peak_prefill_memory": null, "peak_decode_memory": 3896372312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "86.2682", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "8e0df38644a5e274cbe525e37505619d4c8ef69b2b1d3b3035cb33e63ff994fa"} | ||||
| 340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9bc19a5b2b8eefff42c33c14", "attempt_id": "ebf459dcf2cb", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:39.021259Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5881, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.913459064439, "ttft_ms": 7.286083069629967, "decode_ms": 59.19345794245601}, "total_wall_ms": 1180.5035839788616, "ttft_ms": 7.286083069629967, "input_usage": {"receiver_prompt_tokens": 5881}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4359225344, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3894946904, "mlx_cache_bytes": 3228037464, "process_rss_bytes": 4359225344}, "peak_prefill_memory": null, "peak_decode_memory": 3894946904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yevgenia Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "70acf90909a5c82e82ecfd652944ec8d08010f0d2b23315dbf5f3f51d322e547"} | ||||
| 341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2566d209df52a3f914825d73", "attempt_id": "289e90428a7c", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:40.226410Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5891, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1112.5171659514308, "ttft_ms": 7.530667004175484, "decode_ms": 65.93920907471329}, "total_wall_ms": 1197.771165985614, "ttft_ms": 7.530667004175484, "input_usage": {"receiver_prompt_tokens": 5891}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4359258112, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3907284056, "mlx_cache_bytes": 3868209496, "process_rss_bytes": 4359258112}, "peak_prefill_memory": null, "peak_decode_memory": 3907284056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,637,140", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "0e5762a61893fc1b558335178d9f2224b2b5fef9858c737456022436b29a5cf0"} | ||||
| 342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f4c80941589b1433d4658d43", "attempt_id": "7e2908d01946", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:41.451379Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5891, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1110.7773330295458, "ttft_ms": 7.622333010658622, "decode_ms": 73.46312503796071}, "total_wall_ms": 1203.0635830014944, "ttft_ms": 7.622333010658622, "input_usage": {"receiver_prompt_tokens": 5891}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4359290880, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3907284056, "mlx_cache_bytes": 3868209496, "process_rss_bytes": 4359290880}, "peak_prefill_memory": null, "peak_decode_memory": 3907284056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XL-20E-2025", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "30ca76c2925a8fac3dbf0a127f444082e02954e2fb04cd4b4d133d2a00fbb39b"} | ||||
| 343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2eb4a149ea39eca09f3885a3", "attempt_id": "c27cddf4380d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:42.679526Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5882, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1102.9417079407722, "ttft_ms": 7.6050409115850925, "decode_ms": 14.784750062972307}, "total_wall_ms": 1136.5177090046927, "ttft_ms": 7.6050409115850925, "input_usage": {"receiver_prompt_tokens": 5882}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4359323648, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3895127128, "mlx_cache_bytes": 4252184920, "process_rss_bytes": 4359323648}, "peak_prefill_memory": null, "peak_decode_memory": 3895127128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3ce78db20bd02b9807ca747e", "attempt_id": "29ff30f7bace", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:43.841389Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 5881, "message_tokens": 5806, "message_utf8_bytes": 28999, "cache_tensor_bytes": null, "serialized_payload_bytes": 28999, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.018625054508447647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1101.3330420246348, "ttft_ms": 8.696667035110295, "decode_ms": 14.792833011597395}, "total_wall_ms": 1136.7925419472158, "ttft_ms": 8.696667035110295, "input_usage": {"receiver_prompt_tokens": 5881}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4359356416, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3894946904, "mlx_cache_bytes": 4252184920, "process_rss_bytes": 4359356416}, "peak_prefill_memory": null, "peak_decode_memory": 3894946904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f8fe0b8df7f2ab94040c5e80", "attempt_id": "4dca1749b529", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:46.156985Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 35, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 3.504958003759384, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.00183293689042, "ttft_ms": 51.00183293689042, "decode_ms": 91.9415830867365}, "total_wall_ms": 152.32633298728615, "ttft_ms": 51.00183293689042, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 35}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4526424064, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3719720172, "mlx_cache_bytes": 5233604410, "process_rss_bytes": 4526424064}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3719720172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GJ-48Y-4804", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "288a654d3c294039b9f1fd8097a6383af1f152bbc0fa1c8267f80c506695c7be"} | ||||
| 346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "411cd178542a37912d7d85e7", "attempt_id": "26efefff28bd", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:46.335025Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 43, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 1.434875070117414, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.93320796266198, "ttft_ms": 45.93320796266198, "decode_ms": 98.1274169171229}, "total_wall_ms": 151.17312502115965, "ttft_ms": 45.93320796266198, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 43}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4526424064, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3732761860, "mlx_cache_bytes": 5319227538, "process_rss_bytes": 4526424064}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3732761860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 890-P, Rouyn-Noranda", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "5ea897ec96744c7f678e48d39a1ef3c30bd28848303a8b5073b259e5657721a2"} | ||||
| 347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "50dc7357ed058f1d24d40be7", "attempt_id": "ac56a0036fcc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:46.511651Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 40, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 1.5596250304952264, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.04645902570337, "ttft_ms": 49.04645902570337, "decode_ms": 57.19570897053927}, "total_wall_ms": 113.47154097165912, "ttft_ms": 49.04645902570337, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 40}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4526424064, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3729992972, "mlx_cache_bytes": 5386893458, "process_rss_bytes": 4526424064}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3729992972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "86.2682", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "8e0df38644a5e274cbe525e37505619d4c8ef69b2b1d3b3035cb33e63ff994fa"} | ||||
| 348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5ccc74f23f6725325b76d8d0", "attempt_id": "1c925720d165", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:46.649990Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 0.9155840380117297, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.023541923612356, "ttft_ms": 48.023541923612356, "decode_ms": 64.86895808484405}, "total_wall_ms": 119.53475000336766, "ttft_ms": 48.023541923612356, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 4526424064, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3720686900, "mlx_cache_bytes": 5431950754, "process_rss_bytes": 4526424064}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3720686900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yevgenia Sørlie", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "70acf90909a5c82e82ecfd652944ec8d08010f0d2b23315dbf5f3f51d322e547"} | ||||
| 349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f279c4cf289219d2c995fee0", "attempt_id": "0f76fa1e247c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:46.794133Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 1.572667038999498, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.968625048175454, "ttft_ms": 51.968625048175454, "decode_ms": 73.86033306829631}, "total_wall_ms": 133.15645896364003, "ttft_ms": 51.968625048175454, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4526424064, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3738266896, "mlx_cache_bytes": 5504827154, "process_rss_bytes": 4526424064}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3738266896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,637,140", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "0e5762a61893fc1b558335178d9f2224b2b5fef9858c737456022436b29a5cf0"} | ||||
| 350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "880bbfcee221a4b23f742ad8", "attempt_id": "099637359328", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:46.952426Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 46, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 1.5667079715058208, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.10562504362315, "ttft_ms": 52.10562504362315, "decode_ms": 82.15745899360627}, "total_wall_ms": 141.8662080541253, "ttft_ms": 52.10562504362315, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4526440448, "backend_memory": {"mlx_active_bytes": 3593890824, "mlx_peak_bytes": 3738266896, "mlx_cache_bytes": 5504827154, "process_rss_bytes": 4526440448}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3738266896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XL-20E-2025", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "30ca76c2925a8fac3dbf0a127f444082e02954e2fb04cd4b4d133d2a00fbb39b"} | ||||
| 351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a71eb9604cfb6cc9cb822503", "attempt_id": "8483ee5509bc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:47.118782Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 37, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 1.5250829746946692, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.92937496677041, "ttft_ms": 47.92937496677041, "decode_ms": 16.402125009335577}, "total_wall_ms": 71.45679194945842, "ttft_ms": 47.92937496677041, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4526440448, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3722833204, "mlx_cache_bytes": 5562565739, "process_rss_bytes": 4526440448}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3722833204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "183be4c3d5f43ac62fde0e7b", "attempt_id": "b6dc8e6cf1d6", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:47.215464Z", "task_family": "synthetic", "document_id": "syn_03031_8000", "document_hash": "1315fadec404406b9b9933336d956956092ae4420ccb739cec53c1406f0f89af", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03031_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3424152584}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5806, "source_tokens_receiver": 5806, "query_tokens": 36, "message_tokens": 5845, "message_utf8_bytes": 28999, "cache_tensor_bytes": 167587840, "serialized_payload_bytes": 167600582, "side_information_bytes": 12742, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1152.0047079538926, "doc_prefill_ms": 1100.5430000368506, "compress_ms": 3.63687495701015, "serialize_ms": 37.00891695916653, "load_ms": 1.5731670428067446, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.41537489462644, "ttft_ms": 47.41537489462644, "decode_ms": 16.389249940402806}, "total_wall_ms": 70.79779205378145, "ttft_ms": 47.41537489462644, "input_usage": {"receiver_prefix_tokens": 5845, "dense_cache_bytes": 167587840, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4526440448, "backend_memory": {"mlx_active_bytes": 3592973320, "mlx_peak_bytes": 3721145652, "mlx_cache_bytes": 5562795115, "process_rss_bytes": 4526440448}, "peak_prefill_memory": 3882986584, "peak_decode_memory": 3721145652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03031_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3bf3595a285322af41c9cd8f27f5d08e6ad55f6b70a5ea4f11bf4d32b85e3a72", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d5a84bbec49ec1d4e532be4e", "attempt_id": "e50244f0bced", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:47.334649Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2005, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.59312504157424, "ttft_ms": 7.52408301923424, "decode_ms": 78.84966698475182}, "total_wall_ms": 429.56079193390906, "ttft_ms": 7.52408301923424, "input_usage": {"receiver_prompt_tokens": 2005}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4486922240, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824602012, "mlx_cache_bytes": 1117412520, "process_rss_bytes": 4486922240}, "peak_prefill_memory": null, "peak_decode_memory": 3824602012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TQ-37Z-3885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "a9fc9678b963b7c3d6778c275b5aeffc61762adbe622c0b7221038130b0f941f"} | ||||
| 354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e0329575d451e74e0ebfab1a", "attempt_id": "e3c2d7826260", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:47.781927Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2013, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.06937500089407, "ttft_ms": 7.2249999502673745, "decode_ms": 78.41325004119426}, "total_wall_ms": 429.2712500318885, "ttft_ms": 7.2249999502673745, "input_usage": {"receiver_prompt_tokens": 2013}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4486938624, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3827616700, "mlx_cache_bytes": 1816460312, "process_rss_bytes": 4486938624}, "peak_prefill_memory": null, "peak_decode_memory": 3827616700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 395-Z, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "62705540f1dfbf31a4188d1537cb948fa38b2bfa8e9bb0cce66a6c65b63cbe21"} | ||||
| 355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b383d04645656a44b0abc404", "attempt_id": "38a829966e68", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:48.228668Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2012, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.1593339620158, "ttft_ms": 7.343208999373019, "decode_ms": 49.63804199360311}, "total_wall_ms": 399.8694579349831, "ttft_ms": 7.343208999373019, "input_usage": {"receiver_prompt_tokens": 2012}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4486938624, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3827616700, "mlx_cache_bytes": 1816460312, "process_rss_bytes": 4486938624}, "peak_prefill_memory": null, "peak_decode_memory": 3827616700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.7060", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "af701ce56cefa8d20cc3946e344bad57b3ddca67140908fc124f710fe1577614"} | ||||
| 356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "834e7e33a923efe866d39876", "attempt_id": "87771c929edb", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:48.645775Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2007, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.28583294618875, "ttft_ms": 7.456500083208084, "decode_ms": 49.746000091545284}, "total_wall_ms": 400.0495000509545, "ttft_ms": 7.456500083208084, "input_usage": {"receiver_prompt_tokens": 2007}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4486938624, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3873917896, "mlx_cache_bytes": 2309782552, "process_rss_bytes": 4486938624}, "peak_prefill_memory": null, "peak_decode_memory": 3873917896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Baptiste-Roy", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "0828367789e6648fa24fa6e3bfce339a5b9721a26940345b1dc8f263207eb1e6"} | ||||
| 357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f37a8e2259ad1ec043a060bc", "attempt_id": "8f86088d6138", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:49.062830Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2015, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.8002079920843, "ttft_ms": 7.253292016685009, "decode_ms": 64.23566595185548}, "total_wall_ms": 415.13950005173683, "ttft_ms": 7.253292016685009, "input_usage": {"receiver_prompt_tokens": 2015}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4486955008, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3828009924, "mlx_cache_bytes": 2742918032, "process_rss_bytes": 4486955008}, "peak_prefill_memory": null, "peak_decode_memory": 3828009924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,326,886", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "e3010154fffa148727cf0089dd15f522da80a70472d3718942ebc33c8f37eecd"} | ||||
| 358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7e9f93915666c907583b34dd", "attempt_id": "30a50f35cc3b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:49.496679Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2014, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.05129197612405, "ttft_ms": 7.123541086912155, "decode_ms": 70.69800002500415}, "total_wall_ms": 421.4281659806147, "ttft_ms": 7.123541086912155, "input_usage": {"receiver_prompt_tokens": 2014}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4486955008, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3828009924, "mlx_cache_bytes": 2742918032, "process_rss_bytes": 4486955008}, "peak_prefill_memory": null, "peak_decode_memory": 3828009924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TU-84M-3627", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "8ed507841daaac245c79f7204399ab8bf8859c9bb5257e6ae0f4982c89095295"} | ||||
| 359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6b1d8d54ad5c6b2437b854a0", "attempt_id": "f6b2de5e21e2", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:49.935180Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2005, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.4111670786515, "ttft_ms": 7.320083910599351, "decode_ms": 14.296917011961341}, "total_wall_ms": 364.67937496490777, "ttft_ms": 7.320083910599351, "input_usage": {"receiver_prompt_tokens": 2005}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4486955008, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824602012, "mlx_cache_bytes": 2742918032, "process_rss_bytes": 4486955008}, "peak_prefill_memory": null, "peak_decode_memory": 3824602012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fea3ad3491233278e32ef4e6", "attempt_id": "8b2ca95e69cf", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:50.317694Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 2006, "message_tokens": 1931, "message_utf8_bytes": 7555, "cache_tensor_bytes": null, "serialized_payload_bytes": 7555, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012791017070412636, "decode_payload_ms": 0.0, "receiver_prefill_ms": 338.7324580689892, "ttft_ms": 7.380292052403092, "decode_ms": 14.36849997844547}, "total_wall_ms": 364.1128749586642, "ttft_ms": 7.380292052403092, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4486955008, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824798652, "mlx_cache_bytes": 3174079376, "process_rss_bytes": 4486955008}, "peak_prefill_memory": null, "peak_decode_memory": 3824798652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "11352ee3c7e4a56c2e00559e", "attempt_id": "d06bb57a9c6b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.055024Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 1.7021670937538147, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.251708019524813, "ttft_ms": 28.251708019524813, "decode_ms": 81.31187502294779}, "total_wall_ms": 113.41366602573544, "ttft_ms": 28.251708019524813, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3364072692, "mlx_cache_bytes": 3950764402, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3364072692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TQ-37Z-3885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "a9fc9678b963b7c3d6778c275b5aeffc61762adbe622c0b7221038130b0f941f"} | ||||
| 362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c717dfc452892e94d4b02617", "attempt_id": "c5ccd0a442e3", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.186803Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 43, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 1.3333330862224102, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.928792035207152, "ttft_ms": 29.928792035207152, "decode_ms": 81.569500034675}, "total_wall_ms": 114.71933301072568, "ttft_ms": 29.928792035207152, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 43}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3382258964, "mlx_cache_bytes": 4141458122, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3382258964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 395-Z, Mont-Laurier", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "62705540f1dfbf31a4188d1537cb948fa38b2bfa8e9bb0cce66a6c65b63cbe21"} | ||||
| 363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "21b84a8099d005c274fa4985", "attempt_id": "e53a0cf317cd", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.318453Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 42, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 1.262207981199026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.853790998458862, "ttft_ms": 29.853790998458862, "decode_ms": 52.39320802502334}, "total_wall_ms": 85.213000071235, "ttft_ms": 29.853790998458862, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 42}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3376000300, "mlx_cache_bytes": 4203766474, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3376000300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.7060", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "af701ce56cefa8d20cc3946e344bad57b3ddca67140908fc124f710fe1577614"} | ||||
| 364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "695d47a5a956e9370b9136be", "attempt_id": "f2f6597f6220", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.420998Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 37, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 1.3536250917240977, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.828500071540475, "ttft_ms": 28.828500071540475, "decode_ms": 51.554208039306104}, "total_wall_ms": 83.51695898454636, "ttft_ms": 28.828500071540475, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 37}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595284, "mlx_cache_bytes": 4280690723, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3367595284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nnamdi Baptiste-Roy", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "0828367789e6648fa24fa6e3bfce339a5b9721a26940345b1dc8f263207eb1e6"} | ||||
| 365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "552f9a608a65d3c2d4c2e6ee", "attempt_id": "de890754c088", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.521905Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 45, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 1.361000002361834, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.515417012386024, "ttft_ms": 28.515417012386024, "decode_ms": 67.44474999140948}, "total_wall_ms": 99.04279198963195, "ttft_ms": 28.515417012386024, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3378064660, "mlx_cache_bytes": 4363331979, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3378064660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,326,886", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "e3010154fffa148727cf0089dd15f522da80a70472d3718942ebc33c8f37eecd"} | ||||
| 366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b804fe6f192d35d40935a248", "attempt_id": "eb0f333a56a9", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.638072Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 44, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 1.356041058897972, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.313083039596677, "ttft_ms": 29.313083039596677, "decode_ms": 74.61916701868176}, "total_wall_ms": 107.38579195458442, "ttft_ms": 29.313083039596677, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3376131348, "mlx_cache_bytes": 4404832651, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3376131348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TU-84M-3627", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "8ed507841daaac245c79f7204399ab8bf8859c9bb5257e6ae0f4982c89095295"} | ||||
| 367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4e871516163cedf571b73809", "attempt_id": "5698a83ab43f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.765905Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 35, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 0.7667080499231815, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.15666701644659, "ttft_ms": 28.15666701644659, "decode_ms": 14.81524994596839}, "total_wall_ms": 45.54887500125915, "ttft_ms": 28.15666701644659, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 35}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3364072692, "mlx_cache_bytes": 4405750155, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3364072692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4c8e4db96f978785c4f57684", "attempt_id": "97e62527e40e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.830349Z", "task_family": "synthetic", "document_id": "syn_03033_2000", "document_hash": "e8322af4ac0690ec0c9c2a4bccec233ee23adc63634b0e43efd4a57b40d05f9e", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03033_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1931, "source_tokens_receiver": 1931, "query_tokens": 36, "message_tokens": 1970, "message_utf8_bytes": 7555, "cache_tensor_bytes": 56483840, "serialized_payload_bytes": 56496525, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 354.762666975148, "doc_prefill_ms": 335.65300004556775, "compress_ms": 1.6621670220047235, "serialize_ms": 13.91787501052022, "load_ms": 1.3008330715820193, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.23254105169326, "ttft_ms": 28.23254105169326, "decode_ms": 14.987458009272814}, "total_wall_ms": 46.374291996471584, "ttft_ms": 28.23254105169326, "input_usage": {"receiver_prefix_tokens": 1970, "dense_cache_bytes": 56483840, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4543348736, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3365858580, "mlx_cache_bytes": 4441467275, "process_rss_bytes": 4543348736}, "peak_prefill_memory": 3813591964, "peak_decode_memory": 3365858580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03033_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5b1d80daf8ac3768a01673c525c33cf003364a98ff8d6b9e3ba1ccbe898177d6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e0f280873a3d4f4e0f52d353", "attempt_id": "0a9428d28735", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:51.910857Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5994, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1131.7432089708745, "ttft_ms": 7.626959006302059, "decode_ms": 73.31404194701463}, "total_wall_ms": 1224.7776670847088, "ttft_ms": 7.626959006302059, "input_usage": {"receiver_prompt_tokens": 5994}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4357160960, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3941739608, "mlx_cache_bytes": 1713156440, "process_rss_bytes": 4357160960}, "peak_prefill_memory": null, "peak_decode_memory": 3941739608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HN-36G-5705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "15422ab9bc2261abb7e4ed834eb86ccf1f15efdfe1aa473c023a8154cf537f8a"} | ||||
| 370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3297caebd39c5deae08aafc1", "attempt_id": "7078958adfa9", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:53.160365Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5998, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1129.774541943334, "ttft_ms": 7.554874988272786, "decode_ms": 80.95983299426734}, "total_wall_ms": 1230.1714170025662, "ttft_ms": 7.554874988272786, "input_usage": {"receiver_prompt_tokens": 5998}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4357177344, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3943345240, "mlx_cache_bytes": 2373611864, "process_rss_bytes": 4357177344}, "peak_prefill_memory": null, "peak_decode_memory": 3943345240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 223-B, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "d734dee7dc70a3a594de2b243f7cef738456c14216bf22006021c48ca22b443d"} | ||||
| 371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3286bd245af8fc11be34e510", "attempt_id": "7d5427097cb6", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:54.415367Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5999, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1128.4669580636546, "ttft_ms": 7.516791112720966, "decode_ms": 51.37437500525266}, "total_wall_ms": 1198.8099999725819, "ttft_ms": 7.516791112720966, "input_usage": {"receiver_prompt_tokens": 5999}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4357210112, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3943525464, "mlx_cache_bytes": 2782753112, "process_rss_bytes": 4357210112}, "peak_prefill_memory": null, "peak_decode_memory": 3943525464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "62.7359", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "1f0e9c1eb5863e282e657769c73cf38fbb2fce4a6a062186a1936ce9c92d9039"} | ||||
| 372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "287e764bf51b71ce27cfaf4b", "attempt_id": "11ad2dcd9592", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:55.638702Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5994, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1127.5676250224933, "ttft_ms": 7.583291968330741, "decode_ms": 43.68416604120284}, "total_wall_ms": 1190.6810839427635, "ttft_ms": 7.583291968330741, "input_usage": {"receiver_prompt_tokens": 5994}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4357242880, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3941739608, "mlx_cache_bytes": 2782753112, "process_rss_bytes": 4357242880}, "peak_prefill_memory": null, "peak_decode_memory": 3941739608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ludivine Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "95de06131699f7047cfa187427424e233c7eaf108b642ae83c9982ac56b820f6"} | ||||
| 373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f210a707863dc138be4189a4", "attempt_id": "9958a7f16ff0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:56.854941Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 6001, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1128.8690000073984, "ttft_ms": 7.549916044808924, "decode_ms": 66.13274989649653}, "total_wall_ms": 1214.2658749362454, "ttft_ms": 7.549916044808924, "input_usage": {"receiver_prompt_tokens": 6001}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4357275648, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3943885912, "mlx_cache_bytes": 3192287576, "process_rss_bytes": 4357275648}, "peak_prefill_memory": null, "peak_decode_memory": 3943885912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,819,325", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "f36a0fcfa530a85649620dd06eb5d22a4856e02795400b5c3b60f2d2273ca135"} | ||||
| 374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f2690baad5e634c6eef80d1a", "attempt_id": "efa51d3c081a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:58.094849Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 6004, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1128.96683299914, "ttft_ms": 7.555707939900458, "decode_ms": 80.65312507096678}, "total_wall_ms": 1228.16858405713, "ttft_ms": 7.555707939900458, "input_usage": {"receiver_prompt_tokens": 6004}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4357308416, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3945131096, "mlx_cache_bytes": 3854627160, "process_rss_bytes": 4357308416}, "peak_prefill_memory": null, "peak_decode_memory": 3945131096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CJ-18G-5232", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "d5b9ff6e43d42f9b616560ee8a3eb4eab140f9ef8979d350ad85abf5d04e24ef"} | ||||
| 375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "74bf0c72414db8b007a7443e", "attempt_id": "1b6ab32d13fa", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:57:59.347874Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5993, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1129.029166069813, "ttft_ms": 7.469833013601601, "decode_ms": 14.639625092968345}, "total_wall_ms": 1162.4998750630766, "ttft_ms": 7.469833013601601, "input_usage": {"receiver_prompt_tokens": 5993}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4357341184, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3941739608, "mlx_cache_bytes": 3854627160, "process_rss_bytes": 4357341184}, "peak_prefill_memory": null, "peak_decode_memory": 3941739608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b47c0d4c228e4861453bf89e", "attempt_id": "fe59aa03ba74", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:00.535548Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 5995, "message_tokens": 5918, "message_utf8_bytes": 29476, "cache_tensor_bytes": null, "serialized_payload_bytes": 29476, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0176670728251338, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1128.639500006102, "ttft_ms": 7.544375024735928, "decode_ms": 14.761666068807244}, "total_wall_ms": 1162.1805829927325, "ttft_ms": 7.544375024735928, "input_usage": {"receiver_prompt_tokens": 5995}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4357373952, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3941919832, "mlx_cache_bytes": 4262785368, "process_rss_bytes": 4357373952}, "peak_prefill_memory": null, "peak_decode_memory": 3941919832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9c1407a273b4529ba05496dc", "attempt_id": "aa93343c6e37", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:02.907103Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 3.6146669881418347, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.86749996896833, "ttft_ms": 49.86749996896833, "decode_ms": 82.40316703449935}, "total_wall_ms": 141.1054169293493, "ttft_ms": 49.86749996896833, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3737152756, "mlx_cache_bytes": 5047252954, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3737152756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HN-36G-5705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "15422ab9bc2261abb7e4ed834eb86ccf1f15efdfe1aa473c023a8154cf537f8a"} | ||||
| 378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "629ff01e7cb1b7f268f8141e", "attempt_id": "13b8d3e80e04", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:03.073636Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 41, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 1.564792008139193, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.61754197999835, "ttft_ms": 52.61754197999835, "decode_ms": 90.28579201549292}, "total_wall_ms": 149.8729579616338, "ttft_ms": 52.61754197999835, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 41}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3744017660, "mlx_cache_bytes": 5127715106, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3744017660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 223-B, Val-d'Or", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "d734dee7dc70a3a594de2b243f7cef738456c14216bf22006021c48ca22b443d"} | ||||
| 379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "15eec4c0117f1ea9f095e5db", "attempt_id": "a70ea53efc9c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:03.248739Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 42, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 1.5532500110566616, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.47979194205254, "ttft_ms": 50.47979194205254, "decode_ms": 57.314292062073946}, "total_wall_ms": 114.67720801010728, "ttft_ms": 50.47979194205254, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 42}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3745459456, "mlx_cache_bytes": 5191563890, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3745459456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "62.7359", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "1f0e9c1eb5863e282e657769c73cf38fbb2fce4a6a062186a1936ce9c92d9039"} | ||||
| 380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "332c9dd6465c97a5b978936c", "attempt_id": "028ba89a6455", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:03.388514Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 37, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 1.5839999541640282, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.714582924731076, "ttft_ms": 48.714582924731076, "decode_ms": 49.57304208073765}, "total_wall_ms": 105.10554199572653, "ttft_ms": 48.714582924731076, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 37}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3737152756, "mlx_cache_bytes": 5191563890, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3737152756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ludivine Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "95de06131699f7047cfa187427424e233c7eaf108b642ae83c9982ac56b820f6"} | ||||
| 381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a62e356074ffb35a292d0115", "attempt_id": "8420c8e0c9cd", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:03.518669Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 44, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 1.5906660119071603, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.77537498436868, "ttft_ms": 50.77537498436868, "decode_ms": 74.16220800951123}, "total_wall_ms": 131.76354195456952, "ttft_ms": 50.77537498436868, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3749899528, "mlx_cache_bytes": 5278153682, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3749899528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,819,325", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "f36a0fcfa530a85649620dd06eb5d22a4856e02795400b5c3b60f2d2273ca135"} | ||||
| 382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c789916d7548c58714ebebb4", "attempt_id": "0bce56990045", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:03.675027Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 47, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 1.4870408922433853, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.75783303659409, "ttft_ms": 52.75783303659409, "decode_ms": 91.7669169139117}, "total_wall_ms": 151.70670801308006, "ttft_ms": 52.75783303659409, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 47}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3754929428, "mlx_cache_bytes": 5352717642, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3754929428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "CJ-18G-5232", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "d5b9ff6e43d42f9b616560ee8a3eb4eab140f9ef8979d350ad85abf5d04e24ef"} | ||||
| 383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "247d1d0f8f859a3cdff9ffa1", "attempt_id": "933cd1b42e8b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:03.852095Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 36, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 1.53870799113065, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.5950000109151, "ttft_ms": 47.5950000109151, "decode_ms": 16.62479096557945}, "total_wall_ms": 71.45133300218731, "ttft_ms": 47.5950000109151, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3736612084, "mlx_cache_bytes": 5383126346, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3736612084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "cb83be1579389d5552e46e37", "attempt_id": "25957706b42f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:03.948681Z", "task_family": "synthetic", "document_id": "syn_03034_8000", "document_hash": "5ffdb9e3398b9864cb5a2eec10f8bf42f4087972c2ae2095226fa987279b179c", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03034_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3435162632}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5918, "source_tokens_receiver": 5918, "query_tokens": 38, "message_tokens": 5957, "message_utf8_bytes": 29476, "cache_tensor_bytes": 170799104, "serialized_payload_bytes": 170811848, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1184.1794160427526, "doc_prefill_ms": 1128.4208330325782, "compress_ms": 6.11358298920095, "serialize_ms": 38.46424992661923, "load_ms": 1.5833339421078563, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.83908305782825, "ttft_ms": 48.83908305782825, "decode_ms": 16.512791975401342}, "total_wall_ms": 72.45012500789016, "ttft_ms": 48.83908305782825, "input_usage": {"receiver_prefix_tokens": 5957, "dense_cache_bytes": 170799104, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4699865088, "backend_memory": {"mlx_active_bytes": 3607653384, "mlx_peak_bytes": 3739708676, "mlx_cache_bytes": 5440815854, "process_rss_bytes": 4699865088}, "peak_prefill_memory": 3929779288, "peak_decode_memory": 3739708676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03034_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "096710a2d5b4ef40c67bc92977455096d0ceb6b775ceacbc26e88c6dcd871d77", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6caf7b471881389cfeb3addd", "attempt_id": "e5da7ffce76f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:04.069024Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2095, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 365.53566600196064, "ttft_ms": 7.471041055396199, "decode_ms": 71.63070805836469}, "total_wall_ms": 448.4904579585418, "ttft_ms": 7.471041055396199, "input_usage": {"receiver_prompt_tokens": 2095}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4660969472, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485484, "mlx_cache_bytes": 1172921872, "process_rss_bytes": 4660969472}, "peak_prefill_memory": null, "peak_decode_memory": 3714485484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SG-71V-9728", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "94ef569f58ec7cdeddf26b386e487290438f3e57fc011d3d3a6642596b12868e"} | ||||
| 386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d545ead3f71f0aec61b9898b", "attempt_id": "591983181c60", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:04.535664Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2100, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.74320897832513, "ttft_ms": 7.236124947667122, "decode_ms": 70.76612499076873}, "total_wall_ms": 446.46870798897, "ttft_ms": 7.236124947667122, "input_usage": {"receiver_prompt_tokens": 2100}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4660985856, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485504, "mlx_cache_bytes": 1273216732, "process_rss_bytes": 4660985856}, "peak_prefill_memory": null, "peak_decode_memory": 3714485504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 190-P, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "0fa1acfc9039f77897e3ffbd0deeeed4b1235e31057039ad326fb186ab4dd01d"} | ||||
| 387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "94e297ee96e123453c05c3f3", "attempt_id": "f4be8033c297", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:04.999797Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2100, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.2094579990953, "ttft_ms": 7.231416995637119, "decode_ms": 50.03104102797806}, "total_wall_ms": 425.1739999745041, "ttft_ms": 7.231416995637119, "input_usage": {"receiver_prompt_tokens": 2100}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4660985856, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485504, "mlx_cache_bytes": 1273216732, "process_rss_bytes": 4660985856}, "peak_prefill_memory": null, "peak_decode_memory": 3714485504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "58.1930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "f8b96734f272699c055eafd0bfd34e83bdddc244e4b7bad68a9902432bdfc16b"} | ||||
| 388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "150ed8beb384e24ea5989c84", "attempt_id": "5b73c37ae2fe", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:05.443906Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2094, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.8488329490647, "ttft_ms": 7.241541985422373, "decode_ms": 35.73154204059392}, "total_wall_ms": 411.46229195874184, "ttft_ms": 7.241541985422373, "input_usage": {"receiver_prompt_tokens": 2094}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4660985856, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485484, "mlx_cache_bytes": 1301970652, "process_rss_bytes": 4660985856}, "peak_prefill_memory": null, "peak_decode_memory": 3714485484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ewan Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "d9d322de72158e519af3cc6f1c243fe729fb9b5de8e914fa30164ed490e36715"} | ||||
| 389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e067cd9f644ee99b2b8f92e0", "attempt_id": "d288b7fa2e61", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:05.873094Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2103, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.36679190956056, "ttft_ms": 7.1997500490397215, "decode_ms": 64.3117920262739}, "total_wall_ms": 439.4041660707444, "ttft_ms": 7.1997500490397215, "input_usage": {"receiver_prompt_tokens": 2103}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4661002240, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485516, "mlx_cache_bytes": 1408753588, "process_rss_bytes": 4661002240}, "peak_prefill_memory": null, "peak_decode_memory": 3714485516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,546,236", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "5e1845f7ba9b0fa6382745e2bb74a47d5a90fca5f31bc8b7e13609f49af06ce0"} | ||||
| 390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0b1e5295a4c2a62feb1aa96c", "attempt_id": "87304db1a39d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:06.329880Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2105, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.924208028242, "ttft_ms": 7.19599996227771, "decode_ms": 71.41920796129853}, "total_wall_ms": 447.0925839850679, "ttft_ms": 7.19599996227771, "input_usage": {"receiver_prompt_tokens": 2105}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4661002240, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485524, "mlx_cache_bytes": 1500774548, "process_rss_bytes": 4661002240}, "peak_prefill_memory": null, "peak_decode_memory": 3714485524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "KK-23U-4457", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "acfa14a945c38304143f718fff58942685646504a77cc76ae2a4fdb9f13d938d"} | ||||
| 391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "25e931e18051e7b0569ec5af", "attempt_id": "d22e8243ea4d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:06.794378Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2096, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.64633292052895, "ttft_ms": 7.275375071913004, "decode_ms": 14.273457927629352}, "total_wall_ms": 389.6412920439616, "ttft_ms": 7.275375071913004, "input_usage": {"receiver_prompt_tokens": 2096}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4661002240, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485504, "mlx_cache_bytes": 1573863572, "process_rss_bytes": 4661002240}, "peak_prefill_memory": null, "peak_decode_memory": 3714485504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "47fd51232be67dad3765f9ad", "attempt_id": "241270aa57c8", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:07.201181Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 2096, "message_tokens": 2020, "message_utf8_bytes": 7401, "cache_tensor_bytes": null, "serialized_payload_bytes": 7401, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 364.7120000096038, "ttft_ms": 7.220542058348656, "decode_ms": 14.30512499064207}, "total_wall_ms": 389.4940410973504, "ttft_ms": 7.220542058348656, "input_usage": {"receiver_prompt_tokens": 2096}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4661002240, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3714485504, "mlx_cache_bytes": 1573863572, "process_rss_bytes": 4661002240}, "peak_prefill_memory": null, "peak_decode_memory": 3714485504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fc0634b0d291d7fe927908ee", "attempt_id": "279b4b2b09f1", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:07.983027Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 36, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.9902080530300736, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.721333015710115, "ttft_ms": 28.721333015710115, "decode_ms": 74.70083306543529}, "total_wall_ms": 107.69679199438542, "ttft_ms": 28.721333015710115, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4719263744, "backend_memory": {"mlx_active_bytes": 3273681928, "mlx_peak_bytes": 3380292856, "mlx_cache_bytes": 1661931205, "process_rss_bytes": 4719263744}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3380292856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "SG-71V-9728", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "94ef569f58ec7cdeddf26b386e487290438f3e57fc011d3d3a6642596b12868e"} | ||||
| 394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "312541cbdd064228988fd559", "attempt_id": "edc6291b1736", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.109629Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.3142090756446123, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.280375038273633, "ttft_ms": 30.280375038273633, "decode_ms": 74.44220804609358}, "total_wall_ms": 107.83233295660466, "ttft_ms": 30.280375038273633, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4719263744, "backend_memory": {"mlx_active_bytes": 3273681928, "mlx_peak_bytes": 3386748196, "mlx_cache_bytes": 1742655501, "process_rss_bytes": 4719263744}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3386748196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 190-P, Schefferville", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "0fa1acfc9039f77897e3ffbd0deeeed4b1235e31057039ad326fb186ab4dd01d"} | ||||
| 395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e2f435568e57f60b61caeec3", "attempt_id": "9e1cb3b2f9b7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.235256Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 41, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.3372080866247416, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.06741707213223, "ttft_ms": 30.06741707213223, "decode_ms": 51.98595905676484}, "total_wall_ms": 85.13354195747524, "ttft_ms": 30.06741707213223, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4719263744, "backend_memory": {"mlx_active_bytes": 3273681928, "mlx_peak_bytes": 3386748196, "mlx_cache_bytes": 1742655501, "process_rss_bytes": 4719263744}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3386748196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "58.1930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "f8b96734f272699c055eafd0bfd34e83bdddc244e4b7bad68a9902432bdfc16b"} | ||||
| 396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "652d5157a8e434336ac0103b", "attempt_id": "c4f95b05858d", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.338267Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 35, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.308833947405219, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.394124936312437, "ttft_ms": 28.394124936312437, "decode_ms": 36.922457977198064}, "total_wall_ms": 68.41395900119096, "ttft_ms": 28.394124936312437, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 35}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4719263744, "backend_memory": {"mlx_active_bytes": 3273681928, "mlx_peak_bytes": 3378932984, "mlx_cache_bytes": 1777504269, "process_rss_bytes": 4719263744}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3378932984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ewan Zelenko", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "d9d322de72158e519af3cc6f1c243fe729fb9b5de8e914fa30164ed490e36715"} | ||||
| 397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f7ea3937e29b60d439707623", "attempt_id": "21f79c39a0f9", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.423807Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 44, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.4957499224692583, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.664582969620824, "ttft_ms": 30.664582969620824, "decode_ms": 67.2740830341354}, "total_wall_ms": 101.19066701736301, "ttft_ms": 30.664582969620824, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4719280128, "backend_memory": {"mlx_active_bytes": 3273681928, "mlx_peak_bytes": 3390024980, "mlx_cache_bytes": 1854738797, "process_rss_bytes": 4719280128}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3390024980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,546,236", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "5e1845f7ba9b0fa6382745e2bb74a47d5a90fca5f31bc8b7e13609f49af06ce0"} | ||||
| 398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "48655935ac9f9cf53958978a", "attempt_id": "e05e5081cbc4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.541815Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 46, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.332749961875379, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.603375053033233, "ttft_ms": 30.603375053033233, "decode_ms": 73.84066691156477}, "total_wall_ms": 107.55683295428753, "ttft_ms": 30.603375053033233, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4719280128, "backend_memory": {"mlx_active_bytes": 3274599432, "mlx_peak_bytes": 3393350940, "mlx_cache_bytes": 1960022749, "process_rss_bytes": 4719280128}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3393350940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "KK-23U-4457", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "acfa14a945c38304143f718fff58942685646504a77cc76ae2a4fdb9f13d938d"} | ||||
| 399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "127096fd6a00d214210f64ff", "attempt_id": "2c647a699933", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.666133Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.3892919523641467, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.054207912646234, "ttft_ms": 28.054207912646234, "decode_ms": 14.755666023120284}, "total_wall_ms": 46.04591696988791, "ttft_ms": 28.054207912646234, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4719280128, "backend_memory": {"mlx_active_bytes": 3273681928, "mlx_peak_bytes": 3382570252, "mlx_cache_bytes": 2006210614, "process_rss_bytes": 4719280128}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3382570252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6795dbb5f1d5cf84e3968f18", "attempt_id": "eaf549b644b4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.729446Z", "task_family": "synthetic", "document_id": "syn_03036_2000", "document_hash": "0fcd9ea0c1a76ae64bd02e59acd8dcdb6a2ca13fedc5ab5ac1186d56e8376d13", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03036_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3213126664}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 2020, "source_tokens_receiver": 2020, "query_tokens": 37, "message_tokens": 2059, "message_utf8_bytes": 7401, "cache_tensor_bytes": 59035648, "serialized_payload_bytes": 59048333, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.4066670080647, "doc_prefill_ms": 356.26741708256304, "compress_ms": 1.9978750497102737, "serialize_ms": 13.693000073544681, "load_ms": 1.349334022961557, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.83183299470693, "ttft_ms": 27.83183299470693, "decode_ms": 14.891708036884665}, "total_wall_ms": 45.94587499741465, "ttft_ms": 27.83183299470693, "input_usage": {"receiver_prefix_tokens": 2059, "dense_cache_bytes": 59035648, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4719280128, "backend_memory": {"mlx_active_bytes": 3273681928, "mlx_peak_bytes": 3382570252, "mlx_cache_bytes": 2006210614, "process_rss_bytes": 4719280128}, "peak_prefill_memory": 3714485484, "peak_decode_memory": 3382570252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03036_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2a466126fc6ad2bc75c3bf8886704bca9c2eb92c2ba96e4c8311ff5fd52a8c81", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ad322ec80be6c0b9b82a30f6", "attempt_id": "db219d2abc46", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:08.806712Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6051, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1149.3533750763163, "ttft_ms": 7.824208005331457, "decode_ms": 73.45479191280901}, "total_wall_ms": 1242.270875023678, "ttft_ms": 7.824208005331457, "input_usage": {"receiver_prompt_tokens": 6051}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4547706880, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3961433176, "mlx_cache_bytes": 1743679832, "process_rss_bytes": 4547706880}, "peak_prefill_memory": null, "peak_decode_memory": 3961433176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HR-43L-3013", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "0cd6da485084f9884229002d8c423c19eef01330e5e8b8b1d417bd301b8bcf95"} | ||||
| 402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "970f5e89fdfedc1ff7ab10f1", "attempt_id": "30160488b78c", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:10.074772Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6057, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1148.6654169857502, "ttft_ms": 7.63433298561722, "decode_ms": 73.52583296597004}, "total_wall_ms": 1241.260917042382, "ttft_ms": 7.63433298561722, "input_usage": {"receiver_prompt_tokens": 6057}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4547739648, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3963219032, "mlx_cache_bytes": 2424467800, "process_rss_bytes": 4547739648}, "peak_prefill_memory": null, "peak_decode_memory": 3963219032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 764-N, Matagami", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "3b9f968dd56f551a2f9080aa97e2dd75f113c60bca538bb4b4472ee49ea33096"} | ||||
| 403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "be410a919d4f93c41d653b58", "attempt_id": "abe80fe0a6a0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:11.341255Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6055, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1147.0352499745786, "ttft_ms": 7.49345903750509, "decode_ms": 50.81916693598032}, "total_wall_ms": 1216.6141659254208, "ttft_ms": 7.49345903750509, "input_usage": {"receiver_prompt_tokens": 6055}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4547772416, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3962858584, "mlx_cache_bytes": 2845602136, "process_rss_bytes": 4547772416}, "peak_prefill_memory": null, "peak_decode_memory": 3962858584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "52.4601", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "8b9c112062354c43cfefa90af77562947b457c4b23e6208087870673fd9b95c6"} | ||||
| 404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "32524ad859f1aa5cc000f8bd", "attempt_id": "b6bef8bf4f98", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:12.582637Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6049, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1143.722707987763, "ttft_ms": 7.643625023774803, "decode_ms": 66.18570792488754}, "total_wall_ms": 1229.1089580394328, "ttft_ms": 7.643625023774803, "input_usage": {"receiver_prompt_tokens": 6049}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4547805184, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3960892504, "mlx_cache_bytes": 3265360216, "process_rss_bytes": 4547805184}, "peak_prefill_memory": null, "peak_decode_memory": 3960892504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Solveig Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "2ce06231e10d2b1d9dddeef39e5433969f323ca0e8f66e2c543aa36f21cf5db3"} | ||||
| 405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6c92e40c1dbd3659e8e2a884", "attempt_id": "9e9cc2dc447d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:13.838233Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6062, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1147.4081659689546, "ttft_ms": 7.464541937224567, "decode_ms": 51.444292068481445}, "total_wall_ms": 1217.2265839762986, "ttft_ms": 7.464541937224567, "input_usage": {"receiver_prompt_tokens": 6062}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4547837952, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3965004888, "mlx_cache_bytes": 3948032344, "process_rss_bytes": 4547837952}, "peak_prefill_memory": null, "peak_decode_memory": 3965004888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "459,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "fb693a5d485291e89c99e9852fa549afad20fd8d49927e70f30e3c1c15105635"} | ||||
| 406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "84b26893d6e10c33931e7b32", "attempt_id": "fd8289483ee0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:15.080256Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6059, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1146.5044170618057, "ttft_ms": 7.47358298394829, "decode_ms": 72.79595790896565}, "total_wall_ms": 1238.2761250482872, "ttft_ms": 7.47358298394829, "input_usage": {"receiver_prompt_tokens": 6059}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4547870720, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3963579480, "mlx_cache_bytes": 4369953112, "process_rss_bytes": 4547870720}, "peak_prefill_memory": null, "peak_decode_memory": 3963579480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GX-48X-7240", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "d06667dc933d1a921ff2121ef2808a365d4d3f600e77ad1525788398a80d0895"} | ||||
| 407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f6ee7e274983bec0c3707c0d", "attempt_id": "c399d0a4a9af", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:16.343475Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6052, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1148.2373329345137, "ttft_ms": 7.391166058368981, "decode_ms": 14.733458054251969}, "total_wall_ms": 1181.934415944852, "ttft_ms": 7.391166058368981, "input_usage": {"receiver_prompt_tokens": 6052}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4547903488, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3961613400, "mlx_cache_bytes": 4790497624, "process_rss_bytes": 4547903488}, "peak_prefill_memory": null, "peak_decode_memory": 3961613400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4c022ce3b84b66ffc06c7174", "attempt_id": "fab80f411f73", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:17.551834Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 6052, "message_tokens": 5975, "message_utf8_bytes": 29553, "cache_tensor_bytes": null, "serialized_payload_bytes": 29553, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.020041014067828655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1146.8698749085888, "ttft_ms": 7.415625033900142, "decode_ms": 14.697207952849567}, "total_wall_ms": 1180.1519580185413, "ttft_ms": 7.415625033900142, "input_usage": {"receiver_prompt_tokens": 6052}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4547936256, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3961613400, "mlx_cache_bytes": 4790497624, "process_rss_bytes": 4547936256}, "peak_prefill_memory": null, "peak_decode_memory": 3961613400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2fc3fea908b0c14374e71d56", "attempt_id": "f8797aaf5413", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:19.939672Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 37, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 3.577415947802365, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.71175005286932, "ttft_ms": 50.71175005286932, "decode_ms": 83.53016595356166}, "total_wall_ms": 143.6504169832915, "ttft_ms": 50.71175005286932, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 37}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3740265716, "mlx_cache_bytes": 5614270426, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3740265716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HR-43L-3013", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "0cd6da485084f9884229002d8c423c19eef01330e5e8b8b1d417bd301b8bcf95"} | ||||
| 410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "58e97b528ebb449dc0a9a49b", "attempt_id": "51f8a02d0a05", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:20.109146Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 43, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 1.6015410656109452, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.7103339554742, "ttft_ms": 52.7103339554742, "decode_ms": 83.19083298556507}, "total_wall_ms": 142.73033395875245, "ttft_ms": 52.7103339554742, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 43}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3751832836, "mlx_cache_bytes": 5699893554, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3751832836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 764-N, Matagami", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "3b9f968dd56f551a2f9080aa97e2dd75f113c60bca538bb4b4472ee49ea33096"} | ||||
| 411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f7de643ce2cec0a4fc7dae8c", "attempt_id": "a0ba16c0a2ac", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:20.276752Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 41, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 1.5533339465036988, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.59941704571247, "ttft_ms": 52.59941704571247, "decode_ms": 57.65637499280274}, "total_wall_ms": 117.22854094114155, "ttft_ms": 52.59941704571247, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3750997260, "mlx_cache_bytes": 5764413746, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3750997260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "52.4601", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "8b9c112062354c43cfefa90af77562947b457c4b23e6208087870673fd9b95c6"} | ||||
| 412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "09aa5ced0ce5c6f9482b0cde", "attempt_id": "caad8331a5e4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:20.419872Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 35, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 1.7707919469103217, "receiver_prefill_ms": 0.0, "query_prefill_ms": 47.99845803063363, "ttft_ms": 47.99845803063363, "decode_ms": 73.96241603419185}, "total_wall_ms": 129.23562503419816, "ttft_ms": 47.99845803063363, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 35}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3738463476, "mlx_cache_bytes": 5808044338, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3738463476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Solveig Ouellet-Marchand", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "2ce06231e10d2b1d9dddeef39e5433969f323ca0e8f66e2c543aa36f21cf5db3"} | ||||
| 413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "62c7380728595ca8b6ba09da", "attempt_id": "7f0fa68092bd", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:20.574333Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 48, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 1.5657079638913274, "receiver_prefill_ms": 0.0, "query_prefill_ms": 53.33620903547853, "ttft_ms": 53.33620903547853, "decode_ms": 58.0341249005869}, "total_wall_ms": 118.13741596415639, "ttft_ms": 53.33620903547853, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 48}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3759140120, "mlx_cache_bytes": 5883820722, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3759140120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "459,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "fb693a5d485291e89c99e9852fa549afad20fd8d49927e70f30e3c1c15105635"} | ||||
| 414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ca2376b76e3a37437bbb25d5", "attempt_id": "d1a6dd09910e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:20.718256Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 45, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 1.5238749329000711, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.88295792322606, "ttft_ms": 51.88295792322606, "decode_ms": 83.36587494704872}, "total_wall_ms": 141.99541695415974, "ttft_ms": 51.88295792322606, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3755076888, "mlx_cache_bytes": 5952666290, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3755076888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GX-48X-7240", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "d06667dc933d1a921ff2121ef2808a365d4d3f600e77ad1525788398a80d0895"} | ||||
| 415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1512be4b65a8e0a806e00985", "attempt_id": "d1fb5e636706", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:20.884931Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 1.4998330734670162, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.64083298202604, "ttft_ms": 50.64083298202604, "decode_ms": 16.383124981075525}, "total_wall_ms": 73.7036670325324, "ttft_ms": 50.64083298202604, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3746475276, "mlx_cache_bytes": 6010486870, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3746475276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d4c78e74c830ac9cbef9e395", "attempt_id": "42c30c4bc650", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:20.983420Z", "task_family": "synthetic", "document_id": "syn_03037_8000", "document_hash": "fd3f20a4229ac3648580c4531c3c06c546221cf9dd07b6aefcd7d05ac4b17dd9", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03037_8000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3436080136}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5975, "source_tokens_receiver": 5975, "query_tokens": 38, "message_tokens": 6014, "message_utf8_bytes": 29553, "cache_tensor_bytes": 172433408, "serialized_payload_bytes": 172446152, "side_information_bytes": 12744, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1182.9400840215385, "doc_prefill_ms": 1128.943582996726, "compress_ms": 3.477749996818602, "serialize_ms": 38.96825003903359, "load_ms": 1.568000065162778, "receiver_prefill_ms": 0.0, "query_prefill_ms": 50.59308302588761, "ttft_ms": 50.59308302588761, "decode_ms": 16.20633399579674}, "total_wall_ms": 73.63016705494374, "ttft_ms": 50.59308302588761, "input_usage": {"receiver_prefix_tokens": 6014, "dense_cache_bytes": 172433408, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4892999680, "backend_memory": {"mlx_active_bytes": 3610405896, "mlx_peak_bytes": 3746770188, "mlx_cache_bytes": 6010486870, "process_rss_bytes": 4892999680}, "peak_prefill_memory": 3948702808, "peak_decode_memory": 3746770188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03037_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b3be12434595aa2ebfde53be2d605158ebe0ed8e02f5d05368832b0c01c0185a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "eef7a22923146cd1d5678e28", "attempt_id": "ce701fb4ca4f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:21.104656Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1998, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 341.29995794501156, "ttft_ms": 7.4139999924227595, "decode_ms": 71.37370808050036}, "total_wall_ms": 423.6013339832425, "ttft_ms": 7.4139999924227595, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4833067008, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822603136, "mlx_cache_bytes": 1127259276, "process_rss_bytes": 4833067008}, "peak_prefill_memory": null, "peak_decode_memory": 3822603136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DA-68R-2815", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "97e2778dcc4bad0f2bc307ef463e57160536b92aadd3591c0a5b8a7dc83cd4f6"} | ||||
| 418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0f5ab6da395a0d2467e5c745", "attempt_id": "1e35a4e07f8e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:21.545456Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2004, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.0411669863388, "ttft_ms": 7.209375035017729, "decode_ms": 86.13183302804828}, "total_wall_ms": 436.85091694351286, "ttft_ms": 7.209375035017729, "input_usage": {"receiver_prompt_tokens": 2004}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4833083392, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824405400, "mlx_cache_bytes": 1822931928, "process_rss_bytes": 4833083392}, "peak_prefill_memory": null, "peak_decode_memory": 3824405400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 191-F, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "2d7ad60e78a85057478a832253fc07fe8f9748d83f535687db486d8b8120a0cf"} | ||||
| 419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "12d59949d9b2331fa2ad7562", "attempt_id": "23706546a4ed", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:21.999303Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2003, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 338.5637500323355, "ttft_ms": 7.374249980784953, "decode_ms": 49.91191695444286}, "total_wall_ms": 399.39262496773154, "ttft_ms": 7.374249980784953, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4833083392, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824405400, "mlx_cache_bytes": 1822931928, "process_rss_bytes": 4833083392}, "peak_prefill_memory": null, "peak_decode_memory": 3824405400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "40.2091", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "3edf15d0142ce87a30ad1abb58e5adb9b084b20e118165fba2af0591ba809ce5"} | ||||
| 420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1f66ab09f217e825819d6e15", "attempt_id": "819b19d164e9", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:22.415713Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1999, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.5172080490738, "ttft_ms": 7.2077090153470635, "decode_ms": 35.659249988384545}, "total_wall_ms": 385.75612497515976, "ttft_ms": 7.2077090153470635, "input_usage": {"receiver_prompt_tokens": 1999}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4833083392, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822799768, "mlx_cache_bytes": 2252717016, "process_rss_bytes": 4833083392}, "peak_prefill_memory": null, "peak_decode_memory": 3822799768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Bohdan Obuya", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "5130fc8d00e2a101feb6481ffda01ed025f12bb643fbbdb1f69c7d1df1023017"} | ||||
| 421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "19c604a581bce346b6f29c0f", "attempt_id": "2e32e182cef3", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:22.818981Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2005, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.4196250010282, "ttft_ms": 7.266833097673953, "decode_ms": 63.716083066537976}, "total_wall_ms": 414.08270795363933, "ttft_ms": 7.266833097673953, "input_usage": {"receiver_prompt_tokens": 2005}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4833099776, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3824602012, "mlx_cache_bytes": 2683689768, "process_rss_bytes": 4833099776}, "peak_prefill_memory": null, "peak_decode_memory": 3824602012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,027,162", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "e4780ef9209b9d0ced1b6e3014076bf54f1bab9be1a7e3d456ed34e8fa707bf5"} | ||||
| 422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7c04f6a1984965cf58289366", "attempt_id": "56b4622b163a", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:23.250126Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 2008, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 340.3894159710035, "ttft_ms": 7.287875050678849, "decode_ms": 71.60758308600634}, "total_wall_ms": 422.9255421087146, "ttft_ms": 7.287875050678849, "input_usage": {"receiver_prompt_tokens": 2008}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4833099776, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3826011048, "mlx_cache_bytes": 3381049988, "process_rss_bytes": 4833099776}, "peak_prefill_memory": null, "peak_decode_memory": 3826011048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JS-65C-5324", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "538cc532cf1099b48a6be1ae0cdba8e5f918e2ab10ac2cf52a3b0237033b3850"} | ||||
| 423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ce846b00a6dcd97f7ccf6e56", "attempt_id": "2d52f17f2f87", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:23.690584Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1999, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.36575008556247, "ttft_ms": 7.36495794262737, "decode_ms": 14.13749996572733}, "total_wall_ms": 364.45624998304993, "ttft_ms": 7.36495794262737, "input_usage": {"receiver_prompt_tokens": 1999}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4833099776, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822799768, "mlx_cache_bytes": 3381049988, "process_rss_bytes": 4833099776}, "peak_prefill_memory": null, "peak_decode_memory": 3822799768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f2f8fd401d376c077b98dfc4", "attempt_id": "6ca06e453418", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:24.072280Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 1999, "message_tokens": 1923, "message_utf8_bytes": 7527, "cache_tensor_bytes": null, "serialized_payload_bytes": 7527, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.7709579439834, "ttft_ms": 7.187249953858554, "decode_ms": 14.367124997079372}, "total_wall_ms": 364.6807090844959, "ttft_ms": 7.187249953858554, "input_usage": {"receiver_prompt_tokens": 1999}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4833099776, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3822799768, "mlx_cache_bytes": 3381049988, "process_rss_bytes": 4833099776}, "peak_prefill_memory": null, "peak_decode_memory": 3822799768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "56cbe948132822363e34edfc", "attempt_id": "94c3d77e38e5", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:24.807882Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q00_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 36, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 1.6005829675123096, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.551874915137887, "ttft_ms": 28.551874915137887, "decode_ms": 74.37308400403708}, "total_wall_ms": 106.65774997323751, "ttft_ms": 28.551874915137887, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 36}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3365432568, "mlx_cache_bytes": 4155998389, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3365432568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DA-68R-2815", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "97e2778dcc4bad0f2bc307ef463e57160536b92aadd3591c0a5b8a7dc83cd4f6"} | ||||
| 426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b294f6e948f311a146a7b31d", "attempt_id": "2777bac72235", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:24.932991Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q01_single_fact", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 42, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 0.7004590006545186, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.707625042647123, "ttft_ms": 29.707625042647123, "decode_ms": 88.65595795214176}, "total_wall_ms": 120.79633306711912, "ttft_ms": 29.707625042647123, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 42}, "output_usage": {"output_tokens": 12}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3378244880, "mlx_cache_bytes": 4255138309, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3378244880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lot 191-F, Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.8571428571428571}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "2d7ad60e78a85057478a832253fc07fe8f9748d83f535687db486d8b8120a0cf"} | ||||
| 427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "36caaea65367649f9e09eed3", "attempt_id": "784818e88f5c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:25.071435Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q02_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 41, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 1.3379160081967711, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.560624971054494, "ttft_ms": 29.560624971054494, "decode_ms": 51.683290977962315}, "total_wall_ms": 84.35108396224678, "ttft_ms": 29.560624971054494, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 41}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3377310992, "mlx_cache_bytes": 4295819781, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3377310992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "40.2091", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "3edf15d0142ce87a30ad1abb58e5adb9b084b20e118165fba2af0591ba809ce5"} | ||||
| 428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "13a64c66a533cdeb830b2120", "attempt_id": "6bb43d097cb7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:25.172782Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q03_exact_copy", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 1.3126250123605132, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.681208030320704, "ttft_ms": 28.681208030320704, "decode_ms": 37.10116702131927}, "total_wall_ms": 68.8589159399271, "ttft_ms": 28.681208030320704, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595280, "mlx_cache_bytes": 4371826526, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3367595280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Bohdan Obuya", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "5130fc8d00e2a101feb6481ffda01ed025f12bb643fbbdb1f69c7d1df1023017"} | ||||
| 429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d7e7e39cb9445c8e6626ce40", "attempt_id": "0ced76ddea57", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:25.258494Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q04_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 43, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 1.3489160919561982, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.252875014208257, "ttft_ms": 29.252875014208257, "decode_ms": 66.27216609194875}, "total_wall_ms": 98.58737501781434, "ttft_ms": 29.252875014208257, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 43}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3382258964, "mlx_cache_bytes": 4475357366, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3382258964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,027,162", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "e4780ef9209b9d0ced1b6e3014076bf54f1bab9be1a7e3d456ed34e8fa707bf5"} | ||||
| 430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2a7e0a4838469ada5df4b625", "attempt_id": "7a4fceb3b1cf", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:25.374171Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 46, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 1.2529999949038029, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.10920900851488, "ttft_ms": 30.10920900851488, "decode_ms": 74.53029206953943}, "total_wall_ms": 107.66249999869615, "ttft_ms": 30.10920900851488, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3379735832, "mlx_cache_bytes": 4647897638, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3379735832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JS-65C-5324", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "538cc532cf1099b48a6be1ae0cdba8e5f918e2ab10ac2cf52a3b0237033b3850"} | ||||
| 431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e181a242f3c7cbba7c4fe30e", "attempt_id": "30057309567f", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:25.498966Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 1.3427920639514923, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.128208010457456, "ttft_ms": 28.128208010457456, "decode_ms": 14.852459076792002}, "total_wall_ms": 46.020541922189295, "ttft_ms": 28.128208010457456, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595280, "mlx_cache_bytes": 4648815142, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3367595280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "faa4bcb6e3e594c3b7071e76", "attempt_id": "59b284d125d1", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:25.562365Z", "task_family": "synthetic", "document_id": "syn_03039_2000", "document_hash": "d2491d5f844feb63f313eeffaf204fa21f9681c9544a158e16d409e14e731760", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03039_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203329032}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 8, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1923, "source_tokens_receiver": 1923, "query_tokens": 37, "message_tokens": 1962, "message_utf8_bytes": 7527, "cache_tensor_bytes": 56254464, "serialized_payload_bytes": 56267149, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 353.6185839911923, "doc_prefill_ms": 334.9667079746723, "compress_ms": 1.715000020340085, "serialize_ms": 13.523041969165206, "load_ms": 1.3667079620063305, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.268874972127378, "ttft_ms": 28.268874972127378, "decode_ms": 15.04216599278152}, "total_wall_ms": 46.34041606914252, "ttft_ms": 28.268874972127378, "input_usage": {"receiver_prefix_tokens": 1962, "dense_cache_bytes": 56254464, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4889755648, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3367595280, "mlx_cache_bytes": 4648815142, "process_rss_bytes": 4889755648}, "peak_prefill_memory": 3810577280, "peak_decode_memory": 3367595280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03039_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d8a1d000c05038deeb10bafd06965b60f4d87e5eabfc3a9aa3bd19f4190fe9f4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2cc5fe9cada1d3a7aa6cbfd9", "attempt_id": "14a923855f70", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:25.642874Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 1926, "message_tokens": 1843, "message_utf8_bytes": 7892, "cache_tensor_bytes": null, "serialized_payload_bytes": 7892, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.005249981768429279, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.77895802166313, "ttft_ms": 7.2876670164987445, "decode_ms": 570.1371670002118}, "total_wall_ms": 913.8737500179559, "ttft_ms": 7.2876670164987445, "input_usage": {"receiver_prompt_tokens": 1926}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4698963968, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3798108768, "mlx_cache_bytes": 791812972, "process_rss_bytes": 4698963968}, "peak_prefill_memory": null, "peak_decode_memory": 3798108768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "output_hash": "5ae3d4b0264e1bdf0e621aa129b65618e5370c3646dfe9deafac6e3129ee6866"} | ||||
| 434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f4bdff6011c3219bd7a16d0e", "attempt_id": "d2d46fb7a2bf", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:26.932214Z", "task_family": "exec", "document_id": "exec_00201_2000", "document_hash": "065b6c18bbd16f16126924a54946ca4bf95c5863e57b14f33e4c9d88568f8549", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00201_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7892, "cache_tensor_bytes": 53960704, "serialized_payload_bytes": 53973385, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.2533340267837, "doc_prefill_ms": 322.8537921095267, "compress_ms": 1.4466249849647284, "serialize_ms": 12.05145800486207, "load_ms": 1.7732500564306974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.691917006857693, "ttft_ms": 29.691917006857693, "decode_ms": 590.5878749908879}, "total_wall_ms": 624.0524160675704, "ttft_ms": 29.691917006857693, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4752441344, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3378179352, "mlx_cache_bytes": 1631083725, "process_rss_bytes": 4752441344}, "peak_prefill_memory": 3783150176, "peak_decode_memory": 3378179352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00201_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "48c545d2e03d978f28bbd76e2ed2bb4b40affd2373c1de4edfb5eb7b62d5b07c", "output_hash": "5ae3d4b0264e1bdf0e621aa129b65618e5370c3646dfe9deafac6e3129ee6866"} | ||||
| 435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "379fb74e48871d2809eda6ae", "attempt_id": "ef6b8373e91e", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:27.598060Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 1926, "message_tokens": 1843, "message_utf8_bytes": 7665, "cache_tensor_bytes": null, "serialized_payload_bytes": 7665, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009750016033649445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.8904169611633, "ttft_ms": 7.472958997823298, "decode_ms": 570.3191249631345}, "total_wall_ms": 914.3323339521885, "ttft_ms": 7.472958997823298, "input_usage": {"receiver_prompt_tokens": 1926}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4713873408, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3797863008, "mlx_cache_bytes": 806755180, "process_rss_bytes": 4713873408}, "peak_prefill_memory": null, "peak_decode_memory": 3797863008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "09710fe0ec98046d512ae99f", "attempt_id": "4af8191c50e9", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:28.886292Z", "task_family": "exec", "document_id": "exec_00202_2000", "document_hash": "ec13194237af7efe7765a21f1d8303ab8ac449271eb48e3395906648c770bab8", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00202_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7665, "cache_tensor_bytes": 53960704, "serialized_payload_bytes": 53973385, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.212416972965, "doc_prefill_ms": 321.8552089529112, "compress_ms": 0.8870830060914159, "serialize_ms": 11.704749893397093, "load_ms": 1.8737089121714234, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.39829195383936, "ttft_ms": 29.39829195383936, "decode_ms": 588.8986670179293}, "total_wall_ms": 622.1474999329075, "ttft_ms": 29.39829195383936, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4713873408, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3377556760, "mlx_cache_bytes": 1687346381, "process_rss_bytes": 4713873408}, "peak_prefill_memory": 3783150176, "peak_decode_memory": 3377556760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00202_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "48c545d2e03d978f28bbd76e2ed2bb4b40affd2373c1de4edfb5eb7b62d5b07c", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "f97fc75b66ecfc443242a87d", "attempt_id": "334d0c485b84", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:29.550998Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 1924, "message_tokens": 1841, "message_utf8_bytes": 7788, "cache_tensor_bytes": null, "serialized_payload_bytes": 7788, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008834060281515121, "decode_payload_ms": 0.0, "receiver_prefill_ms": 331.2542079947889, "ttft_ms": 7.564166095107794, "decode_ms": 570.4350839368999}, "total_wall_ms": 912.9200830357149, "ttft_ms": 7.564166095107794, "input_usage": {"receiver_prompt_tokens": 1924}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4713873408, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3797469784, "mlx_cache_bytes": 806361956, "process_rss_bytes": 4713873408}, "peak_prefill_memory": null, "peak_decode_memory": 3797469784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "425a7a94a417b54086e55470", "attempt_id": "bca7b99955f4", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:30.837985Z", "task_family": "exec", "document_id": "exec_00203_2000", "document_hash": "39eee37c7ba5fe1b6d8fce9eef4c00e10a33d8ca049d12ae01b9521d4ac60863", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00203_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7788, "cache_tensor_bytes": 53903360, "serialized_payload_bytes": 53916041, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.3817080175504, "doc_prefill_ms": 322.62204203289, "compress_ms": 0.7996250642463565, "serialize_ms": 11.233584024012089, "load_ms": 1.8736670026555657, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.77145800832659, "ttft_ms": 29.77145800832659, "decode_ms": 591.5755840251222}, "total_wall_ms": 625.1627909950912, "ttft_ms": 29.77145800832659, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4713807872, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3377556760, "mlx_cache_bytes": 1686559941, "process_rss_bytes": 4713807872}, "peak_prefill_memory": 3782756952, "peak_decode_memory": 3377556760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00203_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "cae0fb32fa856e76c4f052e580d78750860ad844205ebcc6c55ebd5cfdf92394", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e5ed50f5d7b6d4b9d8f01617", "attempt_id": "a225dd502f05", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:31.505293Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 1937, "message_tokens": 1854, "message_utf8_bytes": 7921, "cache_tensor_bytes": null, "serialized_payload_bytes": 7921, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008041970431804657, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.5160830281675, "ttft_ms": 7.510125054977834, "decode_ms": 569.4468750152737}, "total_wall_ms": 913.1284999893978, "ttft_ms": 7.510125054977834, "input_usage": {"receiver_prompt_tokens": 1937}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4713807872, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3801467532, "mlx_cache_bytes": 810523544, "process_rss_bytes": 4713807872}, "peak_prefill_memory": null, "peak_decode_memory": 3801467532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "35d4f25a31707643c219b37f", "attempt_id": "d4cf95442196", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:32.798347Z", "task_family": "exec", "document_id": "exec_00204_2000", "document_hash": "0aaf1a095160aa21c4485db3b1b171e86d9d41b904ac2a2ea102cc13df19cd22", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00204_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7921, "cache_tensor_bytes": 54276096, "serialized_payload_bytes": 54288777, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 344.3518750136718, "doc_prefill_ms": 324.0345410304144, "compress_ms": 1.463417080231011, "serialize_ms": 14.894249965436757, "load_ms": 1.49891700129956, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.7860000282526, "ttft_ms": 29.7860000282526, "decode_ms": 590.256292023696}, "total_wall_ms": 623.7064159940928, "ttft_ms": 29.7860000282526, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4767842304, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1807736057, "process_rss_bytes": 4767842304}, "peak_prefill_memory": 3787246220, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00204_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "39f526413d98b27eff14043447dd4ffcebfbf299451b832c19078f384e73545a", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6369d94c8f597645eda4bc66", "attempt_id": "a0a6fe628af7", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:33.466530Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 1951, "message_tokens": 1868, "message_utf8_bytes": 7882, "cache_tensor_bytes": null, "serialized_payload_bytes": 7882, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008915900252759457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.4698329670355, "ttft_ms": 7.538667065091431, "decode_ms": 572.4736669799313}, "total_wall_ms": 916.3032920332626, "ttft_ms": 7.538667065091431, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4696031232, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3806284484, "mlx_cache_bytes": 798809040, "process_rss_bytes": 4696031232}, "peak_prefill_memory": null, "peak_decode_memory": 3806284484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b20018f7a1fcddd4d7ed8ccc", "attempt_id": "279dbced7b54", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:34.759310Z", "task_family": "exec", "document_id": "exec_00205_2000", "document_hash": "c82f149ddbd77be80773d103825621fb187f06bb60d4fd570c73c2b3cd898ecb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00205_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 54677504, "serialized_payload_bytes": 54690185, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.45620798133314, "doc_prefill_ms": 322.99337501171976, "compress_ms": 0.8386250119656324, "serialize_ms": 12.727499939501286, "load_ms": 1.4982919674366713, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.99812499526888, "ttft_ms": 28.99812499526888, "decode_ms": 590.046750032343}, "total_wall_ms": 622.6547500118613, "ttft_ms": 28.99812499526888, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4712415232, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1793088817, "process_rss_bytes": 4712415232}, "peak_prefill_memory": 3791817412, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00205_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d89aa2b8ad5a7077f4cb917e448276cae6bd34a1b09d0b94ef094496c04ccb4d", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0437ba281c8b4ba4e1922c28", "attempt_id": "5ee2fc9f760f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:35.425734Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 1924, "message_tokens": 1841, "message_utf8_bytes": 7727, "cache_tensor_bytes": null, "serialized_payload_bytes": 7727, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009207986295223236, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.4941248865798, "ttft_ms": 7.518833968788385, "decode_ms": 569.7973750066012}, "total_wall_ms": 913.7081250082701, "ttft_ms": 7.518833968788385, "input_usage": {"receiver_prompt_tokens": 1924}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4694720512, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3797469784, "mlx_cache_bytes": 789584740, "process_rss_bytes": 4694720512}, "peak_prefill_memory": null, "peak_decode_memory": 3797469784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "output_hash": "8fc2fb9765238f62f6d0120cc019bf477260252d95f246c2530e38ab3bb6d5bb"} | ||||
| 444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "25f6b2424f36ae5e8838d274", "attempt_id": "6d89a95066e3", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:36.716739Z", "task_family": "exec", "document_id": "exec_00206_2000", "document_hash": "e391c9d757bc03677c664222c3ff3f1bbab881d7f566c0072b184e0b90503339", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00206_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200904200}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1841, "source_tokens_receiver": 1841, "query_tokens": 44, "message_tokens": 1880, "message_utf8_bytes": 7727, "cache_tensor_bytes": 53903360, "serialized_payload_bytes": 53916041, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.2942919638008, "doc_prefill_ms": 321.87637500464916, "compress_ms": 1.1623749742284417, "serialize_ms": 13.383916928432882, "load_ms": 1.5241249930113554, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.854333959519863, "ttft_ms": 29.854333959519863, "decode_ms": 590.8130829920992}, "total_wall_ms": 624.0045840386301, "ttft_ms": 29.854333959519863, "input_usage": {"receiver_prefix_tokens": 1880, "dense_cache_bytes": 53903360, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4748853248, "backend_memory": {"mlx_active_bytes": 3258706952, "mlx_peak_bytes": 3378179352, "mlx_cache_bytes": 1686559941, "process_rss_bytes": 4748853248}, "peak_prefill_memory": 3783002712, "peak_decode_memory": 3378179352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00206_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "cae0fb32fa856e76c4f052e580d78750860ad844205ebcc6c55ebd5cfdf92394", "output_hash": "8fc2fb9765238f62f6d0120cc019bf477260252d95f246c2530e38ab3bb6d5bb"} | ||||
| 445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "95ee0d603e9be329827f0786", "attempt_id": "cf0e321fa35f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:37.383286Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 1926, "message_tokens": 1843, "message_utf8_bytes": 7856, "cache_tensor_bytes": null, "serialized_payload_bytes": 7856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008708098903298378, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.67649996560067, "ttft_ms": 7.538292091339827, "decode_ms": 573.7740000477061}, "total_wall_ms": 917.705541010946, "ttft_ms": 7.538292091339827, "input_usage": {"receiver_prompt_tokens": 1926}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4712120320, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3797863008, "mlx_cache_bytes": 807377772, "process_rss_bytes": 4712120320}, "peak_prefill_memory": null, "peak_decode_memory": 3797863008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "output_hash": "392829215db6c90185ee7d3e6f42b9db13fee20b04cae89547cdfb7fc296f6c4"} | ||||
| 446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bdfa5e895339752e18ab31ae", "attempt_id": "298e4569bebc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:38.676943Z", "task_family": "exec", "document_id": "exec_00207_2000", "document_hash": "7d024469b5d38776a899aa870f5af7e146953a19f1adc1d91f634cda62aa4c14", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00207_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200904200}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1843, "source_tokens_receiver": 1843, "query_tokens": 44, "message_tokens": 1882, "message_utf8_bytes": 7856, "cache_tensor_bytes": 53960704, "serialized_payload_bytes": 53973385, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.13704105746, "doc_prefill_ms": 322.00079201720655, "compress_ms": 1.0146250715479255, "serialize_ms": 13.327250024303794, "load_ms": 1.6328750643879175, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.82749999500811, "ttft_ms": 29.82749999500811, "decode_ms": 593.264332972467}, "total_wall_ms": 626.7463340191171, "ttft_ms": 29.82749999500811, "input_usage": {"receiver_prefix_tokens": 1882, "dense_cache_bytes": 53960704, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4748541952, "backend_memory": {"mlx_active_bytes": 3258706952, "mlx_peak_bytes": 3378179352, "mlx_cache_bytes": 1687346381, "process_rss_bytes": 4748541952}, "peak_prefill_memory": 3783150176, "peak_decode_memory": 3378179352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00207_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "48c545d2e03d978f28bbd76e2ed2bb4b40affd2373c1de4edfb5eb7b62d5b07c", "output_hash": "392829215db6c90185ee7d3e6f42b9db13fee20b04cae89547cdfb7fc296f6c4"} | ||||
| 447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2a99cdadf9c2179c5f6cb2f3", "attempt_id": "f665111a3813", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:39.345945Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 1955, "message_tokens": 1872, "message_utf8_bytes": 7854, "cache_tensor_bytes": null, "serialized_payload_bytes": 7854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01025001984089613, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.51700005773455, "ttft_ms": 7.518750033341348, "decode_ms": 570.7194579299539}, "total_wall_ms": 917.5883330171928, "ttft_ms": 7.518750033341348, "input_usage": {"receiver_prompt_tokens": 1955}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4711809024, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3808135892, "mlx_cache_bytes": 818191328, "process_rss_bytes": 4711809024}, "peak_prefill_memory": null, "peak_decode_memory": 3808135892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4c698310bb727aec8da3ffde", "attempt_id": "1b51816e7d5c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:40.639436Z", "task_family": "exec", "document_id": "exec_00208_2000", "document_hash": "8528b3fafcf58b9daa88ffa9d7b9b25fb6e225f9bb767849744c05510a5ace37", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00208_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201199112}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1872, "source_tokens_receiver": 1872, "query_tokens": 44, "message_tokens": 1911, "message_utf8_bytes": 7854, "cache_tensor_bytes": 54792192, "serialized_payload_bytes": 54804873, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.26054199784994, "doc_prefill_ms": 323.38304189033806, "compress_ms": 1.0452090064063668, "serialize_ms": 11.913875001482666, "load_ms": 1.8202500650659204, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.365167069248855, "ttft_ms": 30.365167069248855, "decode_ms": 592.5662920344621}, "total_wall_ms": 626.8345420248806, "ttft_ms": 30.365167069248855, "input_usage": {"receiver_prefix_tokens": 1911, "dense_cache_bytes": 54792192, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4728029184, "backend_memory": {"mlx_active_bytes": 3259919368, "mlx_peak_bytes": 3379784984, "mlx_cache_bytes": 1729912129, "process_rss_bytes": 4728029184}, "peak_prefill_memory": 3793423060, "peak_decode_memory": 3379784984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00208_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2863f75652a8d0a5cc3e9b83740fab24b92c5d5d91a60c2c97c04c140ff596f2", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d552bc31515383abef6fda6f", "attempt_id": "01016566e597", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:41.309005Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 1935, "message_tokens": 1852, "message_utf8_bytes": 7865, "cache_tensor_bytes": null, "serialized_payload_bytes": 7865, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009750016033649445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 333.4972079610452, "ttft_ms": 7.267958950251341, "decode_ms": 569.6508749388158}, "total_wall_ms": 914.109000004828, "ttft_ms": 7.267958950251341, "input_usage": {"receiver_prompt_tokens": 1935}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4710629376, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3801074308, "mlx_cache_bytes": 811047824, "process_rss_bytes": 4710629376}, "peak_prefill_memory": null, "peak_decode_memory": 3801074308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "output_hash": "e335cb56e3da4183737ef16d8f3840631f825c28b05a23e17c44f51ed059703b"} | ||||
| 450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "18ebb6f30fd13581078175fe", "attempt_id": "8892036bec9b", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:42.597492Z", "task_family": "exec", "document_id": "exec_00209_2000", "document_hash": "27a0f4409b3611173adf72865b52c6beef014bce0282fd0498be50deeed192c9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00209_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201199112}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1852, "source_tokens_receiver": 1852, "query_tokens": 44, "message_tokens": 1891, "message_utf8_bytes": 7865, "cache_tensor_bytes": 54218752, "serialized_payload_bytes": 54231433, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.91599997878075, "doc_prefill_ms": 322.9512079851702, "compress_ms": 0.7649590261280537, "serialize_ms": 11.412792024202645, "load_ms": 1.5001250430941582, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.224875033833086, "ttft_ms": 29.224875033833086, "decode_ms": 593.1278339121491}, "total_wall_ms": 625.9511250536889, "ttft_ms": 29.224875033833086, "input_usage": {"receiver_prefix_tokens": 1891, "dense_cache_bytes": 54218752, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4710170624, "backend_memory": {"mlx_active_bytes": 3259001864, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1677319409, "process_rss_bytes": 4710170624}, "peak_prefill_memory": 3786607236, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00209_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7490e57f6ec618e54dcff1d31ace2d7f12cb73a9a40f7d2b35a82279d767a684", "output_hash": "e335cb56e3da4183737ef16d8f3840631f825c28b05a23e17c44f51ed059703b"} | ||||
| 451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "aaec6391301f934e938aae92", "attempt_id": "3504f6288ff4", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:43.265339Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 1947, "message_tokens": 1864, "message_utf8_bytes": 7811, "cache_tensor_bytes": null, "serialized_payload_bytes": 7811, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008916016668081284, "decode_payload_ms": 0.0, "receiver_prefill_ms": 333.36941699963063, "ttft_ms": 7.6441660057753325, "decode_ms": 569.3778749555349}, "total_wall_ms": 914.0631250338629, "ttft_ms": 7.6441660057753325, "input_usage": {"receiver_prompt_tokens": 1947}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4710170624, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3804875444, "mlx_cache_bytes": 815012800, "process_rss_bytes": 4710170624}, "peak_prefill_memory": null, "peak_decode_memory": 3804875444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ac9bf4f60a9f437996cac654", "attempt_id": "5d14aae23bd0", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:44.554241Z", "task_family": "exec", "document_id": "exec_00210_2000", "document_hash": "ffa82307f9b4986f3fc473b8b7df1e4f8f0e1c25d3b6e36cdcf4114a763427c5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00210_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201199112}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7811, "cache_tensor_bytes": 54562816, "serialized_payload_bytes": 54575497, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 339.3297919537872, "doc_prefill_ms": 323.3454170404002, "compress_ms": 0.7748749339953065, "serialize_ms": 11.420792085118592, "load_ms": 1.5532919205725193, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.939375002868474, "ttft_ms": 29.939375002868474, "decode_ms": 593.086792039685}, "total_wall_ms": 626.6208339948207, "ttft_ms": 29.939375002868474, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4709941248, "backend_memory": {"mlx_active_bytes": 3259919368, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1772412193, "process_rss_bytes": 4709941248}, "peak_prefill_memory": 3790408372, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00210_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ce8c00174c975eecff456134891c470100cb84109e8efc56b5f4d3848b9235dc", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "75815089fcab5a466db3a2ee", "attempt_id": "0e60ff1e38df", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:45.223571Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 1920, "message_tokens": 1837, "message_utf8_bytes": 7909, "cache_tensor_bytes": null, "serialized_payload_bytes": 7909, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008207978680729866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 324.9075000640005, "ttft_ms": 7.410582969896495, "decode_ms": 570.4844170249999}, "total_wall_ms": 906.3927920069546, "ttft_ms": 7.410582969896495, "input_usage": {"receiver_prompt_tokens": 1920}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4709941248, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3795618376, "mlx_cache_bytes": 787602260, "process_rss_bytes": 4709941248}, "peak_prefill_memory": null, "peak_decode_memory": 3795618376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "output_hash": "5ae3d4b0264e1bdf0e621aa129b65618e5370c3646dfe9deafac6e3129ee6866"} | ||||
| 454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a0c645fbae4b7f864860edae", "attempt_id": "88f50117d98c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:46.506114Z", "task_family": "exec", "document_id": "exec_00211_2000", "document_hash": "95faa51b0302db54273e9b4469b6eae92c251463238fdad494d437435c293548", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00211_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201199112}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1837, "source_tokens_receiver": 1837, "query_tokens": 44, "message_tokens": 1876, "message_utf8_bytes": 7909, "cache_tensor_bytes": 53788672, "serialized_payload_bytes": 53801353, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.0886250892654, "doc_prefill_ms": 321.71816704794765, "compress_ms": 0.782625051215291, "serialize_ms": 13.56941694393754, "load_ms": 1.396792009472847, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.860082918778062, "ttft_ms": 27.860082918778062, "decode_ms": 592.0465409290045}, "total_wall_ms": 623.4986669151112, "ttft_ms": 27.860082918778062, "input_usage": {"receiver_prefix_tokens": 1876, "dense_cache_bytes": 53788672, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4763959296, "backend_memory": {"mlx_active_bytes": 3259001864, "mlx_peak_bytes": 3377556760, "mlx_cache_bytes": 1738235061, "process_rss_bytes": 4763959296}, "peak_prefill_memory": 3781397064, "peak_decode_memory": 3377556760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00211_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9fe55b7852453683a4a0b4f15af0318ebd11f4813695a0351a619e7378ee8caa", "output_hash": "5ae3d4b0264e1bdf0e621aa129b65618e5370c3646dfe9deafac6e3129ee6866"} | ||||
| 455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a069dfe407a7a835495180b9", "attempt_id": "46e2837be9f0", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:47.174821Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 1951, "message_tokens": 1868, "message_utf8_bytes": 7882, "cache_tensor_bytes": null, "serialized_payload_bytes": 7882, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010458985343575478, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.5178329832852, "ttft_ms": 7.726375013589859, "decode_ms": 571.8200829578564}, "total_wall_ms": 915.8028330421075, "ttft_ms": 7.726375013589859, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4709842944, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3806284484, "mlx_cache_bytes": 816503760, "process_rss_bytes": 4709842944}, "peak_prefill_memory": null, "peak_decode_memory": 3806284484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "941528e6eaceddc2f208a466", "attempt_id": "f4a15b166766", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:48.467249Z", "task_family": "exec", "document_id": "exec_00212_2000", "document_hash": "2be5dc8496484a99fc11a00be474f4f7f139a8f491a2ebf3fff0db8e7804dd82", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00212_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201199112}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1868, "source_tokens_receiver": 1868, "query_tokens": 44, "message_tokens": 1907, "message_utf8_bytes": 7882, "cache_tensor_bytes": 54677504, "serialized_payload_bytes": 54690185, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.27624991722405, "doc_prefill_ms": 324.03812499251217, "compress_ms": 0.7946660043671727, "serialize_ms": 11.61204103846103, "load_ms": 1.4828749699518085, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.76629203092307, "ttft_ms": 28.76629203092307, "decode_ms": 589.6151659544557}, "total_wall_ms": 621.9416670501232, "ttft_ms": 28.76629203092307, "input_usage": {"receiver_prefix_tokens": 1907, "dense_cache_bytes": 54677504, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4705484800, "backend_memory": {"mlx_active_bytes": 3259919368, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1775394097, "process_rss_bytes": 4705484800}, "peak_prefill_memory": 3791817412, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00212_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d89aa2b8ad5a7077f4cb917e448276cae6bd34a1b09d0b94ef094496c04ccb4d", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7b38d0c90d500f78720a34da", "attempt_id": "82b98561a78f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:49.132819Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 1888, "message_tokens": 1805, "message_utf8_bytes": 7695, "cache_tensor_bytes": null, "serialized_payload_bytes": 7695, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009875046089291573, "decode_payload_ms": 0.0, "receiver_prefill_ms": 322.36495800316334, "ttft_ms": 7.495291996747255, "decode_ms": 572.796958964318}, "total_wall_ms": 906.3941660569981, "ttft_ms": 7.495291996747255, "input_usage": {"receiver_prompt_tokens": 1888}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4705484800, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3785001416, "mlx_cache_bytes": 776493780, "process_rss_bytes": 4705484800}, "peak_prefill_memory": null, "peak_decode_memory": 3785001416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "output_hash": "bf7126e9b129977cab3a3e8e5cd58a2732743aa1d9b634885ba31857ab2fc365"} | ||||
| 458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d387c3c1dcc6414b46d368f0", "attempt_id": "0622d6e150e2", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:50.403955Z", "task_family": "exec", "document_id": "exec_00213_2000", "document_hash": "3c65c42333c25f1f3f90331747f08fafce263c8faa11a56d3a68bc58b2217327", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00213_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3199364104}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1805, "source_tokens_receiver": 1805, "query_tokens": 44, "message_tokens": 1844, "message_utf8_bytes": 7695, "cache_tensor_bytes": 52871168, "serialized_payload_bytes": 52883849, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 328.72862508520484, "doc_prefill_ms": 311.2937919795513, "compress_ms": 1.3944579986855388, "serialize_ms": 12.347790994681418, "load_ms": 1.892667030915618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.384708053432405, "ttft_ms": 27.384708053432405, "decode_ms": 591.2702500354499}, "total_wall_ms": 622.582457959652, "ttft_ms": 27.384708053432405, "input_usage": {"receiver_prefix_tokens": 1844, "dense_cache_bytes": 52871168, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4757782528, "backend_memory": {"mlx_active_bytes": 3256249352, "mlx_peak_bytes": 3375328536, "mlx_cache_bytes": 1656822837, "process_rss_bytes": 4757782528}, "peak_prefill_memory": 3770288584, "peak_decode_memory": 3375328536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00213_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "10161d75828f406a25c250d73e083a934c4af8532155b6c3570e00ac07f8b7ee", "output_hash": "bf7126e9b129977cab3a3e8e5cd58a2732743aa1d9b634885ba31857ab2fc365"} | ||||
| 459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d6e9119cf6e31baf89cfba72", "attempt_id": "d794bbf85404", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:51.070801Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 1965, "message_tokens": 1882, "message_utf8_bytes": 7815, "cache_tensor_bytes": null, "serialized_payload_bytes": 7815, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009417068213224411, "decode_payload_ms": 0.0, "receiver_prefill_ms": 339.12537491414696, "ttft_ms": 7.538249948993325, "decode_ms": 570.5082920612767}, "total_wall_ms": 921.0732500068843, "ttft_ms": 7.538249948993325, "input_usage": {"receiver_prompt_tokens": 1965}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4702732288, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3811543804, "mlx_cache_bytes": 820222984, "process_rss_bytes": 4702732288}, "peak_prefill_memory": null, "peak_decode_memory": 3811543804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
| 460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "40f7d938e221b980f4f4af71", "attempt_id": "04201071f993", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:52.386435Z", "task_family": "exec", "document_id": "exec_00214_2000", "document_hash": "ac0a3ee69ec7da626616f6ffb5e443a4f26a3d7857caaa20f1d4ebfa5355d28b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00214_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1882, "source_tokens_receiver": 1882, "query_tokens": 44, "message_tokens": 1921, "message_utf8_bytes": 7815, "cache_tensor_bytes": 55078912, "serialized_payload_bytes": 55091593, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.76849994342774, "doc_prefill_ms": 331.78216707892716, "compress_ms": 1.5659999335184693, "serialize_ms": 19.40150000154972, "load_ms": 1.4406249392777681, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.04104201681912, "ttft_ms": 30.04104201681912, "decode_ms": 594.1533750155941}, "total_wall_ms": 627.5883329799399, "ttft_ms": 30.04104201681912, "input_usage": {"receiver_prefix_tokens": 1921, "dense_cache_bytes": 55078912, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4813799424, "backend_memory": {"mlx_active_bytes": 3261131784, "mlx_peak_bytes": 3381390616, "mlx_cache_bytes": 1773788521, "process_rss_bytes": 4813799424}, "peak_prefill_memory": 3797322492, "peak_decode_memory": 3381390616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00214_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3044b676ed314e95679c4bc8c92908467be502bfef2b28716bbbcb3e69069177", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
| 461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "391427855247d16f09186d01", "attempt_id": "0823ac747082", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:53.057620Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 1948, "message_tokens": 1865, "message_utf8_bytes": 7894, "cache_tensor_bytes": null, "serialized_payload_bytes": 7894, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.0113749410957098, "decode_payload_ms": 0.0, "receiver_prefill_ms": 333.4968750132248, "ttft_ms": 7.552750059403479, "decode_ms": 571.2791249388829}, "total_wall_ms": 916.0509170033038, "ttft_ms": 7.552750059403479, "input_usage": {"receiver_prompt_tokens": 1948}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4742594560, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3805694648, "mlx_cache_bytes": 799136708, "process_rss_bytes": 4742594560}, "peak_prefill_memory": null, "peak_decode_memory": 3805694648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "4a1e6e56e01a6537093bee50", "attempt_id": "99b177241e3e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:54.351480Z", "task_family": "exec", "document_id": "exec_00215_2000", "document_hash": "a4094c70181359b8442ead384be9497e3fb0c46a4d9266cce07ca77bd9e26e2b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00215_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201821704}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7894, "cache_tensor_bytes": 54591488, "serialized_payload_bytes": 54604169, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.5879999520257, "doc_prefill_ms": 323.4458330553025, "compress_ms": 1.0435000294819474, "serialize_ms": 13.21970799472183, "load_ms": 1.5445410972461104, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.124832992441952, "ttft_ms": 30.124832992441952, "decode_ms": 592.3409999813884}, "total_wall_ms": 626.0172079782933, "ttft_ms": 30.124832992441952, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4797546496, "backend_memory": {"mlx_active_bytes": 3260541960, "mlx_peak_bytes": 3379784984, "mlx_cache_bytes": 1773215013, "process_rss_bytes": 4797546496}, "peak_prefill_memory": 3790850744, "peak_decode_memory": 3379784984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 2:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00215_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "4dd77a1684e42b16e8d6d475b3b2a047619223fa3a6596f757dd9f356d41b4a9", "output_hash": "111af72c94374b97bacc5d052d35b957f391e1f675a32029199f2086f21def08"} | ||||
| 463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "43f5f63299bbc9bbe51628b6", "attempt_id": "230867d9de11", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:55.020209Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 2001, "message_tokens": 1918, "message_utf8_bytes": 7838, "cache_tensor_bytes": null, "serialized_payload_bytes": 7838, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010291929356753826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 341.39487496577203, "ttft_ms": 7.3810419999063015, "decode_ms": 570.3976249787956}, "total_wall_ms": 922.8053750703111, "ttft_ms": 7.3810419999063015, "input_usage": {"receiver_prompt_tokens": 2001}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4760190976, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3823324044, "mlx_cache_bytes": 904748184, "process_rss_bytes": 4760190976}, "peak_prefill_memory": null, "peak_decode_memory": 3823324044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "output_hash": "392829215db6c90185ee7d3e6f42b9db13fee20b04cae89547cdfb7fc296f6c4"} | ||||
| 464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "0fddcc691919e3810705631a", "attempt_id": "a303b1cbb7a5", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:56.337734Z", "task_family": "exec", "document_id": "exec_00216_2000", "document_hash": "1a218de32e6fe4bbe97927ea16330bda3b598ed66c1517824d94ff90f944e802", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00216_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3203181576}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1918, "source_tokens_receiver": 1918, "query_tokens": 44, "message_tokens": 1957, "message_utf8_bytes": 7838, "cache_tensor_bytes": 56111104, "serialized_payload_bytes": 56123789, "side_information_bytes": 12685, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 358.70575008448213, "doc_prefill_ms": 335.07570798974484, "compress_ms": 1.4949589967727661, "serialize_ms": 18.349124933592975, "load_ms": 1.8857920076698065, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.034500057809055, "ttft_ms": 30.034500057809055, "decode_ms": 593.6114999931306}, "total_wall_ms": 627.4071659427136, "ttft_ms": 30.034500057809055, "input_usage": {"receiver_prefix_tokens": 1957, "dense_cache_bytes": 56111104, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4873240576, "backend_memory": {"mlx_active_bytes": 3263736840, "mlx_peak_bytes": 3375721744, "mlx_cache_bytes": 1919327737, "process_rss_bytes": 4873240576}, "peak_prefill_memory": 3808873356, "peak_decode_memory": 3375721744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00216_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1ee1b478b5c1daee4230fa7c720f735a9763cb8f14c525886e72b5af4dcda8cd", "output_hash": "392829215db6c90185ee7d3e6f42b9db13fee20b04cae89547cdfb7fc296f6c4"} | ||||
| 465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d33ea10a4b4d0f9e182f43b0", "attempt_id": "946797613f75", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:57.010573Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 1921, "message_tokens": 1838, "message_utf8_bytes": 7764, "cache_tensor_bytes": null, "serialized_payload_bytes": 7764, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008790986612439156, "decode_payload_ms": 0.0, "receiver_prefill_ms": 324.73079196643084, "ttft_ms": 7.686082972213626, "decode_ms": 572.9205419775099}, "total_wall_ms": 908.9557499391958, "ttft_ms": 7.686082972213626, "input_usage": {"receiver_prompt_tokens": 1921}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4808425472, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3795814988, "mlx_cache_bytes": 807476056, "process_rss_bytes": 4808425472}, "peak_prefill_memory": null, "peak_decode_memory": 3795814988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "836d76a7e7569988c64b0d27", "attempt_id": "a5c5e9fb1df5", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:58.296303Z", "task_family": "exec", "document_id": "exec_00217_2000", "document_hash": "1223c7391b1da1aeae2d242c0e41de4639218cfe0c90ba9065f1cce42f0eedbd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00217_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200576520}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7764, "cache_tensor_bytes": 53817344, "serialized_payload_bytes": 53830025, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.1110420236364, "doc_prefill_ms": 321.6483329888433, "compress_ms": 1.9072089344263077, "serialize_ms": 12.805834063328803, "load_ms": 1.5049169305711985, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.59275008086115, "ttft_ms": 28.59275008086115, "decode_ms": 592.1798750059679}, "total_wall_ms": 624.370374949649, "ttft_ms": 28.59275008086115, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 4862410752, "backend_memory": {"mlx_active_bytes": 3258379272, "mlx_peak_bytes": 3378621720, "mlx_cache_bytes": 1627462841, "process_rss_bytes": 4862410752}, "peak_prefill_memory": 3781593676, "peak_decode_memory": 3378621720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00217_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dc917898b47191cebec556ff4942abd79e8a276c34c32faf7625fc4f520d7954", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "eae27b2c5573eff981a47f19", "attempt_id": "78e851153fff", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:58:58.962791Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 1913, "message_tokens": 1830, "message_utf8_bytes": 7776, "cache_tensor_bytes": null, "serialized_payload_bytes": 7776, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009834067896008492, "decode_payload_ms": 0.0, "receiver_prefill_ms": 323.5673749586567, "ttft_ms": 7.620208081789315, "decode_ms": 571.4866250054911}, "total_wall_ms": 912.7191659063101, "ttft_ms": 7.620208081789315, "input_usage": {"receiver_prompt_tokens": 1913}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3590291456, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3793619500, "mlx_cache_bytes": 784898872, "process_rss_bytes": 3590291456}, "peak_prefill_memory": null, "peak_decode_memory": 3793619500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "897fc8c320f7bf73d7e1888b", "attempt_id": "4532d8d39f9c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:00.249110Z", "task_family": "exec", "document_id": "exec_00218_2000", "document_hash": "971d94c4e7b4ae02142ffb6eb92af9d2cc0f6e4d52e94a64c5132b510197ce8a", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00218_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200576520}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1830, "source_tokens_receiver": 1830, "query_tokens": 44, "message_tokens": 1869, "message_utf8_bytes": 7776, "cache_tensor_bytes": 53587968, "serialized_payload_bytes": 53600649, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.03320792503655, "doc_prefill_ms": 321.63470797240734, "compress_ms": 0.777167035266757, "serialize_ms": 11.906000087037683, "load_ms": 1.5362920239567757, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.916292056441307, "ttft_ms": 29.916292056441307, "decode_ms": 593.0408330168575}, "total_wall_ms": 626.4486669097096, "ttft_ms": 29.916292056441307, "input_usage": {"receiver_prefix_tokens": 1869, "dense_cache_bytes": 53587968, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3606708224, "backend_memory": {"mlx_active_bytes": 3258379272, "mlx_peak_bytes": 3376934168, "mlx_cache_bytes": 1761598617, "process_rss_bytes": 3606708224}, "peak_prefill_memory": 3779152428, "peak_decode_memory": 3376934168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00218_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7ac2a53a914d7455b82c3cba0f21526a0af91b5631f3f5bd9b29dc56a68686f1", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "bfd17172d3a1d1541be9fbdd", "attempt_id": "42a4cd6b4823", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:00.917322Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 1937, "message_tokens": 1854, "message_utf8_bytes": 7938, "cache_tensor_bytes": null, "serialized_payload_bytes": 7938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008209026418626308, "decode_payload_ms": 0.0, "receiver_prefill_ms": 333.8072079932317, "ttft_ms": 7.433707942254841, "decode_ms": 571.8073749449104}, "total_wall_ms": 916.535333963111, "ttft_ms": 7.433707942254841, "input_usage": {"receiver_prompt_tokens": 1937}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3589292032, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3801467532, "mlx_cache_bytes": 810818456, "process_rss_bytes": 3589292032}, "peak_prefill_memory": null, "peak_decode_memory": 3801467532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b606caf51d3ab31e6f59e2b8", "attempt_id": "f1247a1407a9", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:02.211390Z", "task_family": "exec", "document_id": "exec_00219_2000", "document_hash": "390edd848add1a4cf011660e8ac9a6a6aa381c4508a8f68635f3217ce20979cb", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00219_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1854, "source_tokens_receiver": 1854, "query_tokens": 44, "message_tokens": 1893, "message_utf8_bytes": 7938, "cache_tensor_bytes": 54276096, "serialized_payload_bytes": 54288777, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.9480419252068, "doc_prefill_ms": 323.9872910780832, "compress_ms": 1.0400000028312206, "serialize_ms": 12.974375043995678, "load_ms": 1.5460830181837082, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.257083078846335, "ttft_ms": 29.257083078846335, "decode_ms": 591.0810839850456}, "total_wall_ms": 623.9499159855768, "ttft_ms": 29.257083078846335, "input_usage": {"receiver_prefix_tokens": 1893, "dense_cache_bytes": 54276096, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3644030976, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1790336249, "process_rss_bytes": 3644030976}, "peak_prefill_memory": 3787000460, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00219_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "39f526413d98b27eff14043447dd4ffcebfbf299451b832c19078f384e73545a", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "c6d3ec7835724024dc1b56bd", "attempt_id": "d38b295c360c", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:02.879511Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 1944, "message_tokens": 1861, "message_utf8_bytes": 7750, "cache_tensor_bytes": null, "serialized_payload_bytes": 7750, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009082956239581108, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.45908305980265, "ttft_ms": 7.5617090333253145, "decode_ms": 571.6721250209957}, "total_wall_ms": 915.3593749506399, "ttft_ms": 7.5617090333253145, "input_usage": {"receiver_prompt_tokens": 1944}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3589603328, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3804285608, "mlx_cache_bytes": 796728244, "process_rss_bytes": 3589603328}, "peak_prefill_memory": null, "peak_decode_memory": 3804285608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e97b9298038ef5ac6117c95e", "attempt_id": "1f734a83fa37", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:04.171228Z", "task_family": "exec", "document_id": "exec_00220_2000", "document_hash": "31eca9e7afc70ac5a795edc1d1529c531e0d028342802a61f4496c013e13bf45", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00220_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7750, "cache_tensor_bytes": 54476800, "serialized_payload_bytes": 54489481, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.5792500125244, "doc_prefill_ms": 323.64995894022286, "compress_ms": 0.8697089506313205, "serialize_ms": 12.317291926592588, "load_ms": 1.773957978002727, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.937499901279807, "ttft_ms": 29.937499901279807, "decode_ms": 591.4679589914158}, "total_wall_ms": 625.2293749712408, "ttft_ms": 29.937499901279807, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3605659648, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1788927253, "process_rss_bytes": 3605659648}, "peak_prefill_memory": 3789818536, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00220_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7925008c3ad7448bdb8e9604040f2342903baa45c8a420d342a51df8931569b4", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "55e63653cd14f44ca5ba9c59", "attempt_id": "5ad79b65ec99", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:04.839810Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 1978, "message_tokens": 1895, "message_utf8_bytes": 7638, "cache_tensor_bytes": null, "serialized_payload_bytes": 7638, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009582960046827793, "decode_payload_ms": 0.0, "receiver_prefill_ms": 337.5406250124797, "ttft_ms": 7.452874910086393, "decode_ms": 569.6522910147905}, "total_wall_ms": 918.3281670557335, "ttft_ms": 7.452874910086393, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3587964928, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3815541552, "mlx_cache_bytes": 896244796, "process_rss_bytes": 3587964928}, "peak_prefill_memory": null, "peak_decode_memory": 3815541552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "37102a5c1d9a5cab5d052a8f", "attempt_id": "0568ae28fa98", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:06.144876Z", "task_family": "exec", "document_id": "exec_00221_2000", "document_hash": "e228dfaa0d04173ee28b43513e5fc06914edf5d0c02b09bf0fc534531a583669", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00221_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202411528}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1895, "source_tokens_receiver": 1895, "query_tokens": 44, "message_tokens": 1934, "message_utf8_bytes": 7638, "cache_tensor_bytes": 55451648, "serialized_payload_bytes": 55464329, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 350.2036250429228, "doc_prefill_ms": 331.40604104846716, "compress_ms": 1.264750026166439, "serialize_ms": 13.731249957345426, "load_ms": 1.8546669743955135, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.23287490941584, "ttft_ms": 30.23287490941584, "decode_ms": 590.5694999964908}, "total_wall_ms": 624.7317079687491, "ttft_ms": 30.23287490941584, "input_usage": {"receiver_prefix_tokens": 1934, "dense_cache_bytes": 55451648, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3699408896, "backend_memory": {"mlx_active_bytes": 3262049288, "mlx_peak_bytes": 3381390616, "mlx_cache_bytes": 1924521373, "process_rss_bytes": 3699408896}, "peak_prefill_memory": 3801074480, "peak_decode_memory": 3381390616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00221_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ed20e0227649021c7991548a86969da979163bb9c4669386545f207c66d6bb5b", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b1c6803098034d64368faab4", "attempt_id": "c990ebdf9ce6", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:06.814416Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 1905, "message_tokens": 1822, "message_utf8_bytes": 7878, "cache_tensor_bytes": null, "serialized_payload_bytes": 7878, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008208095096051693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 324.7435000957921, "ttft_ms": 7.452500052750111, "decode_ms": 571.843707934022}, "total_wall_ms": 907.641707919538, "ttft_ms": 7.452500052750111, "input_usage": {"receiver_prompt_tokens": 1905}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3644063744, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3790850572, "mlx_cache_bytes": 783555352, "process_rss_bytes": 3644063744}, "peak_prefill_memory": null, "peak_decode_memory": 3790850572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "03bf1dc468e918b69d7b09ab", "attempt_id": "ad1b4be7d722", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:08.096892Z", "task_family": "exec", "document_id": "exec_00222_2000", "document_hash": "040260f25a42680fcc038386368506adaa004bc2592e75e3fbb5903b54cc19ab", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00222_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1822, "source_tokens_receiver": 1822, "query_tokens": 44, "message_tokens": 1861, "message_utf8_bytes": 7878, "cache_tensor_bytes": 53358592, "serialized_payload_bytes": 53371273, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 339.11716693546623, "doc_prefill_ms": 322.1360830357298, "compress_ms": 1.4220000011846423, "serialize_ms": 11.7624580161646, "load_ms": 1.7795420717447996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.237124952487648, "ttft_ms": 29.237124952487648, "decode_ms": 587.3489170335233}, "total_wall_ms": 620.468792039901, "ttft_ms": 29.237124952487648, "input_usage": {"receiver_prefix_tokens": 1861, "dense_cache_bytes": 53358592, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3697967104, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3377261848, "mlx_cache_bytes": 1670978681, "process_rss_bytes": 3697967104}, "peak_prefill_memory": 3776137740, "peak_decode_memory": 3377261848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00222_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "fa6306adb1425365cc826c622353aa53e20a1e32a03beb227b5c0c6a75a9d99f", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6dab4dad2ff9c613415cee15", "attempt_id": "d37b87da38e5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:08.759588Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 1915, "message_tokens": 1832, "message_utf8_bytes": 7813, "cache_tensor_bytes": null, "serialized_payload_bytes": 7813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008207978680729866, "decode_payload_ms": 0.0, "receiver_prefill_ms": 323.96987499669194, "ttft_ms": 7.615207927301526, "decode_ms": 566.7075839592144}, "total_wall_ms": 902.1181670250371, "ttft_ms": 7.615207927301526, "input_usage": {"receiver_prompt_tokens": 1915}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3659988992, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3794012724, "mlx_cache_bytes": 802691904, "process_rss_bytes": 3659988992}, "peak_prefill_memory": null, "peak_decode_memory": 3794012724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "fda4ada2ad41df5b8b0fa192", "attempt_id": "31079026caf6", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:10.035097Z", "task_family": "exec", "document_id": "exec_00223_2000", "document_hash": "7eef13486249d89cf05bda367ea9dae2ce2479b2236c1917b2f067c49a981619", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00223_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7813, "cache_tensor_bytes": 53645312, "serialized_payload_bytes": 53657993, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 337.7703339792788, "doc_prefill_ms": 321.9052500789985, "compress_ms": 0.8625829359516501, "serialize_ms": 11.271459050476551, "load_ms": 1.6366669442504644, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.580082977190614, "ttft_ms": 29.580082977190614, "decode_ms": 592.0056250179186}, "total_wall_ms": 625.1819169847295, "ttft_ms": 29.580082977190614, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3659366400, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3376934168, "mlx_cache_bytes": 1744985249, "process_rss_bytes": 3659366400}, "peak_prefill_memory": 3779545652, "peak_decode_memory": 3376934168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00223_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "99892a6c5be0ff70400e85633e9213a83ad338aae198e2b7b0e81cd7b3ec450d", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "ce60f47cc6de9e832f40fda1", "attempt_id": "6d595c33310c", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:10.702784Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 1917, "message_tokens": 1834, "message_utf8_bytes": 7739, "cache_tensor_bytes": null, "serialized_payload_bytes": 7739, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00900006853044033, "decode_payload_ms": 0.0, "receiver_prefill_ms": 324.46387491654605, "ttft_ms": 7.623041979968548, "decode_ms": 564.6418340038508}, "total_wall_ms": 900.536583038047, "ttft_ms": 7.623041979968548, "input_usage": {"receiver_prompt_tokens": 1917}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3659366400, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3795028540, "mlx_cache_bytes": 803789640, "process_rss_bytes": 3659366400}, "peak_prefill_memory": null, "peak_decode_memory": 3795028540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "output_hash": "3d96bef102c74d3992df6f0c65cdf277a7c3fb567e96aef4380302125d4278b0"} | ||||
| 480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8cf422c889676c3f39040e48", "attempt_id": "97a790a0af3e", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:11.980017Z", "task_family": "exec", "document_id": "exec_00224_2000", "document_hash": "3e642abb57841365b827053f2437a250dcb419539389820bac778d4596c064fd", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00224_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1834, "source_tokens_receiver": 1834, "query_tokens": 44, "message_tokens": 1873, "message_utf8_bytes": 7739, "cache_tensor_bytes": 53702656, "serialized_payload_bytes": 53715337, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.972624973394, "doc_prefill_ms": 322.2287920070812, "compress_ms": 0.7900409400463104, "serialize_ms": 11.520916013978422, "load_ms": 1.5115420101210475, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.423916013911366, "ttft_ms": 29.423916013911366, "decode_ms": 591.5027090813965}, "total_wall_ms": 624.5275000110269, "ttft_ms": 29.423916013911366, "input_usage": {"receiver_prefix_tokens": 1873, "dense_cache_bytes": 53702656, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3658596352, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3376934168, "mlx_cache_bytes": 1747180713, "process_rss_bytes": 3658596352}, "peak_prefill_memory": 3780561468, "peak_decode_memory": 3376934168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00224_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a6d604c9b78fa328d4bafd9caa3922205308e970460c4ade468aba9590d05a9f", "output_hash": "3d96bef102c74d3992df6f0c65cdf277a7c3fb567e96aef4380302125d4278b0"} | ||||
| 481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "24a4549e1aa9fee046001895", "attempt_id": "ba7727e24a00", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:12.646887Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 1911, "message_tokens": 1828, "message_utf8_bytes": 7819, "cache_tensor_bytes": null, "serialized_payload_bytes": 7819, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010333023965358734, "decode_payload_ms": 0.0, "receiver_prefill_ms": 325.34745894372463, "ttft_ms": 7.472791010513902, "decode_ms": 566.0220830468461}, "total_wall_ms": 902.5301249930635, "ttft_ms": 7.472791010513902, "input_usage": {"receiver_prompt_tokens": 1911}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3658596352, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3793226276, "mlx_cache_bytes": 801905456, "process_rss_bytes": 3658596352}, "peak_prefill_memory": null, "peak_decode_memory": 3793226276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d2e3cd8e92e76e4a8a916bdc", "attempt_id": "3155163c14de", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:13.923635Z", "task_family": "exec", "document_id": "exec_00225_2000", "document_hash": "54918c16a4ae3706a87d182112fca2a39c82c77e3a60fd25a8b47b958f2a6b21", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00225_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1828, "source_tokens_receiver": 1828, "query_tokens": 44, "message_tokens": 1867, "message_utf8_bytes": 7819, "cache_tensor_bytes": 53530624, "serialized_payload_bytes": 53543305, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 337.7868749666959, "doc_prefill_ms": 321.2476250482723, "compress_ms": 0.8420000085607171, "serialize_ms": 11.503249988891184, "load_ms": 1.6042080242186785, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.906167066656053, "ttft_ms": 29.906167066656053, "decode_ms": 589.7793340263888}, "total_wall_ms": 623.3285419875756, "ttft_ms": 29.906167066656053, "input_usage": {"receiver_prefix_tokens": 1867, "dense_cache_bytes": 53530624, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3658481664, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3376934168, "mlx_cache_bytes": 1743412369, "process_rss_bytes": 3658481664}, "peak_prefill_memory": 3778759204, "peak_decode_memory": 3376934168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00225_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "4c1f54aeda4fc5f6ac1b77dcd7c878a8703dd8bb3414c3c39212e1b10b24eede", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e914015c6250d07502a6ed9d", "attempt_id": "8580f8f36558", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:14.589137Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 1915, "message_tokens": 1832, "message_utf8_bytes": 7793, "cache_tensor_bytes": null, "serialized_payload_bytes": 7793, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008791917935013771, "decode_payload_ms": 0.0, "receiver_prefill_ms": 325.4522500792518, "ttft_ms": 7.420709007419646, "decode_ms": 570.3871659934521}, "total_wall_ms": 906.8087919149548, "ttft_ms": 7.420709007419646, "input_usage": {"receiver_prompt_tokens": 1915}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3658481664, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3794012724, "mlx_cache_bytes": 802691904, "process_rss_bytes": 3658481664}, "peak_prefill_memory": null, "peak_decode_memory": 3794012724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "3a5d06cfe4346330aff5451c", "attempt_id": "f59f745c3648", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:15.869769Z", "task_family": "exec", "document_id": "exec_00226_2000", "document_hash": "7a73067df93b17aba1a608bce48f7a6ff16d480af8d23713ec889405f279fc7d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00226_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1832, "source_tokens_receiver": 1832, "query_tokens": 44, "message_tokens": 1871, "message_utf8_bytes": 7793, "cache_tensor_bytes": 53645312, "serialized_payload_bytes": 53657993, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.17029104102403, "doc_prefill_ms": 322.73374998476356, "compress_ms": 0.7837919984012842, "serialize_ms": 11.005874956026673, "load_ms": 1.4384160749614239, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.933208948932588, "ttft_ms": 29.933208948932588, "decode_ms": 592.3213330097497}, "total_wall_ms": 625.9241249645129, "ttft_ms": 29.933208948932588, "input_usage": {"receiver_prefix_tokens": 1871, "dense_cache_bytes": 53645312, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3658432512, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3376934168, "mlx_cache_bytes": 1744985249, "process_rss_bytes": 3658432512}, "peak_prefill_memory": 3779545652, "peak_decode_memory": 3376934168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00226_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "99892a6c5be0ff70400e85633e9213a83ad338aae198e2b7b0e81cd7b3ec450d", "output_hash": "2e4bfac8408f7d47a44418589c435d6b558b60fa1b0c3f55946b9a4e4d436727"} | ||||
| 485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6c488b1c839dc04b1d5b51ea", "attempt_id": "a16223fdc794", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:16.539551Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 1947, "message_tokens": 1864, "message_utf8_bytes": 7895, "cache_tensor_bytes": null, "serialized_payload_bytes": 7895, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009082956239581108, "decode_payload_ms": 0.0, "receiver_prefill_ms": 341.15829202346504, "ttft_ms": 7.513790973462164, "decode_ms": 566.7082079453394}, "total_wall_ms": 919.3622909951955, "ttft_ms": 7.513790973462164, "input_usage": {"receiver_prompt_tokens": 1947}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3658432512, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3804875444, "mlx_cache_bytes": 814095296, "process_rss_bytes": 3658432512}, "peak_prefill_memory": null, "peak_decode_memory": 3804875444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "535d942b790aecd2f693ef3d", "attempt_id": "e25649cb9a74", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:17.838204Z", "task_family": "exec", "document_id": "exec_00227_2000", "document_hash": "6afe19e10d57be0082db797187045b004680fa22a13a56a7b8f7e2a51b40597d", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00227_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1864, "source_tokens_receiver": 1864, "query_tokens": 44, "message_tokens": 1903, "message_utf8_bytes": 7895, "cache_tensor_bytes": 54562816, "serialized_payload_bytes": 54575497, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 342.13408397044986, "doc_prefill_ms": 323.70999990962446, "compress_ms": 1.449999981559813, "serialize_ms": 13.084916048683226, "load_ms": 1.5038750134408474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.921249952167273, "ttft_ms": 29.921249952167273, "decode_ms": 587.8782919608057}, "total_wall_ms": 621.4594159973785, "ttft_ms": 29.921249952167273, "input_usage": {"receiver_prefix_tokens": 1903, "dense_cache_bytes": 54562816, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3712598016, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1844239649, "process_rss_bytes": 3712598016}, "peak_prefill_memory": 3790654132, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00227_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "ce8c00174c975eecff456134891c470100cb84109e8efc56b5f4d3848b9235dc", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "5e39ac9ef077868889e4823c", "attempt_id": "26121fce4b3d", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:18.502226Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 1950, "message_tokens": 1867, "message_utf8_bytes": 7815, "cache_tensor_bytes": null, "serialized_payload_bytes": 7815, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.55258307326585, "ttft_ms": 7.578040938824415, "decode_ms": 566.4804578991607}, "total_wall_ms": 910.4018330108374, "ttft_ms": 7.578040938824415, "input_usage": {"receiver_prompt_tokens": 1950}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3640770560, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3806087872, "mlx_cache_bytes": 798612428, "process_rss_bytes": 3640770560}, "peak_prefill_memory": null, "peak_decode_memory": 3806087872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "output_hash": "bf7126e9b129977cab3a3e8e5cd58a2732743aa1d9b634885ba31857ab2fc365"} | ||||
| 488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6a88426c95f324eea4351d6c", "attempt_id": "2e7a226889fa", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:19.790083Z", "task_family": "exec", "document_id": "exec_00228_2000", "document_hash": "08d5c40fa24cccbcccaac14d408c241ab602604a712b727f12f570eb56887a74", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00228_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7815, "cache_tensor_bytes": 54648832, "serialized_payload_bytes": 54661513, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.30866604391485, "doc_prefill_ms": 323.3345829648897, "compress_ms": 0.8053330238908529, "serialize_ms": 13.247083057649434, "load_ms": 1.538792042993009, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.786207946017385, "ttft_ms": 29.786207946017385, "decode_ms": 589.8149169515818}, "total_wall_ms": 622.9422090109438, "ttft_ms": 29.786207946017385, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3713138688, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1792695597, "process_rss_bytes": 3713138688}, "peak_prefill_memory": 3791620800, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00228_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "406d919908d935ece285f7a844af89faeccb0cdba3237783361be90d7cabdc8a", "output_hash": "bf7126e9b129977cab3a3e8e5cd58a2732743aa1d9b634885ba31857ab2fc365"} | ||||
| 489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "774392db9d7e180517be9532", "attempt_id": "3a44c05b3e83", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:20.455123Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 1948, "message_tokens": 1865, "message_utf8_bytes": 7723, "cache_tensor_bytes": null, "serialized_payload_bytes": 7723, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008499948307871819, "decode_payload_ms": 0.0, "receiver_prefill_ms": 334.20908299740404, "ttft_ms": 7.373624946922064, "decode_ms": 566.7367919813842}, "total_wall_ms": 911.8906250223517, "ttft_ms": 7.373624946922064, "input_usage": {"receiver_prompt_tokens": 1948}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3695443968, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3805694648, "mlx_cache_bytes": 798219204, "process_rss_bytes": 3695443968}, "peak_prefill_memory": null, "peak_decode_memory": 3805694648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6f591100cb2f26be9244ce9b", "attempt_id": "15ebc283737c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:21.742194Z", "task_family": "exec", "document_id": "exec_00229_2000", "document_hash": "b6a34443a51bb95703036fc2467d0c50ad248f99f3c11c0a35d6bc7fcf0ad481", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00229_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1865, "source_tokens_receiver": 1865, "query_tokens": 44, "message_tokens": 1904, "message_utf8_bytes": 7723, "cache_tensor_bytes": 54591488, "serialized_payload_bytes": 54604169, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 339.9120829999447, "doc_prefill_ms": 322.98824994359165, "compress_ms": 0.8531659841537476, "serialize_ms": 12.358542066067457, "load_ms": 1.5186249511316419, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.273708049207926, "ttft_ms": 30.273708049207926, "decode_ms": 589.3308750819415}, "total_wall_ms": 623.1957079144195, "ttft_ms": 30.273708049207926, "input_usage": {"receiver_prefix_tokens": 1904, "dense_cache_bytes": 54591488, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3713073152, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1791204645, "process_rss_bytes": 3713073152}, "peak_prefill_memory": 3790604984, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00229_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "4dd77a1684e42b16e8d6d475b3b2a047619223fa3a6596f757dd9f356d41b4a9", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8a5cc58ba0fc71e3c1fc4ec6", "attempt_id": "7b2c8b443d2f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:22.407851Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 1929, "message_tokens": 1846, "message_utf8_bytes": 7830, "cache_tensor_bytes": null, "serialized_payload_bytes": 7830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008875038474798203, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.7608340186998, "ttft_ms": 7.3748750146478415, "decode_ms": 567.9317910689861}, "total_wall_ms": 911.6338751045987, "ttft_ms": 7.3748750146478415, "input_usage": {"receiver_prompt_tokens": 1929}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3695378432, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3799075436, "mlx_cache_bytes": 791272312, "process_rss_bytes": 3695378432}, "peak_prefill_memory": null, "peak_decode_memory": 3799075436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e4d7f2ee03e58ffb8b5b6acc", "attempt_id": "d86241fc3f68", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:23.695995Z", "task_family": "exec", "document_id": "exec_00230_2000", "document_hash": "cbb9dba4a75d2570390205536d928042eae0341c49e7dcc11a2cea988c175ba9", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00230_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200904200}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1846, "source_tokens_receiver": 1846, "query_tokens": 44, "message_tokens": 1885, "message_utf8_bytes": 7830, "cache_tensor_bytes": 54046720, "serialized_payload_bytes": 54059401, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.65808297600597, "doc_prefill_ms": 322.40862504113466, "compress_ms": 1.229582936502993, "serialize_ms": 13.171166996471584, "load_ms": 1.717416918836534, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.786165920086205, "ttft_ms": 29.786165920086205, "decode_ms": 588.2114169653505}, "total_wall_ms": 621.9477500999346, "ttft_ms": 29.786165920086205, "input_usage": {"receiver_prefix_tokens": 1885, "dense_cache_bytes": 54046720, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3748986880, "backend_memory": {"mlx_active_bytes": 3258706952, "mlx_peak_bytes": 3378179352, "mlx_cache_bytes": 1689935065, "process_rss_bytes": 3748986880}, "peak_prefill_memory": 3784608364, "peak_decode_memory": 3378179352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00230_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "721b47d0372723e69fab5a8807a677ff2232dd66e8b87400e61444630a8ab614", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a282c613dcdfcd9f6d51d764", "attempt_id": "86335098fab5", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:24.361286Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 1944, "message_tokens": 1861, "message_utf8_bytes": 7895, "cache_tensor_bytes": null, "serialized_payload_bytes": 7895, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010499963536858559, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.8150419984013, "ttft_ms": 7.523000007495284, "decode_ms": 567.3002089606598}, "total_wall_ms": 911.3964579300955, "ttft_ms": 7.523000007495284, "input_usage": {"receiver_prompt_tokens": 1944}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3712253952, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3804285608, "mlx_cache_bytes": 814128052, "process_rss_bytes": 3712253952}, "peak_prefill_memory": null, "peak_decode_memory": 3804285608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "7a85b575537d28966fbc4954", "attempt_id": "8c4ae3ff8fe0", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:25.650604Z", "task_family": "exec", "document_id": "exec_00231_2000", "document_hash": "b599ec4f6ea744baef17b36d05ab828f105675eeebf81a780befd49f389ec9d3", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00231_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1861, "source_tokens_receiver": 1861, "query_tokens": 44, "message_tokens": 1900, "message_utf8_bytes": 7895, "cache_tensor_bytes": 54476800, "serialized_payload_bytes": 54489481, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 340.9303749212995, "doc_prefill_ms": 324.11649997811764, "compress_ms": 0.804334064014256, "serialize_ms": 12.163290986791253, "load_ms": 1.4991250354796648, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.9143340671435, "ttft_ms": 29.9143340671435, "decode_ms": 589.4579590531066}, "total_wall_ms": 622.8989999508485, "ttft_ms": 29.9143340671435, "input_usage": {"receiver_prefix_tokens": 1900, "dense_cache_bytes": 54476800, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3729833984, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1806327061, "process_rss_bytes": 3729833984}, "peak_prefill_memory": 3789818536, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00231_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "7925008c3ad7448bdb8e9604040f2342903baa45c8a420d342a51df8931569b4", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "a617fa13bfd27af0392c9720", "attempt_id": "660a192f9dfd", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:26.315462Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 1932, "message_tokens": 1849, "message_utf8_bytes": 7811, "cache_tensor_bytes": null, "serialized_payload_bytes": 7811, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010874937288463116, "decode_payload_ms": 0.0, "receiver_prefill_ms": 331.87133294995874, "ttft_ms": 7.644832949154079, "decode_ms": 564.7228750167415}, "total_wall_ms": 907.7960409922525, "ttft_ms": 7.644832949154079, "input_usage": {"receiver_prompt_tokens": 1932}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3694739456, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3800484472, "mlx_cache_bytes": 792763268, "process_rss_bytes": 3694739456}, "peak_prefill_memory": null, "peak_decode_memory": 3800484472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "output_hash": "3d96bef102c74d3992df6f0c65cdf277a7c3fb567e96aef4380302125d4278b0"} | ||||
| 496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "1a8164d124d3a14a267280a3", "attempt_id": "8986a1b41079", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:27.597630Z", "task_family": "exec", "document_id": "exec_00232_2000", "document_hash": "94e54bf28dac5a404fdf94451d3e632c18f63dff001cc758f89f5239d27f659b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00232_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200904200}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1849, "source_tokens_receiver": 1849, "query_tokens": 44, "message_tokens": 1888, "message_utf8_bytes": 7811, "cache_tensor_bytes": 54132736, "serialized_payload_bytes": 54145417, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 339.05479102395475, "doc_prefill_ms": 322.0677920617163, "compress_ms": 1.012417022138834, "serialize_ms": 12.23129197023809, "load_ms": 1.8545420607551932, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.085292015224695, "ttft_ms": 29.085292015224695, "decode_ms": 588.3677910314873}, "total_wall_ms": 621.3943749899045, "ttft_ms": 29.085292015224695, "input_usage": {"receiver_prefix_tokens": 1888, "dense_cache_bytes": 54132736, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3711795200, "backend_memory": {"mlx_active_bytes": 3258706952, "mlx_peak_bytes": 3378179352, "mlx_cache_bytes": 1692015845, "process_rss_bytes": 3711795200}, "peak_prefill_memory": 3785198200, "peak_decode_memory": 3378179352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00232_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "9dcac9351ca974360e8377a6cc8d91ed75aa99b31c07eb7f61ae9429e2a4b9f1", "output_hash": "3d96bef102c74d3992df6f0c65cdf277a7c3fb567e96aef4380302125d4278b0"} | ||||
| 497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8fd532a35f2880309972e831", "attempt_id": "11fb756d2438", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:28.261711Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 1940, "message_tokens": 1857, "message_utf8_bytes": 7730, "cache_tensor_bytes": null, "serialized_payload_bytes": 7730, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008584000170230865, "decode_payload_ms": 0.0, "receiver_prefill_ms": 333.0364589346573, "ttft_ms": 7.449624943546951, "decode_ms": 568.1110409786925}, "total_wall_ms": 912.1520830085501, "ttft_ms": 7.449624943546951, "input_usage": {"receiver_prompt_tokens": 1940}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3711795200, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3802679960, "mlx_cache_bytes": 812440484, "process_rss_bytes": 3711795200}, "peak_prefill_memory": null, "peak_decode_memory": 3802679960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
| 498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "96a5b7b44d640b05d0a746c1", "attempt_id": "b34addbc35b7", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:29.550590Z", "task_family": "exec", "document_id": "exec_00233_2000", "document_hash": "c0f56e7b9b73df623955c8b6822884e4b53df031c58736213f498ed2b4d693dc", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00233_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1857, "source_tokens_receiver": 1857, "query_tokens": 44, "message_tokens": 1896, "message_utf8_bytes": 7730, "cache_tensor_bytes": 54362112, "serialized_payload_bytes": 54374793, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.3926250068471, "doc_prefill_ms": 323.33308400120586, "compress_ms": 0.8666249923408031, "serialize_ms": 13.098625000566244, "load_ms": 1.656375010497868, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.21999990940094, "ttft_ms": 29.21999990940094, "decode_ms": 589.4547919742763}, "total_wall_ms": 622.3162909736857, "ttft_ms": 29.21999990940094, "input_usage": {"receiver_prefix_tokens": 1896, "dense_cache_bytes": 54362112, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3783868416, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1802951941, "process_rss_bytes": 3783868416}, "peak_prefill_memory": 3788212888, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00233_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "d6f8935721a324c3b77e74d199e58c9e13160f70a171eb5e597b7d5344917fba", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
| 499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e7878e9541c5bb73c400141a", "attempt_id": "4490ff951023", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:30.215457Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 1899, "message_tokens": 1816, "message_utf8_bytes": 7827, "cache_tensor_bytes": null, "serialized_payload_bytes": 7827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008624978363513947, "decode_payload_ms": 0.0, "receiver_prefill_ms": 324.6184579329565, "ttft_ms": 7.693750085309148, "decode_ms": 567.3695000587031}, "total_wall_ms": 903.2252919860184, "ttft_ms": 7.693750085309148, "input_usage": {"receiver_prompt_tokens": 1899}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3748773888, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3788605940, "mlx_cache_bytes": 780557056, "process_rss_bytes": 3748773888}, "peak_prefill_memory": null, "peak_decode_memory": 3788605940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "587a3d9303844889d884e2d5", "attempt_id": "e32e18300253", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:31.482305Z", "task_family": "exec", "document_id": "exec_00234_2000", "document_hash": "3522724b66617b60e55fa67efc23998ff528130352e7a960ee1e052d697670a5", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00234_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3199364104}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1816, "source_tokens_receiver": 1816, "query_tokens": 44, "message_tokens": 1855, "message_utf8_bytes": 7827, "cache_tensor_bytes": 53186560, "serialized_payload_bytes": 53199241, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 328.5082499496639, "doc_prefill_ms": 311.105249915272, "compress_ms": 1.607874990440905, "serialize_ms": 12.095791986212134, "load_ms": 1.8313750624656677, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.145208070985973, "ttft_ms": 29.145208070985973, "decode_ms": 587.4803749611601}, "total_wall_ms": 620.4875420080498, "ttft_ms": 29.145208070985973, "input_usage": {"receiver_prefix_tokens": 1855, "dense_cache_bytes": 53186560, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3801825280, "backend_memory": {"mlx_active_bytes": 3256249352, "mlx_peak_bytes": 3375623448, "mlx_cache_bytes": 1646664801, "process_rss_bytes": 3801825280}, "peak_prefill_memory": 3773893108, "peak_decode_memory": 3375623448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00234_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "f9c09a9a5fcb08af4a5f4465c354ab6f90360142666033d4394570af6eac28f0", "output_hash": "95b589aae01ceb28173bbda2d1899562fda275c253a91ee5ea456dc1c0bc5a15"} | ||||
| 501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e9962c4f33403e026e606768", "attempt_id": "810038a3174f", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:32.144460Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 1939, "message_tokens": 1856, "message_utf8_bytes": 7900, "cache_tensor_bytes": null, "serialized_payload_bytes": 7900, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008958973921835423, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.2732080705464, "ttft_ms": 7.397499983198941, "decode_ms": 563.9104170259088}, "total_wall_ms": 907.3227079352364, "ttft_ms": 7.397499983198941, "input_usage": {"receiver_prompt_tokens": 1939}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3764469760, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3802483348, "mlx_cache_bytes": 810703776, "process_rss_bytes": 3764469760}, "peak_prefill_memory": null, "peak_decode_memory": 3802483348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "b33524ec7036f03f9539c58d", "attempt_id": "20226b2ec3dc", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:33.429082Z", "task_family": "exec", "document_id": "exec_00235_2000", "document_hash": "20bfca2f1ed7277720116b37988eb2bf9331505c61f7491ff7f131ed0b2d70e1", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00235_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1856, "source_tokens_receiver": 1856, "query_tokens": 44, "message_tokens": 1895, "message_utf8_bytes": 7900, "cache_tensor_bytes": 54333440, "serialized_payload_bytes": 54346121, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.23525000177324, "doc_prefill_ms": 323.08629201725125, "compress_ms": 1.526458072476089, "serialize_ms": 12.733957963064313, "load_ms": 1.4654160477221012, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.134250060655177, "ttft_ms": 30.134250060655177, "decode_ms": 588.0082920193672}, "total_wall_ms": 621.6714589390904, "ttft_ms": 30.134250060655177, "input_usage": {"receiver_prefix_tokens": 1895, "dense_cache_bytes": 54333440, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3819503616, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1838374145, "process_rss_bytes": 3819503616}, "peak_prefill_memory": 3788262036, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 6:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00235_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.2, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "544fbc728072be2bfa454fde74d712a0dfdd00dd5759da32fd604b46f315704d", "output_hash": "1ec5241e9c661e8139811b32a876ec4e1bffefecab6e72aa90bd3512df6a9c80"} | ||||
| 503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e5e53cd250430e9679628625", "attempt_id": "ba95b1edc57b", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:34.093338Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 1950, "message_tokens": 1867, "message_utf8_bytes": 7867, "cache_tensor_bytes": null, "serialized_payload_bytes": 7867, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009040930308401585, "decode_payload_ms": 0.0, "receiver_prefill_ms": 333.8053749175742, "ttft_ms": 7.424207986332476, "decode_ms": 565.693375072442}, "total_wall_ms": 910.5497089913115, "ttft_ms": 7.424207986332476, "input_usage": {"receiver_prompt_tokens": 1950}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3748593664, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3806087872, "mlx_cache_bytes": 798612428, "process_rss_bytes": 3748593664}, "peak_prefill_memory": null, "peak_decode_memory": 3806087872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "2ad497ffaeeaf5a9ff7fed8a", "attempt_id": "756464abd473", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:35.380519Z", "task_family": "exec", "document_id": "exec_00236_2000", "document_hash": "23053422d45849043d9eb3706daf105a581cd66b69e96220ab1285c7c92b2058", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00236_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201494024}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1867, "source_tokens_receiver": 1867, "query_tokens": 44, "message_tokens": 1906, "message_utf8_bytes": 7867, "cache_tensor_bytes": 54648832, "serialized_payload_bytes": 54661513, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 341.33225004188716, "doc_prefill_ms": 323.9759170683101, "compress_ms": 0.770541955716908, "serialize_ms": 12.726875022053719, "load_ms": 1.5007499605417252, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.621625086292624, "ttft_ms": 29.621625086292624, "decode_ms": 588.2786670699716}, "total_wall_ms": 621.2174170650542, "ttft_ms": 29.621625086292624, "input_usage": {"receiver_prefix_tokens": 1906, "dense_cache_bytes": 54648832, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3820978176, "backend_memory": {"mlx_active_bytes": 3260214280, "mlx_peak_bytes": 3379162392, "mlx_cache_bytes": 1792695597, "process_rss_bytes": 3820978176}, "peak_prefill_memory": 3791620800, "peak_decode_memory": 3379162392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00236_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "406d919908d935ece285f7a844af89faeccb0cdba3237783361be90d7cabdc8a", "output_hash": "8fcc7b3df307301761bb98068b1716bd7e58a1f8a11de3ace03bf46345d084c1"} | ||||
| 505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "293c198d8d25b0bee5256184", "attempt_id": "28bbcdf87f40", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:36.043643Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 1988, "message_tokens": 1905, "message_utf8_bytes": 7842, "cache_tensor_bytes": null, "serialized_payload_bytes": 7842, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008333008736371994, "decode_payload_ms": 0.0, "receiver_prefill_ms": 341.7229170445353, "ttft_ms": 7.436916930601001, "decode_ms": 567.8280839929357}, "total_wall_ms": 920.6897499971092, "ttft_ms": 7.436916930601001, "input_usage": {"receiver_prompt_tokens": 1988}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3803283456, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3819326296, "mlx_cache_bytes": 900258916, "process_rss_bytes": 3803283456}, "peak_prefill_memory": null, "peak_decode_memory": 3819326296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "6eaf60baf9190e56e8b02e69", "attempt_id": "de099397ebff", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:37.351201Z", "task_family": "exec", "document_id": "exec_00237_2000", "document_hash": "a8320d4e9d153e4398af56ca92c73f39bb1c1b9e97609e9ec096c1157cebe872", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00237_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3202116616}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1905, "source_tokens_receiver": 1905, "query_tokens": 44, "message_tokens": 1944, "message_utf8_bytes": 7842, "cache_tensor_bytes": 55738368, "serialized_payload_bytes": 55751049, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 351.1568339308724, "doc_prefill_ms": 332.40137505345047, "compress_ms": 1.6546660335734487, "serialize_ms": 13.309458969160914, "load_ms": 1.896957983262837, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.85458297189325, "ttft_ms": 29.85458297189325, "decode_ms": 589.0432079322636}, "total_wall_ms": 622.6765409810469, "ttft_ms": 29.85458297189325, "input_usage": {"receiver_prefix_tokens": 1944, "dense_cache_bytes": 55738368, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3915022336, "backend_memory": {"mlx_active_bytes": 3261754376, "mlx_peak_bytes": 3382160664, "mlx_cache_bytes": 1837047237, "process_rss_bytes": 3915022336}, "peak_prefill_memory": 3804482392, "peak_decode_memory": 3382160664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00237_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "594150a2705e26f4d611d9f8a60ef644aea4e62d2205551f224a3bd70da312d8", "output_hash": "c3f960822b40f5e0b4dbd2d13890a0f88c492aaeeb91cd7c8e1004957dd11d7a"} | ||||
| 507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "034e78bc4c2869a21ae7d91f", "attempt_id": "e696478c3fea", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:38.017686Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 1921, "message_tokens": 1838, "message_utf8_bytes": 7676, "cache_tensor_bytes": null, "serialized_payload_bytes": 7676, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009917072020471096, "decode_payload_ms": 0.0, "receiver_prefill_ms": 324.4736669585109, "ttft_ms": 7.503916975110769, "decode_ms": 567.4337919335812}, "total_wall_ms": 903.0994999920949, "ttft_ms": 7.503916975110769, "input_usage": {"receiver_prompt_tokens": 1921}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3877666816, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3796060748, "mlx_cache_bytes": 788716376, "process_rss_bytes": 3877666816}, "peak_prefill_memory": null, "peak_decode_memory": 3796060748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "output_hash": "5ae3d4b0264e1bdf0e621aa129b65618e5370c3646dfe9deafac6e3129ee6866"} | ||||
| 508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "8870190c5a503e34923079a7", "attempt_id": "932be9658144", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:39.295508Z", "task_family": "exec", "document_id": "exec_00238_2000", "document_hash": "068a11a09e40cb07626e21d7abb095fb9c4779acc1a0db602ca10678ae79e3e0", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00238_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1838, "source_tokens_receiver": 1838, "query_tokens": 44, "message_tokens": 1877, "message_utf8_bytes": 7676, "cache_tensor_bytes": 53817344, "serialized_payload_bytes": 53830025, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.95237499382347, "doc_prefill_ms": 321.14854198880494, "compress_ms": 1.521000056527555, "serialize_ms": 12.588457902893424, "load_ms": 1.8012919463217258, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.526832931675017, "ttft_ms": 28.526832931675017, "decode_ms": 587.7336249686778}, "total_wall_ms": 620.146166998893, "ttft_ms": 28.526832931675017, "input_usage": {"receiver_prefix_tokens": 1877, "dense_cache_bytes": 53817344, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3931570176, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3377556760, "mlx_cache_bytes": 1683578041, "process_rss_bytes": 3931570176}, "peak_prefill_memory": 3781347916, "peak_decode_memory": 3377556760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 4:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 0)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00238_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "dc917898b47191cebec556ff4942abd79e8a276c34c32faf7625fc4f520d7954", "output_hash": "5ae3d4b0264e1bdf0e621aa129b65618e5370c3646dfe9deafac6e3129ee6866"} | ||||
| 509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d4564a2aba542c8a2702467a", "attempt_id": "7c9f7b3e02be", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:39.958193Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 1930, "message_tokens": 1847, "message_utf8_bytes": 7723, "cache_tensor_bytes": null, "serialized_payload_bytes": 7723, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010416028089821339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 332.8398329904303, "ttft_ms": 7.535584038123488, "decode_ms": 568.5852500610054}, "total_wall_ms": 912.6660419860855, "ttft_ms": 7.535584038123488, "input_usage": {"receiver_prompt_tokens": 1930}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3875618816, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3799272048, "mlx_cache_bytes": 808246140, "process_rss_bytes": 3875618816}, "peak_prefill_memory": null, "peak_decode_memory": 3799272048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "output_hash": "3d96bef102c74d3992df6f0c65cdf277a7c3fb567e96aef4380302125d4278b0"} | ||||
| 510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "d2983810375d46de74cd3a19", "attempt_id": "1b1d3c6bb55c", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:41.244708Z", "task_family": "exec", "document_id": "exec_00239_2000", "document_hash": "015c78e1e480fb805976a26912f0308a79a0c4b2122313463b5ff6b5ee996a9b", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00239_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3200281608}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1847, "source_tokens_receiver": 1847, "query_tokens": 44, "message_tokens": 1886, "message_utf8_bytes": 7723, "cache_tensor_bytes": 54075392, "serialized_payload_bytes": 54088073, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.18258298560977, "doc_prefill_ms": 322.30850006453693, "compress_ms": 0.8019169326871634, "serialize_ms": 11.33091701194644, "load_ms": 1.8249590648338199, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.684875044040382, "ttft_ms": 29.684875044040382, "decode_ms": 585.8616250334308}, "total_wall_ms": 619.4435829529539, "ttft_ms": 29.684875044040382, "input_usage": {"receiver_prefix_tokens": 1886, "dense_cache_bytes": 54075392, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3875569664, "backend_memory": {"mlx_active_bytes": 3258084360, "mlx_peak_bytes": 3377556760, "mlx_cache_bytes": 1690328285, "process_rss_bytes": 3875569664}, "peak_prefill_memory": 3784559216, "peak_decode_memory": 3377556760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 5:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 2)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00239_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "98150b57ace513ce4f32a740eaf3a39b450db0413b9193260fb0603e5cafa2a7", "output_hash": "3d96bef102c74d3992df6f0c65cdf277a7c3fb567e96aef4380302125d4278b0"} | ||||
| 511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "e81641cc5c21491afd502079", "attempt_id": "ad8c793846b6", "run_group_id": "E3_core_sender:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:41.905827Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3087428616}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 1954, "message_tokens": 1871, "message_utf8_bytes": 7797, "cache_tensor_bytes": null, "serialized_payload_bytes": 7797, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008541974239051342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 335.90487495530397, "ttft_ms": 7.418249966576695, "decode_ms": 567.661042092368}, "total_wall_ms": 914.5815829979256, "ttft_ms": 7.418249966576695, "input_usage": {"receiver_prompt_tokens": 1954}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3875569664, "backend_memory": {"mlx_active_bytes": 3087428616, "mlx_peak_bytes": 3807939280, "mlx_cache_bytes": 817372124, "process_rss_bytes": 3875569664}, "peak_prefill_memory": null, "peak_decode_memory": 3807939280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
| 512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E3_core_sender", "trial_id": "9612ff9fcac074d0a9675a01", "attempt_id": "4127ff39d000", "run_group_id": "E3_core_sender:B0", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "7bde8186e510919523667b02c140225d80c9931fea95aa330ae904670257055c", "git_commit": null, "timestamp_utc": "2026-10-30T08:59:43.198359Z", "task_family": "exec", "document_id": "exec_00240_2000", "document_hash": "4c3927b8378a2b949e85371101d959a0adebcbe41a2d39f239aae883de382e19", "question_id": "q00_exec", "split": "test", "cluster_id": "exec_00240_2000", "sender_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "receiver_model_revision": "mlx-community/Qwen2.5-1.5B-Instruct-bf16@4ae77cb209f06199b8df1c94e21ff341332a3a89", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "m3u96a-m3ultra-96g", "device_state": {"mlx_active_before": 3201199112}, "weight_precision": "bf16", "method_id": "B0", "implementation_fidelity": "custom", "compression_config": {"realized": {}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1871, "source_tokens_receiver": 1871, "query_tokens": 44, "message_tokens": 1910, "message_utf8_bytes": 7797, "cache_tensor_bytes": 54763520, "serialized_payload_bytes": 54776201, "side_information_bytes": 12681, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 342.6938329357654, "doc_prefill_ms": 324.1300000809133, "compress_ms": 1.6622080001980066, "serialize_ms": 13.11316597275436, "load_ms": 1.8911249935626984, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.397333040833473, "ttft_ms": 29.397333040833473, "decode_ms": 591.6277079377323}, "total_wall_ms": 625.0115419970825, "ttft_ms": 29.397333040833473, "input_usage": {"receiver_prefix_tokens": 1910, "dense_cache_bytes": 54763520, "query_tokens": 44}, "output_usage": {"output_tokens": 80}, "provider_cached_usage": null, "process_memory": 3929653248, "backend_memory": {"mlx_active_bytes": 3259919368, "mlx_peak_bytes": 3379784984, "mlx_cache_bytes": 1766251837, "process_rss_bytes": 3929653248}, "peak_prefill_memory": 3793226448, "peak_decode_memory": 3379784984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "def net_revenue(rows):\n total = 0.0\n for r in rows:\n if r['returned']:\n continue\n if r['units'] < 3:\n continue\n total += r['units'] * r['unit_price'] * (1 - r['discount_pct'] / 100.0)\n return round(total, 1)", "evidence_artifact": null, "reference_key_id": "keys/exec/exec_00240_2000.json", "task_scores": {"correct": 0.0, "pass_rate": 0.0, "error": null}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E3_core_sender.log", "payload_hash": "75c74f97f8326d96e72defc137e373b5eed24a2f3007b7104acdac22feafdc25", "output_hash": "6243e224cce1410a190d713c589d27f5e1230a7b60be6e9529f5de58b4000b41"} | ||||
added
runs/raw/E7_qtypes.jsonl
+2520 −0
@@ -0,0 +1,2520 @@ | |||||
| 1 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea22e2f9a852968c8d6fbbc2", "attempt_id": "534f6bb42588", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:30.002161Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1989, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.0102080181241, "ttft_ms": 13.879916979931295, "decode_ms": 133.8511670473963}, "total_wall_ms": 381.1631250428036, "ttft_ms": 13.879916979931295, "input_usage": {"receiver_prompt_tokens": 1989}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6598934528, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7039467344, "mlx_cache_bytes": 875998044, "process_rss_bytes": 6598934528}, "peak_prefill_memory": null, "peak_decode_memory": 7039467344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 2 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "00a8801bc94663ccab41c136", "attempt_id": "7d6ee34624fd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:30.402012Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.75391603820026, "ttft_ms": 13.292750110849738, "decode_ms": 13.415333931334317}, "total_wall_ms": 237.04641696531326, "ttft_ms": 13.292750110849738, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6598983680, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7035502416, "mlx_cache_bytes": 1653828444, "process_rss_bytes": 6598983680}, "peak_prefill_memory": null, "peak_decode_memory": 7035502416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 3 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "19ceef402590ed7efbf5dfa6", "attempt_id": "7e4ebeaa1935", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:30.655446Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1978, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 205.74170793406665, "ttft_ms": 13.36554205045104, "decode_ms": 13.202958973124623}, "total_wall_ms": 234.95079204440117, "ttft_ms": 13.36554205045104, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6598983680, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7035502416, "mlx_cache_bytes": 1653828444, "process_rss_bytes": 6598983680}, "peak_prefill_memory": null, "peak_decode_memory": 7035502416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 4 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0febb3b00002b11d079dcf05", "attempt_id": "c422081a4a45", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:30.906408Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1993, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.22737498767674, "ttft_ms": 13.620291952975094, "decode_ms": 93.42345909681171}, "total_wall_ms": 318.94287490285933, "ttft_ms": 13.620291952975094, "input_usage": {"receiver_prompt_tokens": 1993}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6599032832, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7040991296, "mlx_cache_bytes": 2437147484, "process_rss_bytes": 6599032832}, "peak_prefill_memory": null, "peak_decode_memory": 7040991296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2705965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "149792af0b004a6863128878a817e8506bb3a8476a6d59878795e90cba3743a6"} | ||||
| 5 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "851facbc010f658db897feb2", "attempt_id": "547da759190e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:31.241175Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1989, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.55037502385676, "ttft_ms": 13.452791958115995, "decode_ms": 120.65370799973607}, "total_wall_ms": 344.3172499537468, "ttft_ms": 13.452791958115995, "input_usage": {"receiver_prompt_tokens": 1989}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6599065600, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7039467344, "mlx_cache_bytes": 2437147484, "process_rss_bytes": 6599065600}, "peak_prefill_memory": null, "peak_decode_memory": 7039467344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,034,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "b1dc6064f97c41a63e2b857664a4196c5397f8224728e25ada16fcf249b7ed60"} | ||||
| 6 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cc58c5a2a4aa8014ba7ee10d", "attempt_id": "96f0499d2166", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:31.601278Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1995, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.70066701900214, "ttft_ms": 13.546166010200977, "decode_ms": 67.02695891726762}, "total_wall_ms": 291.9322079978883, "ttft_ms": 13.546166010200977, "input_usage": {"receiver_prompt_tokens": 1995}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6599098368, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7042056256, "mlx_cache_bytes": 3221531484, "process_rss_bytes": 6599098368}, "peak_prefill_memory": null, "peak_decode_memory": 7042056256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldnak-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "2b9a4cf7221f1b6f31508a6b3078ec521f211026a932da5020cddd512ecc5fa2"} | ||||
| 7 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8844bbc840e7e5f35971bafd", "attempt_id": "b2bb1106158f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:31.909193Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1990, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.89841695316136, "ttft_ms": 13.453624909743667, "decode_ms": 93.09333295095712}, "total_wall_ms": 318.18370800465345, "ttft_ms": 13.453624909743667, "input_usage": {"receiver_prompt_tokens": 1990}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6599147520, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7040204864, "mlx_cache_bytes": 3767446364, "process_rss_bytes": 6599147520}, "peak_prefill_memory": null, "peak_decode_memory": 7040204864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3206234", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "5474d05df9eae6fcf58452f6686b56930d76e7927dcaf2637ed7375bb72b68ac"} | ||||
| 8 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d35873c5f7afd1768157282d", "attempt_id": "60ee647ff1a1", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:32.243382Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1986, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.64850003272295, "ttft_ms": 13.481791946105659, "decode_ms": 53.26583399437368}, "total_wall_ms": 278.0509169679135, "ttft_ms": 13.481791946105659, "input_usage": {"receiver_prompt_tokens": 1986}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 6599147520, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7038680912, "mlx_cache_bytes": 4312312668, "process_rss_bytes": 6599147520}, "peak_prefill_memory": null, "peak_decode_memory": 7038680912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "151d42ff8288534a7de93c03896738e8e7fbce36d2650f7188a60efb69cb93d3"} | ||||
| 9 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a3dd17d06966dbb4e600cb4", "attempt_id": "a6114e2db950", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:32.537120Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1990, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.25241692364216, "ttft_ms": 13.402792043052614, "decode_ms": 13.496833038516343}, "total_wall_ms": 237.85700008738786, "ttft_ms": 13.402792043052614, "input_usage": {"receiver_prompt_tokens": 1990}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599147520, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7040204864, "mlx_cache_bytes": 4312312668, "process_rss_bytes": 6599147520}, "peak_prefill_memory": null, "peak_decode_memory": 7040204864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 10 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "091fcabfb767d3ba0352c10f", "attempt_id": "0315b9a5ca58", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:32.790860Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 1992, "message_tokens": 1904, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008416012860834599, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.99658296164125, "ttft_ms": 13.919749995693564, "decode_ms": 13.373124995268881}, "total_wall_ms": 238.04904194548726, "ttft_ms": 13.919749995693564, "input_usage": {"receiver_prompt_tokens": 1992}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599163904, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 7040991296, "mlx_cache_bytes": 4312312668, "process_rss_bytes": 6599163904}, "peak_prefill_memory": null, "peak_decode_memory": 7040991296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 11 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "670f18d2f3b36764b3303d2d", "attempt_id": "4f7f650d7427", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:40.154786Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.2466249242425, "ttft_ms": 13.532625045627356, "decode_ms": 132.2387910913676}, "total_wall_ms": 218.08799996506423, "ttft_ms": 13.532625045627356, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6599720960, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6568915032, "mlx_cache_bytes": 5700414300, "process_rss_bytes": 6599720960}, "peak_prefill_memory": null, "peak_decode_memory": 6568915032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 12 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "67463d697c7f8f6098418526", "attempt_id": "11eebb9d9d06", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:40.389500Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.84420807566494, "ttft_ms": 13.491458958014846, "decode_ms": 13.060042052529752}, "total_wall_ms": 97.36537502612919, "ttft_ms": 13.491458958014846, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599802880, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6564311128, "mlx_cache_bytes": 6059715420, "process_rss_bytes": 6599802880}, "peak_prefill_memory": null, "peak_decode_memory": 6564311128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 13 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52c8bde33c7647fe628acce6", "attempt_id": "6dbf81a3c040", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:40.503173Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.58041607867926, "ttft_ms": 13.15508398693055, "decode_ms": 13.130041072145104}, "total_wall_ms": 96.82679199613631, "ttft_ms": 13.15508398693055, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599819264, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6564311128, "mlx_cache_bytes": 6059715420, "process_rss_bytes": 6599819264}, "peak_prefill_memory": null, "peak_decode_memory": 6564311128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 14 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1de92dba8eab2e951f8933c6", "attempt_id": "2a41978cecd8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:40.615780Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.44404104817659, "ttft_ms": 13.202207977883518, "decode_ms": 119.55541593488306}, "total_wall_ms": 204.20241705141962, "ttft_ms": 13.202207977883518, "input_usage": {"receiver_prompt_tokens": 606, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6599884800, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6571159640, "mlx_cache_bytes": 6413413212, "process_rss_bytes": 6599884800}, "peak_prefill_memory": null, "peak_decode_memory": 6571159640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,705,965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "dbedb6f5d00e413d915513b85d8ed195b18b9acf392ece342a85e15e3752bcc8"} | ||||
| 15 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "feb065bc8a1fa253eb770265", "attempt_id": "6f0d53e68d86", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:40.836766Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.13658306095749, "ttft_ms": 13.321375008672476, "decode_ms": 93.85304199531674}, "total_wall_ms": 178.29295899719, "ttft_ms": 13.321375008672476, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6599901184, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6568915032, "mlx_cache_bytes": 6413413212, "process_rss_bytes": 6599901184}, "peak_prefill_memory": null, "peak_decode_memory": 6568915032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9127965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "a0c871941224304cec47bb1b3d64b8706843b299f14ab94899d97df14f433da7"} | ||||
| 16 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "919b5becc47df49a49356a0a", "attempt_id": "4d7712823937", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:41.030665Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.33545791637152, "ttft_ms": 13.120624935254455, "decode_ms": 65.92712504789233}, "total_wall_ms": 150.38683405146003, "ttft_ms": 13.120624935254455, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6599933952, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6572044376, "mlx_cache_bytes": 6663400284, "process_rss_bytes": 6599933952}, "peak_prefill_memory": null, "peak_decode_memory": 6572044376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldnak-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "2b9a4cf7221f1b6f31508a6b3078ec521f211026a932da5020cddd512ecc5fa2"} | ||||
| 17 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4de3c9a5293baebf900b1922", "attempt_id": "4875c7dd8f35", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:41.197385Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.1221670024097, "ttft_ms": 13.232040917500854, "decode_ms": 92.4196660052985}, "total_wall_ms": 176.72454204875976, "ttft_ms": 13.232040917500854, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6599933952, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6569209944, "mlx_cache_bytes": 6911224668, "process_rss_bytes": 6599933952}, "peak_prefill_memory": null, "peak_decode_memory": 6569209944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9220745", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "f5d77aa763f6365bc80d01b9e6e23bc43fb570ac45771d7bd628c75cde727b35"} | ||||
| 18 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "756b403de67d0d134d550803", "attempt_id": "2e13e5e258e0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:41.390305Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.99845791142434, "ttft_ms": 13.180584064684808, "decode_ms": 13.112833024933934}, "total_wall_ms": 97.30983292683959, "ttft_ms": 13.180584064684808, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599966720, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6589755480, "mlx_cache_bytes": 7179594588, "process_rss_bytes": 6599966720}, "peak_prefill_memory": null, "peak_decode_memory": 6589755480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 19 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3db2ab049fa569c2dc67764d", "attempt_id": "d834792327a4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:41.504067Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.40504203177989, "ttft_ms": 13.11258296482265, "decode_ms": 13.140833005309105}, "total_wall_ms": 97.63008391018957, "ttft_ms": 13.11258296482265, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599983104, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6569209944, "mlx_cache_bytes": 7179594588, "process_rss_bytes": 6599983104}, "peak_prefill_memory": null, "peak_decode_memory": 6569209944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 20 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6218971736c0c02ab4874269", "attempt_id": "759bc10a3e70", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:41.617530Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1087, "cache_tensor_bytes": null, "serialized_payload_bytes": 1087, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7109.954874962568, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.07750007323921, "ttft_ms": 13.253791956230998, "decode_ms": 13.120374991558492}, "total_wall_ms": 97.44749998208135, "ttft_ms": 13.253791956230998, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 2020, "sender_output_tokens": 512, "sender_prefill_ms": 211.81650005746633, "sender_ttft_ms": 13.535334030166268, "sender_decode_ms": 6883.0867910292}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6599999488, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6570291288, "mlx_cache_bytes": 7268658012, "process_rss_bytes": 6599999488}, "peak_prefill_memory": null, "peak_decode_memory": 6570291288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "762b58836b9acc90049d698b9be75bab93aa17c1904eb648b631e899f819781f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 21 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f767cdf31a33c44fc18ab31a", "attempt_id": "b31ad7745c1d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:48.847754Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 483, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.30624992772937, "ttft_ms": 13.081374927423894, "decode_ms": 131.42195902764797}, "total_wall_ms": 201.7741670133546, "ttft_ms": 13.081374927423894, "input_usage": {"receiver_prompt_tokens": 483, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6600359936, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6488680416, "mlx_cache_bytes": 8391095012, "process_rss_bytes": 6600359936}, "peak_prefill_memory": null, "peak_decode_memory": 6488680416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 22 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "996dc589042ce4804e308701", "attempt_id": "eacc640652da", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.066473Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 472, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.73579198587686, "ttft_ms": 13.190999976359308, "decode_ms": 13.041542028076947}, "total_wall_ms": 81.83587493840605, "ttft_ms": 13.190999976359308, "input_usage": {"receiver_prompt_tokens": 472, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600523776, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6483634144, "mlx_cache_bytes": 8679781092, "process_rss_bytes": 6600523776}, "peak_prefill_memory": null, "peak_decode_memory": 6483634144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 23 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "608cdda06453d64fb930278e", "attempt_id": "9b01bd6a0302", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.164514Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 472, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.45437494199723, "ttft_ms": 13.240791973657906, "decode_ms": 12.962665990926325}, "total_wall_ms": 81.52529189828783, "ttft_ms": 13.240791973657906, "input_usage": {"receiver_prompt_tokens": 472, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600523776, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6483634144, "mlx_cache_bytes": 8679781092, "process_rss_bytes": 6600523776}, "peak_prefill_memory": null, "peak_decode_memory": 6483634144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 24 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc2fccd7036503c56df876cb", "attempt_id": "947d9815066d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.262159Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 487, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.8271249756217, "ttft_ms": 13.234417070634663, "decode_ms": 118.27829107642174}, "total_wall_ms": 188.23995802085847, "ttft_ms": 13.234417070634663, "input_usage": {"receiver_prompt_tokens": 487, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6600572928, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6491138032, "mlx_cache_bytes": 8963979900, "process_rss_bytes": 6600572928}, "peak_prefill_memory": null, "peak_decode_memory": 6491138032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,705,965", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "dbedb6f5d00e413d915513b85d8ed195b18b9acf392ece342a85e15e3752bcc8"} | ||||
| 25 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "06253f90eae7d36ca9210ac2", "attempt_id": "00f6d7b949f7", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.466779Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 483, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.49449997488409, "ttft_ms": 13.218209031037986, "decode_ms": 12.949832947924733}, "total_wall_ms": 82.48037507291883, "ttft_ms": 13.218209031037986, "input_usage": {"receiver_prompt_tokens": 483, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600572928, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6488680416, "mlx_cache_bytes": 8963979900, "process_rss_bytes": 6600572928}, "peak_prefill_memory": null, "peak_decode_memory": 6488680416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 26 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "874b7b9569a911d4689d6286", "attempt_id": "485faf2866a0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.564890Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 489, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.45250000432134, "ttft_ms": 13.338832999579608, "decode_ms": 13.053041067905724}, "total_wall_ms": 82.66758301761001, "ttft_ms": 13.338832999579608, "input_usage": {"receiver_prompt_tokens": 489, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600589312, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6491826168, "mlx_cache_bytes": 9164915228, "process_rss_bytes": 6600589312}, "peak_prefill_memory": null, "peak_decode_memory": 6491826168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 27 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f03c62be2aab3e251593f963", "attempt_id": "6c5b4e41912c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.663780Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 484, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.440790951251984, "ttft_ms": 13.515166006982327, "decode_ms": 12.984083965420723}, "total_wall_ms": 82.77199999429286, "ttft_ms": 13.515166006982327, "input_usage": {"receiver_prompt_tokens": 484, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600589312, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6489270256, "mlx_cache_bytes": 9363980828, "process_rss_bytes": 6600589312}, "peak_prefill_memory": null, "peak_decode_memory": 6489270256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 28 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9511b0956a6f28056bc39fb0", "attempt_id": "69a0a4147f73", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.763322Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 480, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.01112504862249, "ttft_ms": 13.342541991733015, "decode_ms": 65.86420896928757}, "total_wall_ms": 135.0534160155803, "ttft_ms": 13.342541991733015, "input_usage": {"receiver_prompt_tokens": 480, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6600622080, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6505179104, "mlx_cache_bytes": 9580937756, "process_rss_bytes": 6600622080}, "peak_prefill_memory": null, "peak_decode_memory": 6505179104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20460", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "5b63f3e420491df16ce14261812cb13bea56ef0ae0d4c058859b3eb55ef83b05"} | ||||
| 29 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "970ad97ac150722961b2f1a9", "attempt_id": "c5d1d241b9db", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:49.914460Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 484, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.592583026736975, "ttft_ms": 13.136583031155169, "decode_ms": 13.08029203210026}, "total_wall_ms": 82.68966700416058, "ttft_ms": 13.136583031155169, "input_usage": {"receiver_prompt_tokens": 484, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600622080, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6489270256, "mlx_cache_bytes": 9580937756, "process_rss_bytes": 6600622080}, "peak_prefill_memory": null, "peak_decode_memory": 6489270256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 30 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2413f43e61e507648e8c7045", "attempt_id": "25e461c9e7b8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:50.013288Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 486, "message_tokens": 383, "message_utf8_bytes": 911, "cache_tensor_bytes": null, "serialized_payload_bytes": 911, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7116.149790934287, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.91770797036588, "ttft_ms": 13.363749952986836, "decode_ms": 13.275375007651746}, "total_wall_ms": 83.38737499434501, "ttft_ms": 13.363749952986836, "input_usage": {"receiver_prompt_tokens": 486, "sender_input_tokens": 2048, "sender_output_tokens": 512, "sender_prefill_ms": 213.90266600064933, "sender_ttft_ms": 13.246667105704546, "sender_decode_ms": 6887.2767080320045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600654848, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6490744816, "mlx_cache_bytes": 9709126172, "process_rss_bytes": 6600654848}, "peak_prefill_memory": null, "peak_decode_memory": 6490744816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a409b88ff601f1f9bf4d221a0c042117fadd2be19621e0b0dd2800495cfbe0cc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 31 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1f7921ec035a1d07a7ba2b8f", "attempt_id": "1e0c2309f129", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:50.114462Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 593, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.63358295615762, "ttft_ms": 13.251792057417333, "decode_ms": 13.634625007398427}, "total_wall_ms": 97.52729092724621, "ttft_ms": 13.251792057417333, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600687616, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6565195864, "mlx_cache_bytes": 9952920092, "process_rss_bytes": 6600687616}, "peak_prefill_memory": null, "peak_decode_memory": 6565195864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 32 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a215242b5c27c7f70ca97852", "attempt_id": "9772a5dcb974", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:50.227967Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 582, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.6452499832958, "ttft_ms": 13.162374962121248, "decode_ms": 13.128207996487617}, "total_wall_ms": 96.87133389525115, "ttft_ms": 13.162374962121248, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600753152, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6559297624, "mlx_cache_bytes": 10292658716, "process_rss_bytes": 6600753152}, "peak_prefill_memory": null, "peak_decode_memory": 6559297624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 33 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ae57e2d5ead078f371456f5", "attempt_id": "10cb0038945b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:50.340965Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 582, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.36441699508578, "ttft_ms": 13.036582968197763, "decode_ms": 13.11354199424386}, "total_wall_ms": 96.4536250103265, "ttft_ms": 13.036582968197763, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600753152, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6559297624, "mlx_cache_bytes": 10292658716, "process_rss_bytes": 6600753152}, "peak_prefill_memory": null, "peak_decode_memory": 6559297624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 34 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e29493f62f6d30e173a4d02a", "attempt_id": "a8f7559a1b34", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:50.453613Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 597, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.8531250236556, "ttft_ms": 13.322874903678894, "decode_ms": 120.04062498454005}, "total_wall_ms": 204.20954108703882, "ttft_ms": 13.322874903678894, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6600802304, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6567997528, "mlx_cache_bytes": 10618585628, "process_rss_bytes": 6600802304}, "peak_prefill_memory": null, "peak_decode_memory": 6567997528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,705,965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "dbedb6f5d00e413d915513b85d8ed195b18b9acf392ece342a85e15e3752bcc8"} | ||||
| 35 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "16e2de2ed4cfd658858d2262", "attempt_id": "55105a1f3ae3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:50.674137Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 593, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.58716700319201, "ttft_ms": 13.186292024329305, "decode_ms": 119.65629202313721}, "total_wall_ms": 203.40120804030448, "ttft_ms": 13.186292024329305, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6600818688, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6565195864, "mlx_cache_bytes": 10618585628, "process_rss_bytes": 6600818688}, "peak_prefill_memory": null, "peak_decode_memory": 6565195864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,034,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "b1dc6064f97c41a63e2b857664a4196c5397f8224728e25ada16fcf249b7ed60"} | ||||
| 36 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6be0d0834858f84346e2197f", "attempt_id": "311aa41cc560", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:50.893922Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 599, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.3884160136804, "ttft_ms": 13.667792081832886, "decode_ms": 66.92437501624227}, "total_wall_ms": 150.94149997457862, "ttft_ms": 13.667792081832886, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6600818688, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6587281496, "mlx_cache_bytes": 10618585628, "process_rss_bytes": 6600818688}, "peak_prefill_memory": null, "peak_decode_memory": 6587281496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "bd81b870addca9eb7c7a0adcc4951f2aba6a86d8408adc5d88e9806bf8dd99e5"} | ||||
| 37 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d60d3e533bf17ff29dd5abbe", "attempt_id": "7bacd231ff75", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:51.061312Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 594, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.54266596585512, "ttft_ms": 13.14674993045628, "decode_ms": 92.19416603446007}, "total_wall_ms": 175.8505420293659, "ttft_ms": 13.14674993045628, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6600867840, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6579023960, "mlx_cache_bytes": 10874978844, "process_rss_bytes": 6600867840}, "peak_prefill_memory": null, "peak_decode_memory": 6579023960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2410945", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "a92e8e79a32eb8c93e7a99c251b4e02a4cc5f011395f8fa025ca74b2dd2c3e23"} | ||||
| 38 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f1d85ba1d3671f634cc9f024", "attempt_id": "7e774ab02fbe", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:51.253806Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 590, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.78949997574091, "ttft_ms": 13.326582964509726, "decode_ms": 92.51225006300956}, "total_wall_ms": 176.57641705591232, "ttft_ms": 13.326582964509726, "input_usage": {"receiver_prompt_tokens": 590}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6600867840, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6564311128, "mlx_cache_bytes": 10874978844, "process_rss_bytes": 6600867840}, "peak_prefill_memory": null, "peak_decode_memory": 6564311128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3569215", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "cf821427c4d9c2cd18c57d1162d453beaad6dd3df8d5552aa3b40c1bc5f12900"} | ||||
| 39 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6521edd26cae7e2fa0ea6a24", "attempt_id": "daf609c006fe", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:51.447351Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 594, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.69266606029123, "ttft_ms": 13.774583931080997, "decode_ms": 13.094999943859875}, "total_wall_ms": 97.60416706558317, "ttft_ms": 13.774583931080997, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600867840, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6579023960, "mlx_cache_bytes": 10874978844, "process_rss_bytes": 6600867840}, "peak_prefill_memory": null, "peak_decode_memory": 6579023960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 40 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5313e207c6ca9adbf3b0c057", "attempt_id": "51cf2e98d7da", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:51.561506Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6171877384}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 596, "message_tokens": 507, "message_utf8_bytes": 1273, "cache_tensor_bytes": null, "serialized_payload_bytes": 1273, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.7028329893946648, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.56816604360938, "ttft_ms": 13.08387506287545, "decode_ms": 13.691665953956544}, "total_wall_ms": 97.30654093436897, "ttft_ms": 13.08387506287545, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6600867840, "backend_memory": {"mlx_active_bytes": 6171877384, "mlx_peak_bytes": 6580203608, "mlx_cache_bytes": 10874978844, "process_rss_bytes": 6600867840}, "peak_prefill_memory": null, "peak_decode_memory": 6580203608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb0c248915f6035e291b13bc3aed86ea6bb64a2b4ec9dfda24bcfbfef91d8f1a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 41 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7aa32d61042753333e41f745", "attempt_id": "c4b112f41190", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:51.903174Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.5912909293547273, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.577415961772203, "ttft_ms": 18.577415961772203, "decode_ms": 131.1916660051793}, "total_wall_ms": 152.89845794904977, "ttft_ms": 18.577415961772203, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6639370240, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331326712, "mlx_cache_bytes": 11596759949, "process_rss_bytes": 6639370240}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331326712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EU-14W-9902", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "3d376b4fc7c8f63be21948805ff82a6005580bfecdfcc0b74a0ce7da935331e8"} | ||||
| 42 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f198ab5654304051c7af367d", "attempt_id": "40b60f35403b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.072745Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.4485419960692525, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.294875044375658, "ttft_ms": 18.294875044375658, "decode_ms": 13.121458934620023}, "total_wall_ms": 34.38679105602205, "ttft_ms": 18.294875044375658, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6639468544, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6321594616, "mlx_cache_bytes": 11620205453, "process_rss_bytes": 6639468544}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6321594616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 43 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28f43eb02f55cf800abde345", "attempt_id": "4ee975ca65be", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.123775Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 0.5479590035974979, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.094624974764884, "ttft_ms": 18.094624974764884, "decode_ms": 12.98587501514703}, "total_wall_ms": 33.0110409995541, "ttft_ms": 18.094624974764884, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6639468544, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6321594616, "mlx_cache_bytes": 11620238221, "process_rss_bytes": 6639468544}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6321594616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 44 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c9575bf13f9dd4987851099a", "attempt_id": "c90e2e83b69c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.172704Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 50, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.4431250747293234, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.301791977137327, "ttft_ms": 18.301791977137327, "decode_ms": 66.17670797277242}, "total_wall_ms": 87.35141693614423, "ttft_ms": 18.301791977137327, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 50}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6639534080, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6334800136, "mlx_cache_bytes": 11668915485, "process_rss_bytes": 6639534080}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6334800136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "5994471abb01112afcc18159f6cc74b4f511b99806da59b3caf5a9c173cacfc5"} | ||||
| 45 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "529fdd8bab616e605857dfb2", "attempt_id": "b5f5f9ba584d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.276493Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.5551249962300062, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.883624997921288, "ttft_ms": 17.883624997921288, "decode_ms": 79.48724995367229}, "total_wall_ms": 100.32358404714614, "ttft_ms": 17.883624997921288, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 6639534080, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331359480, "mlx_cache_bytes": 11668915485, "process_rss_bytes": 6639534080}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331359480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12,345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "716bfc75787fca1d58d1eaab414f739ce403e4f07591d00baf476f60bac06a27"} | ||||
| 46 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "74e1287f8fe860f8615fca22", "attempt_id": "1e53fba13591", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.392982Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 52, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.5267080161720514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.404249916784465, "ttft_ms": 18.404249916784465, "decode_ms": 65.98924996796995}, "total_wall_ms": 87.39754208363593, "ttft_ms": 18.404249916784465, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6639534080, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6335930640, "mlx_cache_bytes": 11705370301, "process_rss_bytes": 6639534080}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6335930640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ostban-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "b4a111f2301f711928f4441bd8ae4f4fcba9fcdbe052752b3b173a0e03e6eced"} | ||||
| 47 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2fd029444a96733ec47b2144", "attempt_id": "3f7a91a9c08d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.496253Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 47, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.3103749370202422, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.17595900502056, "ttft_ms": 18.17595900502056, "decode_ms": 92.66162500716746}, "total_wall_ms": 113.58874989673495, "ttft_ms": 18.17595900502056, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6639550464, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331982088, "mlx_cache_bytes": 11711661757, "process_rss_bytes": 6639550464}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331982088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4009678", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "b241bb1f96d8963c8bba43e0987c05a253cff5205b46230d13cff996702da310"} | ||||
| 48 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "11c9b90fbee1a4020595b574", "attempt_id": "43b39d6a6e6f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.626604Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 43, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.5059580327942967, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.142457935027778, "ttft_ms": 18.142457935027778, "decode_ms": 52.86266596522182}, "total_wall_ms": 74.01604193728417, "ttft_ms": 18.142457935027778, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 43}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 6639566848, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331113720, "mlx_cache_bytes": 11733141181, "process_rss_bytes": 6639566848}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331113720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "151d42ff8288534a7de93c03896738e8e7fbce36d2650f7188a60efb69cb93d3"} | ||||
| 49 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0815fd22551ac23a3bb03307", "attempt_id": "03b2316d5210", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.717116Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 47, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.7005839617922902, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.200916005298495, "ttft_ms": 18.200916005298495, "decode_ms": 13.363124919123948}, "total_wall_ms": 34.65745900757611, "ttft_ms": 18.200916005298495, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6639566848, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331982088, "mlx_cache_bytes": 11733141181, "process_rss_bytes": 6639566848}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331982088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 50 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47da62163bb2c7183c6b212b", "attempt_id": "b0147b413101", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.767637Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6266249224}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1943, "keep": 486, "compress_ms": 14.677041908726096}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 49, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931816, "side_information_bytes": 15912, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 227.3708749562502, "doc_prefill_ms": 204.23550007399172, "compress_ms": 14.71262495033443, "serialize_ms": 5.380457965657115, "load_ms": 1.4580419519916177, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.49124999716878, "ttft_ms": 18.49124999716878, "decode_ms": 13.245207956060767}, "total_wall_ms": 34.60891603026539, "ttft_ms": 18.49124999716878, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6639583232, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6333964552, "mlx_cache_bytes": 11767498429, "process_rss_bytes": 6639583232}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6333964552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2df7e1be733357d24b176adfd0157fc10cfca02f1b4ee6e7e51a6398620b9c86", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 51 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b21390f8c463adde5093a468", "attempt_id": "8cf2bfaa2103", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.818166Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 46, "compress_ms": 46.198333031497896}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931856, "side_information_bytes": 15952, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 51.737750065512955, "doc_prefill_ms": 204.23550007399172, "compress_ms": 47.58000001311302, "serialize_ms": 3.959959023632109, "load_ms": 1.3925000093877316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.793457955121994, "ttft_ms": 17.793457955121994, "decode_ms": 65.71570795495063}, "total_wall_ms": 138.14137503504753, "ttft_ms": 17.793457955121994, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6641532928, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331261176, "mlx_cache_bytes": 11900945269, "process_rss_bytes": 6641532928}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331261176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-519", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81251979f9176665dd8753403ef6865512a81b37ded2301ff9b93b1aaa0b359f", "output_hash": "b93ea769103ffd2e88641d7bf6399ded50a00a056113b8865e3eb632ef12a723"} | ||||
| 52 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3cbb700467c612306c6b0417", "attempt_id": "f74a6a63e7ea", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:52.972449Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 35, "compress_ms": 41.789542068727314}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931856, "side_information_bytes": 15952, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.687583952210844, "doc_prefill_ms": 204.23550007399172, "compress_ms": 43.12100005336106, "serialize_ms": 4.364249994978309, "load_ms": 1.404833048582077, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.086791969835758, "ttft_ms": 18.086791969835758, "decode_ms": 13.148083002306521}, "total_wall_ms": 81.86154207214713, "ttft_ms": 18.086791969835758, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6660489216, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6321594616, "mlx_cache_bytes": 11924030325, "process_rss_bytes": 6660489216}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6321594616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81251979f9176665dd8753403ef6865512a81b37ded2301ff9b93b1aaa0b359f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 53 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "460ff703ed6855d803b68e8d", "attempt_id": "3574d2908fbf", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:53.070846Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 35, "compress_ms": 40.6139160040766}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931854, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 45.90000002644956, "doc_prefill_ms": 204.23550007399172, "compress_ms": 41.965165990404785, "serialize_ms": 3.743416047655046, "load_ms": 0.4890830023214221, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.925332998856902, "ttft_ms": 17.925332998856902, "decode_ms": 13.033624971285462}, "total_wall_ms": 78.78554204944521, "ttft_ms": 17.925332998856902, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6660489216, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6321594616, "mlx_cache_bytes": 11924030325, "process_rss_bytes": 6660489216}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6321594616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de8f9470aaff7fe0e3141b6536c26abb5980aadff4a974bdbfecf8086b67973", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 54 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "69f19d0a9484f7ff49664c33", "attempt_id": "589971a58cc9", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:53.166107Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 50, "compress_ms": 41.5783750358969}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 50, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931854, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 50.718875019811094, "doc_prefill_ms": 204.23550007399172, "compress_ms": 43.01274998579174, "serialize_ms": 7.491875090636313, "load_ms": 0.5655420245602727, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.984500038437545, "ttft_ms": 17.984500038437545, "decode_ms": 118.3042909251526}, "total_wall_ms": 189.14058292284608, "ttft_ms": 17.984500038437545, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 50}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6660603904, "backend_memory": {"mlx_active_bytes": 6287777800, "mlx_peak_bytes": 6334800136, "mlx_cache_bytes": 11962991477, "process_rss_bytes": 6660603904}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6334800136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,783,270", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de8f9470aaff7fe0e3141b6536c26abb5980aadff4a974bdbfecf8086b67973", "output_hash": "2a67a72705453a8a0ac0e1f2be35d695b48ab438e4a12e29209474aa42d00479"} | ||||
| 55 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7e59c56b2a08dd53cbc6de4", "attempt_id": "4c1663d15658", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:53.372446Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 46, "compress_ms": 41.455833008512855}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931856, "side_information_bytes": 15952, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.634458005428314, "doc_prefill_ms": 204.23550007399172, "compress_ms": 42.769167106598616, "serialize_ms": 3.672374994494021, "load_ms": 1.1255410499870777, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.955749994143844, "ttft_ms": 17.955749994143844, "decode_ms": 119.49287494644523}, "total_wall_ms": 186.6872499231249, "ttft_ms": 17.955749994143844, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6660620288, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331261176, "mlx_cache_bytes": 11964466037, "process_rss_bytes": 6660620288}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331261176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,038,565", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81251979f9176665dd8753403ef6865512a81b37ded2301ff9b93b1aaa0b359f", "output_hash": "5b3be4dfb7734981e73c7118a00cbfbf740741bf4328db616823d1c61f07eeec"} | ||||
| 56 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a6eb086d8c0b7772d9d6fb0a", "attempt_id": "ce4dd056a1ee", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:53.575711Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 52, "compress_ms": 41.69745906256139}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 52, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931855, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.80679109878838, "doc_prefill_ms": 204.23550007399172, "compress_ms": 43.02116692997515, "serialize_ms": 3.596707945689559, "load_ms": 1.19012501090765, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.266750033944845, "ttft_ms": 18.266750033944845, "decode_ms": 65.85579202510417}, "total_wall_ms": 133.63141694571823, "ttft_ms": 18.266750033944845, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6660653056, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6335930640, "mlx_cache_bytes": 11987288949, "process_rss_bytes": 6660653056}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6335930640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ba6e95b7abdca0dfcd88e6219641a1e712510e789747f63c79172c956ae05f63", "output_hash": "bd81b870addca9eb7c7a0adcc4951f2aba6a86d8408adc5d88e9806bf8dd99e5"} | ||||
| 57 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ebec783daf4eb6888e8de423", "attempt_id": "c5f3a63e3541", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:53.725940Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 47, "compress_ms": 42.16716706287116}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 47, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931855, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 49.628708977252245, "doc_prefill_ms": 204.23550007399172, "compress_ms": 43.58083405531943, "serialize_ms": 5.850250017829239, "load_ms": 1.1105829617008567, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.980249947868288, "ttft_ms": 17.980249947868288, "decode_ms": 92.36858296208084}, "total_wall_ms": 162.60120901279151, "ttft_ms": 17.980249947868288, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6660653056, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331982088, "mlx_cache_bytes": 11993138037, "process_rss_bytes": 6660653056}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331982088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3145749", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ba6e95b7abdca0dfcd88e6219641a1e712510e789747f63c79172c956ae05f63", "output_hash": "08b6cf317679164258d97c385177468e22385167b1fad2acbd6c93269ccc7317"} | ||||
| 58 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4d6078b20c213ff30ff1264b", "attempt_id": "6c007cb155fe", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:53.905153Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 43, "compress_ms": 41.540584061294794}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 43, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931856, "side_information_bytes": 15952, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.835166052915156, "doc_prefill_ms": 204.23550007399172, "compress_ms": 42.93158301152289, "serialize_ms": 3.714042017236352, "load_ms": 0.46779203694313765, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.98550004605204, "ttft_ms": 17.98550004605204, "decode_ms": 65.88716595433652}, "total_wall_ms": 132.63316708616912, "ttft_ms": 17.98550004605204, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6660685824, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6328541432, "mlx_cache_bytes": 12008588149, "process_rss_bytes": 6660685824}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6328541432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44800", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81251979f9176665dd8753403ef6865512a81b37ded2301ff9b93b1aaa0b359f", "output_hash": "93661967c5350c199b97b6988a521868f90a5734842e7a49347ff8137d853cf4"} | ||||
| 59 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d388285d71a680114920b788", "attempt_id": "a0fddcf2a24f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.054464Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 47, "compress_ms": 41.971916100010276}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 47, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931856, "side_information_bytes": 15952, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.477083979174495, "doc_prefill_ms": 204.23550007399172, "compress_ms": 43.37254201527685, "serialize_ms": 3.9062920259311795, "load_ms": 0.4634170327335596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.857749946415424, "ttft_ms": 17.857749946415424, "decode_ms": 13.141292030923069}, "total_wall_ms": 80.42820799164474, "ttft_ms": 17.857749946415424, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6660685824, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6331982088, "mlx_cache_bytes": 12008588149, "process_rss_bytes": 6660685824}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6331982088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81251979f9176665dd8753403ef6865512a81b37ded2301ff9b93b1aaa0b359f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 60 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d35696a195bed346adcbdc48", "attempt_id": "0dcf904769a0", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.151152Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6247374856}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1943, "keep": 486, "window_tokens": 49, "compress_ms": 41.56625003088266}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 49, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 17915904, "serialized_payload_bytes": 17931855, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 49.64291607029736, "doc_prefill_ms": 204.23550007399172, "compress_ms": 42.90699993725866, "serialize_ms": 6.5391670214012265, "load_ms": 1.5566670335829258, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.015083973295987, "ttft_ms": 18.015083973295987, "decode_ms": 13.389082974754274}, "total_wall_ms": 84.0660419780761, "ttft_ms": 18.015083973295987, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6660685824, "backend_memory": {"mlx_active_bytes": 6286303240, "mlx_peak_bytes": 6333964552, "mlx_cache_bytes": 12014682997, "process_rss_bytes": 6660685824}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6333964552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ba6e95b7abdca0dfcd88e6219641a1e712510e789747f63c79172c956ae05f63", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 61 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6988f16193482be1fcdbcaee", "attempt_id": "3ec001de7da5", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.272593Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 2.5179169606417418, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.703792037442327, "ttft_ms": 21.703792037442327, "decode_ms": 146.01000002585351}, "total_wall_ms": 171.70320893637836, "ttft_ms": 21.703792037442327, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 6741278720, "backend_memory": {"mlx_active_bytes": 6326381320, "mlx_peak_bytes": 6397599980, "mlx_cache_bytes": 12147657405, "process_rss_bytes": 6741278720}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6397599980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 62 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a623e47002f45e360c7ac265", "attempt_id": "e96a178f904a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.461080Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 1.1313339928165078, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.027499995194376, "ttft_ms": 20.027499995194376, "decode_ms": 14.882791903801262}, "total_wall_ms": 37.57045802194625, "ttft_ms": 20.027499995194376, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6741409792, "backend_memory": {"mlx_active_bytes": 6325485352, "mlx_peak_bytes": 6381773612, "mlx_cache_bytes": 12168607389, "process_rss_bytes": 6741409792}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6381773612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 63 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "04de0c9e356b1e8cda08cbdf", "attempt_id": "85b7d3136258", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.515084Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 35, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 2.0080000394955277, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.83466709498316, "ttft_ms": 19.83466709498316, "decode_ms": 14.307625009678304}, "total_wall_ms": 37.54587494768202, "ttft_ms": 19.83466709498316, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6741409792, "backend_memory": {"mlx_active_bytes": 6325485352, "mlx_peak_bytes": 6381773612, "mlx_cache_bytes": 12168607389, "process_rss_bytes": 6741409792}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6381773612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 64 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "942073575857effc7bdf5854", "attempt_id": "e4398c25a6a9", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.568892Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 50, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 1.7285419162362814, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.620000082999468, "ttft_ms": 20.620000082999468, "decode_ms": 100.6297500571236}, "total_wall_ms": 124.46608301252127, "ttft_ms": 20.620000082999468, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 50}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6741573632, "backend_memory": {"mlx_active_bytes": 6326382472, "mlx_peak_bytes": 6403160372, "mlx_cache_bytes": 12198775389, "process_rss_bytes": 6741573632}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6403160372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2705965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "149792af0b004a6863128878a817e8506bb3a8476a6d59878795e90cba3743a6"} | ||||
| 65 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "375c52732d1b6e817782c203", "attempt_id": "b8e01fb8822a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.709461Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 46, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 1.9570000004023314, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.388916949741542, "ttft_ms": 20.388916949741542, "decode_ms": 129.23662492539734}, "total_wall_ms": 153.10520899947733, "ttft_ms": 20.388916949741542, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 6741639168, "backend_memory": {"mlx_active_bytes": 6326380168, "mlx_peak_bytes": 6397598540, "mlx_cache_bytes": 12198777693, "process_rss_bytes": 6741639168}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6397598540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,034,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "b1dc6064f97c41a63e2b857664a4196c5397f8224728e25ada16fcf249b7ed60"} | ||||
| 66 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "67ad4aee5c129de64a7b08cd", "attempt_id": "7fa4370ab368", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.879507Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 52, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 1.9776250701397657, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.741416956298053, "ttft_ms": 20.741416956298053, "decode_ms": 71.91699999384582}, "total_wall_ms": 96.12579201348126, "ttft_ms": 20.741416956298053, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6741655552, "backend_memory": {"mlx_active_bytes": 6326382472, "mlx_peak_bytes": 6405210908, "mlx_cache_bytes": 12228716445, "process_rss_bytes": 6741655552}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6405210908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldnak-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "2b9a4cf7221f1b6f31508a6b3078ec521f211026a932da5020cddd512ecc5fa2"} | ||||
| 67 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a34eb70d05525bbc2635386", "attempt_id": "f0f132a425a0", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:54.992109Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 47, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 1.1551670031622052, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.489374990575016, "ttft_ms": 20.489374990575016, "decode_ms": 100.83820798899978}, "total_wall_ms": 123.9723750622943, "ttft_ms": 20.489374990575016, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 6741671936, "backend_memory": {"mlx_active_bytes": 6326379016, "mlx_peak_bytes": 6398813876, "mlx_cache_bytes": 12255704349, "process_rss_bytes": 6741671936}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6398813876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4306824", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "c69f2ce6ae22e3f15a2371bf64ba27f6439cd33acca311c626826fed99c98447"} | ||||
| 68 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "66b3a6501394ab3bfd6b1b29", "attempt_id": "ecb3e25fbfc3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:55.133906Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 43, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 1.92154198884964, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.301499986089766, "ttft_ms": 20.301499986089766, "decode_ms": 72.36891600769013}, "total_wall_ms": 95.99575004540384, "ttft_ms": 20.301499986089766, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 6741671936, "backend_memory": {"mlx_active_bytes": 6326372136, "mlx_peak_bytes": 6393387852, "mlx_cache_bytes": 12280336381, "process_rss_bytes": 6741671936}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6393387852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44800", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "93661967c5350c199b97b6988a521868f90a5734842e7a49347ff8137d853cf4"} | ||||
| 69 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "88ccfbe0ac89f5a32b800519", "attempt_id": "de5cb9fefca2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:55.246436Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 47, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 1.8968749791383743, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.61141701415181, "ttft_ms": 20.61141701415181, "decode_ms": 14.422458014450967}, "total_wall_ms": 38.3334580110386, "ttft_ms": 20.61141701415181, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6741671936, "backend_memory": {"mlx_active_bytes": 6326372104, "mlx_peak_bytes": 6398813876, "mlx_cache_bytes": 12280336413, "process_rss_bytes": 6741671936}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6398813876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 70 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "99eb5ede6c5868ba3deb3d33", "attempt_id": "35bfc98887a6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:55.301321Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 6286329736}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1904, "source_tokens_receiver": 1904, "query_tokens": 49, "message_tokens": 1943, "message_utf8_bytes": 7128, "cache_tensor_bytes": 38051712, "serialized_payload_bytes": 38085902, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 21.03612502105534, "doc_prefill_ms": 204.23550007399172, "compress_ms": 11.091666063293815, "serialize_ms": 9.600125020369887, "load_ms": 2.001458080485463, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.57125000283122, "ttft_ms": 20.57125000283122, "decode_ms": 14.471041038632393}, "total_wall_ms": 38.5263750795275, "ttft_ms": 20.57125000283122, "input_usage": {"receiver_prefix_tokens": 1943, "dense_cache_bytes": 71626752, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6741671936, "backend_memory": {"mlx_active_bytes": 6326374408, "mlx_peak_bytes": 6401830836, "mlx_cache_bytes": 12308498205, "process_rss_bytes": 6741671936}, "peak_prefill_memory": 7021461328, "peak_decode_memory": 6401830836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6214db98b9866c4a46f9a487bc829c83429d2f6cd9158ee66ec01a6cd75fedba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 71 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c60fce88b35e1a0630b48e6d", "attempt_id": "a261678a0766", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:58.757217Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597378376}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1820, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 213.5984159540385, "ttft_ms": 14.685833011753857, "decode_ms": 96.22766694519669}, "total_wall_ms": 331.5557080786675, "ttft_ms": 14.685833011753857, "input_usage": {"receiver_prompt_tokens": 1820}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13302988800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13282508700, "mlx_cache_bytes": 811848984, "process_rss_bytes": 13302988800}, "peak_prefill_memory": null, "peak_decode_memory": 13282508700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 72 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e322ab0461fcd1f9c6bfdaa", "attempt_id": "ae0ab85c1e11", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:59.106925Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1811, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.2855420531705, "ttft_ms": 13.992541003972292, "decode_ms": 27.402832987718284}, "total_wall_ms": 239.17870805598795, "ttft_ms": 13.992541003972292, "input_usage": {"receiver_prompt_tokens": 1811}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13302988800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13280178336, "mlx_cache_bytes": 1234523416, "process_rss_bytes": 13302988800}, "peak_prefill_memory": null, "peak_decode_memory": 13280178336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 73 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "57986ac9424eff8d9d1cd9a0", "attempt_id": "eaf3f47f8641", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:59.363322Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1811, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 194.69587493222207, "ttft_ms": 13.87841603718698, "decode_ms": 27.68579195253551}, "total_wall_ms": 238.6819999665022, "ttft_ms": 13.87841603718698, "input_usage": {"receiver_prompt_tokens": 1811}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13302988800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13280178336, "mlx_cache_bytes": 1234523416, "process_rss_bytes": 13302988800}, "peak_prefill_memory": null, "peak_decode_memory": 13280178336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 74 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d888c8813d2f7436e1d4c07d", "attempt_id": "00e687cac1f7", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:59.619621Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1826, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 196.64300000295043, "ttft_ms": 13.82645801641047, "decode_ms": 69.60691709537059}, "total_wall_ms": 282.51475002616644, "ttft_ms": 13.82645801641047, "input_usage": {"receiver_prompt_tokens": 1826}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13303005184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13283963064, "mlx_cache_bytes": 1694609820, "process_rss_bytes": 13303005184}, "peak_prefill_memory": null, "peak_decode_memory": 13283963064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,705,965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "dbedb6f5d00e413d915513b85d8ed195b18b9acf392ece342a85e15e3752bcc8"} | ||||
| 75 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "04f30d11466504f48501cfd2", "attempt_id": "5af19848e5c8", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:43:59.919100Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1821, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.952833048068, "ttft_ms": 14.387083938345313, "decode_ms": 70.34920796286315}, "total_wall_ms": 283.17687497474253, "ttft_ms": 14.387083938345313, "input_usage": {"receiver_prompt_tokens": 1821}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13303005184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13282603192, "mlx_cache_bytes": 1873523100, "process_rss_bytes": 13303005184}, "peak_prefill_memory": null, "peak_decode_memory": 13282603192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,034,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "b1dc6064f97c41a63e2b857664a4196c5397f8224728e25ada16fcf249b7ed60"} | ||||
| 76 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a2919882a138d262b484ed37", "attempt_id": "fb36ff033c41", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:00.219163Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1828, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.32795900199562, "ttft_ms": 14.131458010524511, "decode_ms": 55.07029208820313}, "total_wall_ms": 269.0316670341417, "ttft_ms": 14.131458010524511, "input_usage": {"receiver_prompt_tokens": 1828}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 13303021568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13284520128, "mlx_cache_bytes": 2300399144, "process_rss_bytes": 13303021568}, "peak_prefill_memory": null, "peak_decode_memory": 13284520128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "bd81b870addca9eb7c7a0adcc4951f2aba6a86d8408adc5d88e9806bf8dd99e5"} | ||||
| 77 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c6089ef9fdd1e572ddb495bd", "attempt_id": "fb224b9e148b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:00.505524Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1823, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.0040840310976, "ttft_ms": 14.21437505632639, "decode_ms": 570.2231250470504}, "total_wall_ms": 782.0588329341263, "ttft_ms": 14.21437505632639, "input_usage": {"receiver_prompt_tokens": 1823}, "output_usage": {"output_tokens": 41}, "provider_cached_usage": null, "process_memory": 13303021568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13319942340, "mlx_cache_bytes": 2535542312, "process_rss_bytes": 13303021568}, "peak_prefill_memory": null, "peak_decode_memory": 13319942340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745\n9,127,965\n9,440,170\n2,358,405\n1,243,700\n1,034,805\n1,402,360", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "cd41f3380842fa3834fc775984a2c5834a64f6f09a32b5030c21f2d020c827fb"} | ||||
| 78 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "66fecc44e5edd0f71b9fef39", "attempt_id": "7c043e5a6693", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:01.304440Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1819, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 194.666916038841, "ttft_ms": 14.193083974532783, "decode_ms": 41.44749999977648}, "total_wall_ms": 252.73991690482944, "ttft_ms": 14.193083974532783, "input_usage": {"receiver_prompt_tokens": 1819}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 13303021568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13315993760, "mlx_cache_bytes": 2591411752, "process_rss_bytes": 13303021568}, "peak_prefill_memory": null, "peak_decode_memory": 13315993760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "151d42ff8288534a7de93c03896738e8e7fbce36d2650f7188a60efb69cb93d3"} | ||||
| 79 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5df9df4ed03d89f25bc33bb5", "attempt_id": "66c7c04a291e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:01.574429Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1822, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 194.24674997571856, "ttft_ms": 13.830833020620048, "decode_ms": 13.869791990146041}, "total_wall_ms": 224.41366699058563, "ttft_ms": 13.830833020620048, "input_usage": {"receiver_prompt_tokens": 1822}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303021568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13282799800, "mlx_cache_bytes": 2591411752, "process_rss_bytes": 13303021568}, "peak_prefill_memory": null, "peak_decode_memory": 13282799800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 80 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0858e56cc3c670f54f3ca7f5", "attempt_id": "dd5df742686f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:01.815631Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 1825, "message_tokens": 1715, "message_utf8_bytes": 7128, "cache_tensor_bytes": null, "serialized_payload_bytes": 7128, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.004417030140757561, "decode_payload_ms": 0.0, "receiver_prefill_ms": 193.4084160020575, "ttft_ms": 14.173874980770051, "decode_ms": 13.73354101087898}, "total_wall_ms": 223.7972499569878, "ttft_ms": 14.173874980770051, "input_usage": {"receiver_prompt_tokens": 1825}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303119872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13283733688, "mlx_cache_bytes": 2591411752, "process_rss_bytes": 13303119872}, "peak_prefill_memory": null, "peak_decode_memory": 13283733688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 81 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf9bfc5c61b5b32e64498ad6", "attempt_id": "a9baa202e4bf", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:09.385042Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.42320897523314, "ttft_ms": 13.53895803913474, "decode_ms": 94.42066692281514}, "total_wall_ms": 186.56062497757375, "ttft_ms": 13.53895803913474, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 4074470584, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 82 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8f2f2e5c31c1ca8c20daa77e", "attempt_id": "a5935de963ae", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:09.589408Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.99720789585263, "ttft_ms": 13.504332979209721, "decode_ms": 13.480541994795203}, "total_wall_ms": 104.01845898013562, "ttft_ms": 13.504332979209721, "input_usage": {"receiver_prompt_tokens": 612, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13045308936, "mlx_cache_bytes": 4394187960, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13045308936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 83 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b1847967d4138aea810cc27c", "attempt_id": "f10285891a9a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:09.710862Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.52200001757592, "ttft_ms": 13.470040983520448, "decode_ms": 27.260666014626622}, "total_wall_ms": 118.36491606663913, "ttft_ms": 13.470040983520448, "input_usage": {"receiver_prompt_tokens": 612, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13049093640, "mlx_cache_bytes": 4394187960, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13049093640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 84 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "801fe9bb43b7b8d210a2c713", "attempt_id": "b505a05e2ba5", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:09.847556Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.31608301401138, "ttft_ms": 13.671249966137111, "decode_ms": 67.74341699201614}, "total_wall_ms": 159.87554204184562, "ttft_ms": 13.671249966137111, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13045538336, "mlx_cache_bytes": 4767663744, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13045538336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,286,335", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "ad12cae12fcb74f37d058b6ea742f49f7deedd0b26b93a1cd0e06f5d0a9ae91d"} | ||||
| 85 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a343f46318d52c453e00102a", "attempt_id": "2a22c1da7a26", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:10.025136Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.93408406339586, "ttft_ms": 13.762042042799294, "decode_ms": 13.703124946914613}, "total_wall_ms": 105.47962505370378, "ttft_ms": 13.762042042799294, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540064, "mlx_cache_bytes": 4950902400, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13042540064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 86 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "291b53b6711cf93b71193daf", "attempt_id": "a752fea5710b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:10.147161Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 629, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.60362501721829, "ttft_ms": 13.876832905225456, "decode_ms": 13.395083020441234}, "total_wall_ms": 106.0405420139432, "ttft_ms": 13.876832905225456, "input_usage": {"receiver_prompt_tokens": 629, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046799912, "mlx_cache_bytes": 5302374480, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13046799912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 87 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c671c67dbfb04d35db7b9ae1", "attempt_id": "61238bd4b708", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:10.270494Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.87624997925013, "ttft_ms": 13.415542081929743, "decode_ms": 256.58891699276865}, "total_wall_ms": 347.977208904922, "ttft_ms": 13.415542081929743, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13075340832, "mlx_cache_bytes": 5463199824, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13075340832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745 + 2,358,405 = 11,579,150", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "fb64200bc6e459df3ddf643c28ef1dd5851ff522ffbf76c6fda661efdd7d4f18"} | ||||
| 88 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5681d45672e60b9bed90f4f4", "attempt_id": "a8c0dcb2f88c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:10.636015Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.43412507604808, "ttft_ms": 13.475208077579737, "decode_ms": 13.482791953720152}, "total_wall_ms": 104.42562494426966, "ttft_ms": 13.475208077579737, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 5463199824, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 89 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea00306c1597ab1222df5ac4", "attempt_id": "d64bf3fc9733", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:10.758037Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 623, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.61862501502037, "ttft_ms": 13.588084024377167, "decode_ms": 13.716500019654632}, "total_wall_ms": 105.98008392844349, "ttft_ms": 13.588084024377167, "input_usage": {"receiver_prompt_tokens": 623, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13082648096, "mlx_cache_bytes": 5463199824, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13082648096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 90 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b0059da77f3415b400f4c8b", "attempt_id": "a3fb5b13bb91", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:10.881466Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 1670, "cache_tensor_bytes": null, "serialized_payload_bytes": 1670, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7328.180167009123, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.1422500256449, "ttft_ms": 13.513582991436124, "decode_ms": 13.538375031203032}, "total_wall_ms": 105.22816597949713, "ttft_ms": 13.513582991436124, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 1849, "sender_output_tokens": 512, "sender_prefill_ms": 196.90274994354695, "sender_ttft_ms": 13.920916942879558, "sender_decode_ms": 7115.986083052121}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303201792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13045538336, "mlx_cache_bytes": 5463199824, "process_rss_bytes": 13303201792}, "peak_prefill_memory": null, "peak_decode_memory": 13045538336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13d17525ecae01af6559c59de8e6c27b31490bd7b40a2586dd9256053e02f631", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 91 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d8dcc420f1869a0c547121b", "attempt_id": "fd61f50e19a6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:18.330727Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 489, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 57.025999994948506, "ttft_ms": 13.587541994638741, "decode_ms": 94.41491705365479}, "total_wall_ms": 165.95683293417096, "ttft_ms": 13.587541994638741, "input_usage": {"receiver_prompt_tokens": 489, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13303218176, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12936846424, "mlx_cache_bytes": 6192770472, "process_rss_bytes": 13303218176}, "peak_prefill_memory": null, "peak_decode_memory": 12936846424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 92 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38b2f91a414c6d96872c5c44", "attempt_id": "3dd00e0f594f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:18.514778Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 480, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.74408303759992, "ttft_ms": 13.549790950492024, "decode_ms": 13.725875061936677}, "total_wall_ms": 81.8753750063479, "ttft_ms": 13.549790950492024, "input_usage": {"receiver_prompt_tokens": 480, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303250944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12932324440, "mlx_cache_bytes": 6460943784, "process_rss_bytes": 13303250944}, "peak_prefill_memory": null, "peak_decode_memory": 12932324440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 93 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0af199c6b7d5c932e3b909f3", "attempt_id": "230b58a4ab91", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:18.614802Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 480, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.597416961565614, "ttft_ms": 13.288083020597696, "decode_ms": 13.935583992861211}, "total_wall_ms": 81.69420796912163, "ttft_ms": 13.288083020597696, "input_usage": {"receiver_prompt_tokens": 480, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303267328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12932324440, "mlx_cache_bytes": 6460943784, "process_rss_bytes": 13303267328}, "peak_prefill_memory": null, "peak_decode_memory": 12932324440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 94 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ac30c44fda22e8249686a60f", "attempt_id": "2d35f871e94f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:18.713667Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 495, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 57.45104199741036, "ttft_ms": 13.50866595748812, "decode_ms": 67.30441690888256}, "total_wall_ms": 139.15379205718637, "ttft_ms": 13.50866595748812, "input_usage": {"receiver_prompt_tokens": 495, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13303267328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12940926040, "mlx_cache_bytes": 6755954088, "process_rss_bytes": 13303267328}, "peak_prefill_memory": null, "peak_decode_memory": 12940926040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,286,335", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "ad12cae12fcb74f37d058b6ea742f49f7deedd0b26b93a1cd0e06f5d0a9ae91d"} | ||||
| 95 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fd2c25d055cba4afca1b71be", "attempt_id": "5c1c6d4474f9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:18.870530Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 490, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.718042003922164, "ttft_ms": 13.525041984394193, "decode_ms": 13.317208969965577}, "total_wall_ms": 84.41966702230275, "ttft_ms": 13.525041984394193, "input_usage": {"receiver_prompt_tokens": 490, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303283712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12938222680, "mlx_cache_bytes": 7029894568, "process_rss_bytes": 13303283712}, "peak_prefill_memory": null, "peak_decode_memory": 12938222680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 96 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e5a1efa2ba61db561cc4fd3e", "attempt_id": "7d709aee84ed", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:18.971971Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 497, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 57.28220799937844, "ttft_ms": 13.573999982327223, "decode_ms": 13.367709005251527}, "total_wall_ms": 85.1130000082776, "ttft_ms": 13.573999982327223, "input_usage": {"receiver_prompt_tokens": 497, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303283712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12941483096, "mlx_cache_bytes": 7176170920, "process_rss_bytes": 13303283712}, "peak_prefill_memory": null, "peak_decode_memory": 12941483096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 97 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35264610e2725538961dd7ee", "attempt_id": "d37e0a4baff1", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.074567Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 492, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.274583912454545, "ttft_ms": 13.493041973561049, "decode_ms": 13.449707999825478}, "total_wall_ms": 84.07062501646578, "ttft_ms": 13.493041973561049, "input_usage": {"receiver_prompt_tokens": 492, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303300096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12964600920, "mlx_cache_bytes": 7303015848, "process_rss_bytes": 13303300096}, "peak_prefill_memory": null, "peak_decode_memory": 12964600920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 98 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "84f0cea5a9c83f3eabc8e2b4", "attempt_id": "85825e0289a2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.175732Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 488, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.853167083114386, "ttft_ms": 13.458541943691671, "decode_ms": 13.33600003272295}, "total_wall_ms": 83.54949997738004, "ttft_ms": 13.458541943691671, "input_usage": {"receiver_prompt_tokens": 488, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303316480, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12936846424, "mlx_cache_bytes": 7303015848, "process_rss_bytes": 13303316480}, "peak_prefill_memory": null, "peak_decode_memory": 12936846424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 99 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5c26f4b4393119029741a4d9", "attempt_id": "9e1d1e2de4f0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.276660Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 491, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.891582975164056, "ttft_ms": 13.44983302988112, "decode_ms": 13.331374968402088}, "total_wall_ms": 83.55062501505017, "ttft_ms": 13.44983302988112, "input_usage": {"receiver_prompt_tokens": 491, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303316480, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12938583128, "mlx_cache_bytes": 7303015848, "process_rss_bytes": 13303316480}, "peak_prefill_memory": null, "peak_decode_memory": 12938583128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9786a3e40c4fac0ecf38ea12", "attempt_id": "f16ea00fd4b0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.377163Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 494, "message_tokens": 368, "message_utf8_bytes": 1017, "cache_tensor_bytes": null, "serialized_payload_bytes": 1017, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7326.700291014276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 57.401874917559326, "ttft_ms": 13.479041983373463, "decode_ms": 13.546166010200977}, "total_wall_ms": 85.28416696935892, "ttft_ms": 13.479041983373463, "input_usage": {"receiver_prompt_tokens": 494, "sender_input_tokens": 1879, "sender_output_tokens": 512, "sender_prefill_ms": 200.1767500769347, "sender_ttft_ms": 14.02362494263798, "sender_decode_ms": 7110.871208016761}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971236440, "mlx_cache_bytes": 7303015848, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 12971236440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 10, "unresolved_quotes": 2, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f3c7832b56a2042384c78ad6d01645667830c362c55d61569f1eede8a91b0c28", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "83dc2915830fcc1c42b9d65f", "attempt_id": "45e919ca5a29", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.481205Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 615, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.22724992688745, "ttft_ms": 13.595041004009545, "decode_ms": 13.475958025082946}, "total_wall_ms": 104.37925008591264, "ttft_ms": 13.595041004009545, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083016, "mlx_cache_bytes": 7612771752, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13039083016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7041f0b28e5301431aa56668", "attempt_id": "50241e29d7f0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.602704Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 606, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.25733294803649, "ttft_ms": 13.501249952241778, "decode_ms": 27.036166982725263}, "total_wall_ms": 115.84554193541408, "ttft_ms": 13.501249952241778, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040836104, "mlx_cache_bytes": 7951314344, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13040836104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "973eca5eeeffce0eca3e9b40", "attempt_id": "5d2fd7633236", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.735719Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 606, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.83712490648031, "ttft_ms": 13.323041959665716, "decode_ms": 26.926457998342812}, "total_wall_ms": 116.15891591645777, "ttft_ms": 13.323041959665716, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13044571656, "mlx_cache_bytes": 7951314344, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13044571656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b6ea9e5469113f0668b09134", "attempt_id": "c1257fad655d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:19.868911Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 621, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.60020899493247, "ttft_ms": 13.558374950662255, "decode_ms": 67.48654192779213}, "total_wall_ms": 158.74862507916987, "ttft_ms": 13.558374950662255, "input_usage": {"receiver_prompt_tokens": 621}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 7951314344, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,705,965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "dbedb6f5d00e413d915513b85d8ed195b18b9acf392ece342a85e15e3752bcc8"} | ||||
| 105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3fdb50094d9bbaa1177086f7", "attempt_id": "65ecee866efa", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:20.045169Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 616, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.29637501668185, "ttft_ms": 13.682042015716434, "decode_ms": 68.22391599416733}, "total_wall_ms": 159.26941600628197, "ttft_ms": 13.682042015716434, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039459848, "mlx_cache_bytes": 8132783528, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13039459848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,034,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "b1dc6064f97c41a63e2b857664a4196c5397f8224728e25ada16fcf249b7ed60"} | ||||
| 106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "46a08fc5c1f7623442b7594d", "attempt_id": "c03d03d038c8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:20.221210Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 623, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.69195805303752, "ttft_ms": 13.470666948705912, "decode_ms": 53.82141598965973}, "total_wall_ms": 146.051749936305, "ttft_ms": 13.470666948705912, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13082648096, "mlx_cache_bytes": 8132783528, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13082648096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "bd81b870addca9eb7c7a0adcc4951f2aba6a86d8408adc5d88e9806bf8dd99e5"} | ||||
| 107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5803c7e7b0f7ccb30c681c7c", "attempt_id": "f6a965c79d2f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:20.385101Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 618, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.69337501283735, "ttft_ms": 13.40624992735684, "decode_ms": 67.22645799163729}, "total_wall_ms": 158.39733299799263, "ttft_ms": 13.40624992735684, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071998472, "mlx_cache_bytes": 8292101544, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13071998472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "ae55ba88b2cb1b0f1a4e0960ae312e0a1c177c79a6d14b67bff1677cec19b649"} | ||||
| 108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "798becd0e5b5234de7e79735", "attempt_id": "fc013fdb7d95", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:20.561356Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 614, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.06312504503876, "ttft_ms": 13.508333009667695, "decode_ms": 13.518832973204553}, "total_wall_ms": 104.11279194522649, "ttft_ms": 13.508333009667695, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13049830920, "mlx_cache_bytes": 8292101544, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13049830920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1eac10bd3a797486b4f63f37", "attempt_id": "1ca5b428cc60", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:20.682703Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 617, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.3449160149321, "ttft_ms": 13.557165977545083, "decode_ms": 13.37079203221947}, "total_wall_ms": 104.28495798259974, "ttft_ms": 13.557165977545083, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039820296, "mlx_cache_bytes": 8292101544, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13039820296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "43517aa36c202742a3adaf8a", "attempt_id": "6ca6439bbc34", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:20.805290Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 620, "message_tokens": 509, "message_utf8_bytes": 1654, "cache_tensor_bytes": null, "serialized_payload_bytes": 1654, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6468750545755029, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.78254100028425, "ttft_ms": 13.561124913394451, "decode_ms": 13.546666014008224}, "total_wall_ms": 104.91858306340873, "ttft_ms": 13.561124913394451, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13303332864, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 8292101544, "process_rss_bytes": 13303332864}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "63fe357d2aa8485c22ef8e6d958dc06f22cc13db358d8099d2fdb6f67662ce19", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1670d32687d731bd8dcbf223", "attempt_id": "484f7c67f6c7", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.133261Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 45, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.2167500099167228, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.97279203310609, "ttft_ms": 17.97279203310609, "decode_ms": 260.29383298009634}, "total_wall_ms": 280.99604102317244, "ttft_ms": 17.97279203310609, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 45}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": 13405847552, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12958389560, "mlx_cache_bytes": 8813276585, "process_rss_bytes": 13405847552}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12958389560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "There is no mention of a project with site Lot 409-H in Senneterre.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "d87def5ff6c1d5cfa5cb6762811b09c458bfe6d90a075a7e66ddc2e937618006"} | ||||
| 112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fa4d83ca526bf465d16401b4", "attempt_id": "bee6c560bfe1", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.432369Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 36, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.64899998344481, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.534916987642646, "ttft_ms": 17.534916987642646, "decode_ms": 13.637666939757764}, "total_wall_ms": 34.16912502143532, "ttft_ms": 17.534916987642646, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12910875656, "mlx_peak_bytes": 12950443320, "mlx_cache_bytes": 8884530601, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12950443320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "04ad8a752561980facaf3dac", "attempt_id": "7d74ee9c48cf", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.483935Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 36, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.6370409866794944, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.015041084960103, "ttft_ms": 17.015041084960103, "decode_ms": 13.66425002925098}, "total_wall_ms": 33.64912490360439, "ttft_ms": 17.015041084960103, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12911137800, "mlx_peak_bytes": 12950443320, "mlx_cache_bytes": 8884268457, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12950443320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e6b09eace1e78fe758708d8a", "attempt_id": "0f340377de36", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.534402Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 51, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.421791035681963, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.839167034253478, "ttft_ms": 17.839167034253478, "decode_ms": 27.34154195059091}, "total_wall_ms": 47.93979192618281, "ttft_ms": 17.839167034253478, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 51}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12963812664, "mlx_cache_bytes": 8925984722, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12963812664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "40dc4ab5359a3138fe61eee0", "attempt_id": "66e57fcde7c6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.599571Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 46, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.6370840603485703, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.681165947578847, "ttft_ms": 17.681165947578847, "decode_ms": 27.311665937304497}, "total_wall_ms": 48.006291035562754, "ttft_ms": 17.681165947578847, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 46}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12959618360, "mlx_cache_bytes": 8964929490, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12959618360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "377555894d4e98b909064cb6", "attempt_id": "d135aca6277a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.665035Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 53, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 0.6469159852713346, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.77808298356831, "ttft_ms": 17.77808298356831, "decode_ms": 150.47554206103086}, "total_wall_ms": 170.27608305215836, "ttft_ms": 17.77808298356831, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 53}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12966614328, "mlx_cache_bytes": 8988852939, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12966614328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "There is no project code for Wendra-7.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.25}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "9d51965eca3684b10927f102a874d808dae4dcc7a04f9bfd0fa2c4cb72bd212e"} | ||||
| 117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c7395b3c61f6b24876554d9", "attempt_id": "0005538f700c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.853245Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 48, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.627334044314921, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.755749984644353, "ttft_ms": 17.755749984644353, "decode_ms": 68.10916599351913}, "total_wall_ms": 88.8993329135701, "ttft_ms": 17.755749984644353, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12960585016, "mlx_cache_bytes": 9012183755, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12960585016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13,911,678", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "ddeaae8fdd33bc2beda09766011cfeb30a8ed3c728d614bc008fda946ce53292"} | ||||
| 118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "62323b44ad492a4746788bee", "attempt_id": "64e2cb05c9c7", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:21.959558Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 44, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 0.6534999702125788, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.378165968693793, "ttft_ms": 17.378165968693793, "decode_ms": 40.73933302424848}, "total_wall_ms": 60.104125062935054, "ttft_ms": 17.378165968693793, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12957832504, "mlx_cache_bytes": 9025307339, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12957832504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "151d42ff8288534a7de93c03896738e8e7fbce36d2650f7188a60efb69cb93d3"} | ||||
| 119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d51a8b96b2a8b2a90edc2784", "attempt_id": "2861950eb4bd", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.037355Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 47, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.4722920022904873, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.541500041261315, "ttft_ms": 17.541500041261315, "decode_ms": 13.627583044581115}, "total_wall_ms": 33.96179201081395, "ttft_ms": 17.541500041261315, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12960322872, "mlx_cache_bytes": 9037365963, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12960322872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "938d117f3860090361ca4a13", "attempt_id": "f509dc3a586d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.088428Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1775, "keep": 444, "compress_ms": 6.849125027656555}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 50, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934354, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.98537498153746, "doc_prefill_ms": 183.3567499415949, "compress_ms": 6.886375020258129, "serialize_ms": 13.108416926115751, "load_ms": 1.6789590008556843, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.672874964773655, "ttft_ms": 17.672874964773655, "decode_ms": 13.577332952991128}, "total_wall_ms": 34.32137507479638, "ttft_ms": 17.672874964773655, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13405962240, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12966319416, "mlx_cache_bytes": 9053930187, "process_rss_bytes": 13405962240}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12966319416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16877e72e86114da34dfc4c16b42071ee46e58bc77850f6915945f663477cd6a", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c95aa702cc7a7e3b15ece9a", "attempt_id": "75e6076c1d87", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.139762Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 45, "compress_ms": 47.09112492855638}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 45, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 65.73295802809298, "doc_prefill_ms": 183.3567499415949, "compress_ms": 48.37058298289776, "serialize_ms": 17.1827090671286, "load_ms": 1.5370419714599848, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.41958293132484, "ttft_ms": 17.41958293132484, "decode_ms": 96.04524995665997}, "total_wall_ms": 182.16737499460578, "ttft_ms": 17.41958293132484, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13407698944, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12958389560, "mlx_cache_bytes": 9470673611, "process_rss_bytes": 13407698944}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12958389560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "73cd1b5952c9a3877ab1d0b5", "attempt_id": "b6b29fc4a7c5", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.339378Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 36, "compress_ms": 42.83416597172618}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 36, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 57.48070892877877, "doc_prefill_ms": 183.3567499415949, "compress_ms": 44.11808296572417, "serialize_ms": 13.180124922655523, "load_ms": 1.4227499486878514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.4792500436306, "ttft_ms": 16.4792500436306, "decode_ms": 27.243959018960595}, "total_wall_ms": 104.00804202072322, "ttft_ms": 16.4792500436306, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12910908424, "mlx_peak_bytes": 12950443320, "mlx_cache_bytes": 9488138955, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12950443320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f30decb0e1e849edd54e2f7c", "attempt_id": "70890a93c317", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.461115Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 36, "compress_ms": 41.73041693866253}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 36, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.64408395346254, "doc_prefill_ms": 183.3567499415949, "compress_ms": 43.0189169710502, "serialize_ms": 11.445790994912386, "load_ms": 1.5428749611601233, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.71233295928687, "ttft_ms": 16.71233295928687, "decode_ms": 27.259625028818846}, "total_wall_ms": 101.58387501724064, "ttft_ms": 16.71233295928687, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12910908424, "mlx_peak_bytes": 12950443320, "mlx_cache_bytes": 9488138955, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12950443320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6b47230febab84dcdf34acb0", "attempt_id": "33ea23c0065b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.580065Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 51, "compress_ms": 42.7065419498831}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 51, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934393, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.19745903741568, "doc_prefill_ms": 183.3567499415949, "compress_ms": 43.977417051792145, "serialize_ms": 8.038708008825779, "load_ms": 1.6058749752119184, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.49116601422429, "ttft_ms": 17.49116601422429, "decode_ms": 69.38379106577486}, "total_wall_ms": 142.1215001028031, "ttft_ms": 17.49116601422429, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12963812664, "mlx_cache_bytes": 9512420043, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12963812664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,705,965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8e11a92ca8434c0cfeb259e989e26d99f5f17004bfde5cad93e10855381a39f0", "output_hash": "dbedb6f5d00e413d915513b85d8ed195b18b9acf392ece342a85e15e3752bcc8"} | ||||
| 125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d8ec9bd09a1b9d4a0cdfe6b3", "attempt_id": "8a84badacb9e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.740207Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 46, "compress_ms": 43.529000016860664}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 46, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934395, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.25645790435374, "doc_prefill_ms": 183.3567499415949, "compress_ms": 44.79004198219627, "serialize_ms": 8.284332929179072, "load_ms": 0.5514170043170452, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.27312500588596, "ttft_ms": 17.27312500588596, "decode_ms": 67.92337505612522}, "total_wall_ms": 140.44408302288502, "ttft_ms": 17.27312500588596, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12959618360, "mlx_cache_bytes": 9526936267, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12959618360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,034,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5fe9f9224a2235a341a6075ac5c352492962dcfe86be94ddbf512282a6f7b8d", "output_hash": "b1dc6064f97c41a63e2b857664a4196c5397f8224728e25ada16fcf249b7ed60"} | ||||
| 126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a51c992aae1634d34118bde9", "attempt_id": "389d994a0165", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:22.898730Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 53, "compress_ms": 43.208292103372514}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 53, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934395, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.82008403446525, "doc_prefill_ms": 183.3567499415949, "compress_ms": 44.49245799332857, "serialize_ms": 8.153417031280696, "load_ms": 1.5842919237911701, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.52137509174645, "ttft_ms": 17.52137509174645, "decode_ms": 54.488208959810436}, "total_wall_ms": 127.84729106351733, "ttft_ms": 17.52137509174645, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 53}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12966614328, "mlx_cache_bytes": 9534800587, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12966614328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5fe9f9224a2235a341a6075ac5c352492962dcfe86be94ddbf512282a6f7b8d", "output_hash": "bd81b870addca9eb7c7a0adcc4951f2aba6a86d8408adc5d88e9806bf8dd99e5"} | ||||
| 127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5190bc2fbbdcaea156e6abff", "attempt_id": "88582ce0e15b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.045081Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 48, "compress_ms": 43.07750007137656}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 48, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.955082966946065, "doc_prefill_ms": 183.3567499415949, "compress_ms": 44.34429109096527, "serialize_ms": 8.421542006544769, "load_ms": 1.5682500088587403, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.308958107605577, "ttft_ms": 17.308958107605577, "decode_ms": 68.94616596400738}, "total_wall_ms": 142.24462502170354, "ttft_ms": 17.308958107605577, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12960585016, "mlx_cache_bytes": 9542992587, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12960585016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "ae55ba88b2cb1b0f1a4e0960ae312e0a1c177c79a6d14b67bff1677cec19b649"} | ||||
| 128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3339881d8289c04fd29e7583", "attempt_id": "193bc4039da6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.205396Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 44, "compress_ms": 42.82579105347395}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 44, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.42895905394107, "doc_prefill_ms": 183.3567499415949, "compress_ms": 44.092708034440875, "serialize_ms": 8.16408300306648, "load_ms": 1.5022910665720701, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.28466700296849, "ttft_ms": 17.28466700296849, "decode_ms": 40.72037502191961}, "total_wall_ms": 113.28541592229158, "ttft_ms": 17.28466700296849, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12957832504, "mlx_cache_bytes": 9552331467, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12957832504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "151d42ff8288534a7de93c03896738e8e7fbce36d2650f7188a60efb69cb93d3"} | ||||
| 129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b8daf627d8ed7fb49db764d", "attempt_id": "e5c8f147379b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.336429Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 47, "compress_ms": 43.71345799881965}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 47, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 59.18462492991239, "doc_prefill_ms": 183.3567499415949, "compress_ms": 45.01066589727998, "serialize_ms": 13.997208094224334, "load_ms": 1.3063750229775906, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.423750017769635, "ttft_ms": 17.423750017769635, "decode_ms": 13.622249942272902}, "total_wall_ms": 92.90695795789361, "ttft_ms": 17.423750017769635, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12960322872, "mlx_cache_bytes": 9552331467, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12960322872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b2b3b67fa7cfe6e5c144812c", "attempt_id": "68a15b5f6724", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.447087Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1775, "keep": 444, "window_tokens": 50, "compress_ms": 42.8931670030579}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 50, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934393, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.994374979287386, "doc_prefill_ms": 183.3567499415949, "compress_ms": 44.156249961815774, "serialize_ms": 10.668166913092136, "load_ms": 1.7151669599115849, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.437624977901578, "ttft_ms": 17.437624977901578, "decode_ms": 13.731874991208315}, "total_wall_ms": 89.27266695536673, "ttft_ms": 17.437624977901578, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13459144704, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12966696248, "mlx_cache_bytes": 9560867531, "process_rss_bytes": 13459144704}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 12966696248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8e11a92ca8434c0cfeb259e989e26d99f5f17004bfde5cad93e10855381a39f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8a2d8db1b25cfacb0bd21d26", "attempt_id": "62aba9a537d3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.587324Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 45, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 3.302167053334415, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.28375002555549, "ttft_ms": 20.28375002555549, "decode_ms": 104.12608401384205}, "total_wall_ms": 129.06991702038795, "ttft_ms": 20.28375002555549, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13110396769, "mlx_cache_bytes": 9938097515, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13110396769, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LY-51E-3199", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "a1245d1536890a7e4b026366df48441d503f491f782cfd388797b5782443c5c7"} | ||||
| 132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eb5054e56de9cff37bf0a8d8", "attempt_id": "ef1bc49228b2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.734424Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 36, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.202250063419342, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.595000077970326, "ttft_ms": 19.595000077970326, "decode_ms": 30.017334036529064}, "total_wall_ms": 53.168208920396864, "ttft_ms": 19.595000077970326, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024072712, "mlx_peak_bytes": 13098481648, "mlx_cache_bytes": 9961614315, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13098481648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "710b26a470d0b5d48ec683f6", "attempt_id": "12974eebe862", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.804486Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 36, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.1837089443579316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.464208045974374, "ttft_ms": 19.464208045974374, "decode_ms": 29.493791982531548}, "total_wall_ms": 52.53708397503942, "ttft_ms": 19.464208045974374, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024072712, "mlx_peak_bytes": 13098548336, "mlx_cache_bytes": 9961614315, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13098548336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1e73a25fccbc4029613268de", "attempt_id": "79b1e7a3a8e1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.874983Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 51, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.293333993293345, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.244040992110968, "ttft_ms": 20.244040992110968, "decode_ms": 74.51716694049537}, "total_wall_ms": 98.42454199679196, "ttft_ms": 20.244040992110968, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13120523809, "mlx_cache_bytes": 9993020747, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13120523809, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,705,965", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "dbedb6f5d00e413d915513b85d8ed195b18b9acf392ece342a85e15e3752bcc8"} | ||||
| 135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "615aa66884ac96b2edd3e214", "attempt_id": "f65596288ac6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:23.991143Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 46, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.283124951645732, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.500166923739016, "ttft_ms": 20.500166923739016, "decode_ms": 73.48699995782226}, "total_wall_ms": 97.63212502002716, "ttft_ms": 20.500166923739016, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13121636016, "mlx_cache_bytes": 9993020747, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13121636016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,034,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "b1dc6064f97c41a63e2b857664a4196c5397f8224728e25ada16fcf249b7ed60"} | ||||
| 136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "05ecaea3e53e98d415fa2432", "attempt_id": "fe71bfdd988e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:24.106907Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 53, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.083832980133593, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.595500012859702, "ttft_ms": 20.595500012859702, "decode_ms": 58.668999932706356}, "total_wall_ms": 82.7681659720838, "ttft_ms": 20.595500012859702, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 53}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13108965748, "mlx_cache_bytes": 10020947563, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13108965748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wendra-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "bd81b870addca9eb7c7a0adcc4951f2aba6a86d8408adc5d88e9806bf8dd99e5"} | ||||
| 137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ac75682984e5cbd64a9070b", "attempt_id": "d7899de49aba", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:24.207552Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 48, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.1913329837843776, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.15016693621874, "ttft_ms": 20.15016693621874, "decode_ms": 605.2698328858241}, "total_wall_ms": 629.0046670474112, "ttft_ms": 20.15016693621874, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 48}, "output_usage": {"output_tokens": 41}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13026825224, "mlx_peak_bytes": 13114328656, "mlx_cache_bytes": 10323445355, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13114328656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,220,745\n9,127,965\n9,440,170\n2,358,405\n1,243,700\n1,034,805\n1,402,360", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "cd41f3380842fa3834fc775984a2c5834a64f6f09a32b5030c21f2d020c827fb"} | ||||
| 138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e96f998526278ba040c47dd", "attempt_id": "f5a05899920b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:24.855208Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 44, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.285166992805898, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.040167029947042, "ttft_ms": 20.040167029947042, "decode_ms": 44.346165959723294}, "total_wall_ms": 68.0349589092657, "ttft_ms": 20.040167029947042, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024072712, "mlx_peak_bytes": 13109605360, "mlx_cache_bytes": 10326197867, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13109605360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "151d42ff8288534a7de93c03896738e8e7fbce36d2650f7188a60efb69cb93d3"} | ||||
| 139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e9d7c858d3e7fb614d38442e", "attempt_id": "240100458ae4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:24.941172Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 47, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.2104589734226465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.07833297830075, "ttft_ms": 20.07833297830075, "decode_ms": 14.871375053189695}, "total_wall_ms": 38.51191699504852, "ttft_ms": 20.07833297830075, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024072712, "mlx_peak_bytes": 13113476688, "mlx_cache_bytes": 10354984555, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13113476688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "14a21df8ab5b1004f1efebe2", "attempt_id": "3884c00d4d7c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:24.996656Z", "task_family": "synthetic", "document_id": "syn_03000_2000", "document_hash": "c9cc27c20b05b1f6e592846e84990ee9b69c42f9720a8e338ec2f6fca777fdbc", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03000_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12912137224}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1715, "source_tokens_receiver": 1715, "query_tokens": 50, "message_tokens": 1775, "message_utf8_bytes": 7128, "cache_tensor_bytes": 108147200, "serialized_payload_bytes": 108174316, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.61283300910145, "doc_prefill_ms": 183.3567499415949, "compress_ms": 10.511875036172569, "serialize_ms": 22.82095793634653, "load_ms": 2.171166939660907, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.334457978606224, "ttft_ms": 20.334457978606224, "decode_ms": 14.91004100535065}, "total_wall_ms": 38.75704202800989, "ttft_ms": 20.334457978606224, "input_usage": {"receiver_prefix_tokens": 1775, "dense_cache_bytes": 203571200, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13676560384, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13110222788, "mlx_cache_bytes": 10380412523, "process_rss_bytes": 13676560384}, "peak_prefill_memory": 13242855584, "peak_decode_memory": 13110222788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03000_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e4d17c2cfa2b928fcc61946b773799af73f9f94b4bbbdd146657c33a6a83b07a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d981dafe756102c746215a5", "attempt_id": "057fdabacf9d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:25.121393Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5875, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.471416907385, "ttft_ms": 13.825249974615872, "decode_ms": 136.81987498421222}, "total_wall_ms": 834.8122499883175, "ttft_ms": 13.825249974615872, "input_usage": {"receiver_prompt_tokens": 5875}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 13543063552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 2308715960, "process_rss_bytes": 13543063552}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8ba08e9d8b81fd3c62e03c2", "attempt_id": "56f0a65eea59", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:25.979319Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 666.2995830411091, "ttft_ms": 13.884291052818298, "decode_ms": 13.643666985444725}, "total_wall_ms": 702.4442079709843, "ttft_ms": 13.884291052818298, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543079936, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3003758008, "process_rss_bytes": 13543079936}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c10398e51078757abb8ea9d", "attempt_id": "8cd4af7721f2", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:26.704877Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5864, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 746.9053340610117, "ttft_ms": 13.908416964113712, "decode_ms": 13.833333970978856}, "total_wall_ms": 783.0243330681697, "ttft_ms": 13.908416964113712, "input_usage": {"receiver_prompt_tokens": 5864}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543112704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3003758008, "process_rss_bytes": 13543112704}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cde53a82c21cf3c7c92bde73", "attempt_id": "14033593868a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:27.511400Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5879, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 690.6108749099076, "ttft_ms": 13.97391699720174, "decode_ms": 123.08000004850328}, "total_wall_ms": 836.2618340179324, "ttft_ms": 13.97391699720174, "input_usage": {"receiver_prompt_tokens": 5879}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 13543145472, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3704763832, "process_rss_bytes": 13543145472}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,588,115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "6e5b387355d2edb1ffd589b58491594fa792b2b6e99363b2e5710b42eb6429b0"} | ||||
| 145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0684bb350732bd4c755336ea", "attempt_id": "5eb5c6d6db27", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:28.372473Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5872, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.8798750601709, "ttft_ms": 13.964584097266197, "decode_ms": 95.7226250320673}, "total_wall_ms": 796.3272500783205, "ttft_ms": 13.964584097266197, "input_usage": {"receiver_prompt_tokens": 5872}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13543178240, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13582799936, "mlx_cache_bytes": 4242945464, "process_rss_bytes": 13543178240}, "peak_prefill_memory": null, "peak_decode_memory": 13582799936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4439515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "428041758b16a119eefbcb06d172852931ea08ef516d1c13ef1c0ae220e36a5a"} | ||||
| 146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e1102ed4face6bfb7c503581", "attempt_id": "370c03443292", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:29.192414Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5881, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.7113329153508, "ttft_ms": 14.0098329866305, "decode_ms": 68.71187500655651}, "total_wall_ms": 768.9522081054747, "ttft_ms": 14.0098329866305, "input_usage": {"receiver_prompt_tokens": 5881}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13543211008, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 4732630456, "process_rss_bytes": 13543211008}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cfb8d23c848d38c472c5c888", "attempt_id": "cc588ce3f0bc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:29.984946Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5875, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 685.8886670088395, "ttft_ms": 13.850125018507242, "decode_ms": 109.12775003816932}, "total_wall_ms": 817.6374579779804, "ttft_ms": 13.850125018507242, "input_usage": {"receiver_prompt_tokens": 5875}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 13543260160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 4732630456, "process_rss_bytes": 13543260160}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23444449", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "df23230877389fa70d7630689996d86fa1eeacf8814a89b1a2436093c007fb29"} | ||||
| 148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2d137b3819e5865f56339c99", "attempt_id": "edbdbf3374d8", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:30.826119Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5871, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 678.0138339381665, "ttft_ms": 14.073750004172325, "decode_ms": 68.50958405993879}, "total_wall_ms": 769.3271660245955, "ttft_ms": 14.073750004172325, "input_usage": {"receiver_prompt_tokens": 5871}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13543292928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13589697600, "mlx_cache_bytes": 5219497400, "process_rss_bytes": 13543292928}, "peak_prefill_memory": null, "peak_decode_memory": 13589697600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "26500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "e58d320067065d418dd9864f479a1956cd90493af5e094fbd88e7e63bd3738fe"} | ||||
| 149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e0d09e0eabe336437e9ed7b7", "attempt_id": "a567896b47f9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:31.619322Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5876, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 688.361041015014, "ttft_ms": 14.30291694123298, "decode_ms": 13.733791070990264}, "total_wall_ms": 725.1120830187574, "ttft_ms": 14.30291694123298, "input_usage": {"receiver_prompt_tokens": 5876}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543325696, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5707806136, "process_rss_bytes": 13543325696}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "754a9de57fad136c2525cf54", "attempt_id": "f3427e42df9a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:32.368851Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 5877, "message_tokens": 5789, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.014582998119294643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.1747090099379, "ttft_ms": 13.90529191121459, "decode_ms": 13.980499934405088}, "total_wall_ms": 732.5225840322673, "ttft_ms": 13.90529191121459, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 6196311480, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c7483515cb5a61b93819cc6", "attempt_id": "71e8ac5d51a7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:38.378323Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 421, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.20270806644112, "ttft_ms": 13.138000038452446, "decode_ms": 13.056208030320704}, "total_wall_ms": 81.52362494729459, "ttft_ms": 13.138000038452446, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950608640, "mlx_cache_bytes": 7750061128, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12950608640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2927a685a05f9f932a059b1b", "attempt_id": "be5f2f9a45ef", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:38.484290Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 410, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.46020795311779, "ttft_ms": 13.087708037346601, "decode_ms": 13.17708392161876}, "total_wall_ms": 79.76500003132969, "ttft_ms": 13.087708037346601, "input_usage": {"receiver_prompt_tokens": 410, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12942908160, "mlx_cache_bytes": 8070909000, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12942908160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "481e16ac5c930fcd664df86d", "attempt_id": "bd996f2f2857", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:38.588453Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 410, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.497458945959806, "ttft_ms": 13.146916986443102, "decode_ms": 13.386124977841973}, "total_wall_ms": 79.03383392840624, "ttft_ms": 13.146916986443102, "input_usage": {"receiver_prompt_tokens": 410, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12942908160, "mlx_cache_bytes": 8070909000, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12942908160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "601390c4fc4af02e59eaa8d7", "attempt_id": "503a954eb657", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:38.691198Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 425, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.627457935363054, "ttft_ms": 13.24533298611641, "decode_ms": 14.114959049038589}, "total_wall_ms": 82.02191698364913, "ttft_ms": 13.24533298611641, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12953541392, "mlx_cache_bytes": 8402686696, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12953541392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "153b064400ad5f11aed88eec", "attempt_id": "3b79756c2373", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:38.797579Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 418, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.726374986581504, "ttft_ms": 13.069457956589758, "decode_ms": 13.032624963670969}, "total_wall_ms": 80.85662499070168, "ttft_ms": 13.069457956589758, "input_usage": {"receiver_prompt_tokens": 418, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12949035776, "mlx_cache_bytes": 8631800552, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12949035776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d62c917a70713f2aee0a58fc", "attempt_id": "b20d4bda58b7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:38.902301Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 427, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.74050000682473, "ttft_ms": 13.012374984100461, "decode_ms": 13.558541075326502}, "total_wall_ms": 81.36054198257625, "ttft_ms": 13.012374984100461, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12955786008, "mlx_cache_bytes": 8979847568, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12955786008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe7e8ead9ab50cf5a11ad456", "attempt_id": "1e4bb79241f6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:39.007681Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 421, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.646542015485466, "ttft_ms": 12.969458010047674, "decode_ms": 13.073540991172194}, "total_wall_ms": 80.67541709169745, "ttft_ms": 12.969458010047674, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950608640, "mlx_cache_bytes": 8979847568, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12950608640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "581c25289df67c90f5328804", "attempt_id": "e84f7e29c1a2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:39.112714Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 417, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.555291982367635, "ttft_ms": 13.174416963011026, "decode_ms": 13.261415995657444}, "total_wall_ms": 79.01333295740187, "ttft_ms": 13.174416963011026, "input_usage": {"receiver_prompt_tokens": 417, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12948249344, "mlx_cache_bytes": 9208174992, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12948249344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f55b3bc65c108854d3af1ac5", "attempt_id": "0bd5117142f7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:39.215770Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 422, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.636624943464994, "ttft_ms": 13.195457984693348, "decode_ms": 13.262749998830259}, "total_wall_ms": 81.1250830302015, "ttft_ms": 13.195457984693348, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543440384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12951968528, "mlx_cache_bytes": 9439386000, "process_rss_bytes": 13543440384}, "peak_prefill_memory": null, "peak_decode_memory": 12951968528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a7e226ca9282c971d7d848c0", "attempt_id": "3eeab385f08e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:39.320836Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 423, "message_tokens": 331, "message_utf8_bytes": 1694, "cache_tensor_bytes": null, "serialized_payload_bytes": 1694, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5253.479333012365, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.23837499599904, "ttft_ms": 13.085625017993152, "decode_ms": 13.387624989263713}, "total_wall_ms": 80.70870791561902, "ttft_ms": 13.085625017993152, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 5905, "sender_output_tokens": 331, "sender_prefill_ms": 725.4300420172513, "sender_ttft_ms": 14.302290976047516, "sender_decode_ms": 4509.445374947973}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543456768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12952623888, "mlx_cache_bytes": 9671252368, "process_rss_bytes": 13543456768}, "peak_prefill_memory": null, "peak_decode_memory": 12952623888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2b3c7fd2d0fad06e9ef749d084d3789e6711234d532af5351f40b5ea0ad591f0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8fd31d98b858c47f9369e8c2", "attempt_id": "582c407f3145", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.099778Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 455, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.630375049076974, "ttft_ms": 13.048792025074363, "decode_ms": 13.412291998974979}, "total_wall_ms": 83.04329204838723, "ttft_ms": 13.048792025074363, "input_usage": {"receiver_prompt_tokens": 455, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978379656, "mlx_cache_bytes": 11012071592, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12978379656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6283001a54a37a8134eaf4a2", "attempt_id": "1ec87d3d089c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.207713Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 444, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.811500081792474, "ttft_ms": 13.72699998319149, "decode_ms": 13.961584074422717}, "total_wall_ms": 82.42741599678993, "ttft_ms": 13.72699998319149, "input_usage": {"receiver_prompt_tokens": 444, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12969024392, "mlx_cache_bytes": 11257290920, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12969024392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9597bf24f6ab52d2c21e400b", "attempt_id": "15d896b50063", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.313954Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 444, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.115875042043626, "ttft_ms": 13.963207951746881, "decode_ms": 13.699291041120887}, "total_wall_ms": 82.72958407178521, "ttft_ms": 13.963207951746881, "input_usage": {"receiver_prompt_tokens": 444, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12969024392, "mlx_cache_bytes": 11257290920, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12969024392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f2b3d4cabdd782032f26a6c1", "attempt_id": "5092a99640a3", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.422530Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 459, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.789958918467164, "ttft_ms": 13.33429105579853, "decode_ms": 13.586999964900315}, "total_wall_ms": 83.63341691438109, "ttft_ms": 13.33429105579853, "input_usage": {"receiver_prompt_tokens": 459, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12981492632, "mlx_cache_bytes": 11620018128, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12981492632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "07c26e4082eb55944af45eb8", "attempt_id": "96e84a6378e9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.530581Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 452, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.244082934223115, "ttft_ms": 13.353792019188404, "decode_ms": 13.363874983042479}, "total_wall_ms": 82.86541700363159, "ttft_ms": 13.353792019188404, "input_usage": {"receiver_prompt_tokens": 452, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12918217584, "mlx_cache_bytes": 11805910992, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12918217584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bab80cd2dd16f2e4233117e1", "attempt_id": "7ae4dcca85a2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.637740Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 461, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.80516706686467, "ttft_ms": 13.441249961033463, "decode_ms": 13.168707955628633}, "total_wall_ms": 83.32095807418227, "ttft_ms": 13.441249961033463, "input_usage": {"receiver_prompt_tokens": 461, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902210440, "mlx_cache_bytes": 11995442944, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12902210440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "184d8e06cdfebd2e9d1b6c4e", "attempt_id": "a0ac6791ec12", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.745710Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 455, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.77358400821686, "ttft_ms": 13.114708010107279, "decode_ms": 134.11837501917034}, "total_wall_ms": 202.847084030509, "ttft_ms": 13.114708010107279, "input_usage": {"receiver_prompt_tokens": 455, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978396040, "mlx_cache_bytes": 11995442944, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12978396040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,912,055", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b88fd0f44b20541c31d3970412d8ff78ed05b627c69e8e5d8659cf7f1b407bad"} | ||||
| 168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3bba16bde518c87dd83a2a2", "attempt_id": "d766a2809828", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:47.972117Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 451, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.19554205238819, "ttft_ms": 13.27637501526624, "decode_ms": 52.993958932347596}, "total_wall_ms": 122.37979203928262, "ttft_ms": 13.27637501526624, "input_usage": {"receiver_prompt_tokens": 451, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12917627760, "mlx_cache_bytes": 12180745984, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12917627760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.3", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "d73e887ce917b29abec1accbfc8da7d73872d2dfd0540e6ad12fd9c2688765d3"} | ||||
| 169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "adcade2ffa7f002bdeb6782e", "attempt_id": "be533ae8477b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:48.118264Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 456, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.10658293496817, "ttft_ms": 13.353166985325515, "decode_ms": 13.174082967452705}, "total_wall_ms": 82.51758303958923, "ttft_ms": 13.353166985325515, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978920344, "mlx_cache_bytes": 12430700288, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12978920344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9142631b6d971f1172e46171", "attempt_id": "4daa4f7fad51", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:48.225211Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 457, "message_tokens": 353, "message_utf8_bytes": 829, "cache_tensor_bytes": null, "serialized_payload_bytes": 829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7674.60625001695, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.276458035223186, "ttft_ms": 13.96158302668482, "decode_ms": 13.093207962810993}, "total_wall_ms": 83.19395792204887, "ttft_ms": 13.96158302668482, "input_usage": {"receiver_prompt_tokens": 457, "sender_input_tokens": 5933, "sender_output_tokens": 512, "sender_prefill_ms": 679.8264590324834, "sender_ttft_ms": 13.923916965723038, "sender_decode_ms": 6976.071375072934}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543358464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12979444632, "mlx_cache_bytes": 12600700672, "process_rss_bytes": 13543358464}, "peak_prefill_memory": null, "peak_decode_memory": 12979444632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "55c5c19eeaf6806e99364a215b912dea92bf09d82f76616b4a35a712fcdf7a37", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e517834d6f61652fa1570320", "attempt_id": "21908fe3026a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:48.336553Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 592, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.21479099057615, "ttft_ms": 13.12637492083013, "decode_ms": 13.24104203376919}, "total_wall_ms": 97.61970804538578, "ttft_ms": 13.12637492083013, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990407768, "mlx_cache_bytes": 12993883904, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12990407768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9b019ce3856970bb0aabf028", "attempt_id": "538e578ada22", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:48.458401Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 581, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.09308296255767, "ttft_ms": 13.17783398553729, "decode_ms": 13.368209009058774}, "total_wall_ms": 97.61679102666676, "ttft_ms": 13.17783398553729, "input_usage": {"receiver_prompt_tokens": 581}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983723096, "mlx_cache_bytes": 13332541184, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12983723096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "acbb6e1cf8ddc2c7aa3d080f", "attempt_id": "9e5ccc7d88f8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:48.579936Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 581, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.38787503167987, "ttft_ms": 13.205625000409782, "decode_ms": 13.147499994374812}, "total_wall_ms": 96.76529094576836, "ttft_ms": 13.205625000409782, "input_usage": {"receiver_prompt_tokens": 581}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983723096, "mlx_cache_bytes": 13332541184, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12983723096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86c57e518720220f8d09f9d2", "attempt_id": "05787a7f3602", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:48.700974Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 596, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.04508294630796, "ttft_ms": 13.132916064932942, "decode_ms": 92.50308305490762}, "total_wall_ms": 176.69279198162258, "ttft_ms": 13.132916064932942, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992865368, "mlx_cache_bytes": 13694889728, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12992865368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5588115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "5e8aa3e317f34247d5545451c63ac9a5b2e481e54d54b520d99a84cd8ee5a8d9"} | ||||
| 175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2fd22d3d7f7585058e8f9a6e", "attempt_id": "f129dd28d7ed", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:48.901783Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 589, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.45820897817612, "ttft_ms": 13.245500042103231, "decode_ms": 119.27008407656103}, "total_wall_ms": 202.98670802731067, "ttft_ms": 13.245500042103231, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989129816, "mlx_cache_bytes": 13937110784, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12989129816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,439,515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "7e209a4c9dd6879d7024b31aa971d69ea31077909c7ea20bb771181ec5b64af9"} | ||||
| 176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "54d97eb8de5b21982770efd5", "attempt_id": "5c26ac31fa7f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:49.128621Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 598, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.98279097024351, "ttft_ms": 13.52008304093033, "decode_ms": 66.38754194136709}, "total_wall_ms": 150.95037501305342, "ttft_ms": 13.52008304093033, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994438232, "mlx_cache_bytes": 14286286592, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12994438232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b18431e27d88a13b02ab6f08", "attempt_id": "ec1ac00e4868", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:49.303694Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 592, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.49054205324501, "ttft_ms": 13.541624997742474, "decode_ms": 92.2348330495879}, "total_wall_ms": 176.2508749961853, "ttft_ms": 13.541624997742474, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990407768, "mlx_cache_bytes": 14286286592, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12990407768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2448496", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "10cec944db4bd3b422fe8f6c75a3f28f28ce2c865f87779a8b9f77cd992288b1"} | ||||
| 178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "552b38163cdc812211cd8f29", "attempt_id": "28f6a9c6aae2", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:49.503529Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 588, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.80850000400096, "ttft_ms": 13.121291995048523, "decode_ms": 92.52979105804116}, "total_wall_ms": 176.45429202821106, "ttft_ms": 13.121291995048523, "input_usage": {"receiver_prompt_tokens": 588}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007987800, "mlx_cache_bytes": 14463086336, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 13007987800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5588115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "5e8aa3e317f34247d5545451c63ac9a5b2e481e54d54b520d99a84cd8ee5a8d9"} | ||||
| 179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2bc439bf05994e63c2966dc3", "attempt_id": "2aa1b936fe1a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:49.703983Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 593, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.45104198530316, "ttft_ms": 13.262332999147475, "decode_ms": 13.492166996002197}, "total_wall_ms": 97.18045790214092, "ttft_ms": 13.262332999147475, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 14706880256, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "72a9326b1347d8961de7ea58", "attempt_id": "c2663d9d03dc", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:49.825161Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 594, "message_tokens": 505, "message_utf8_bytes": 1232, "cache_tensor_bytes": null, "serialized_payload_bytes": 1232, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.266417003236711, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.69670893158764, "ttft_ms": 13.201583991758525, "decode_ms": 13.179166940972209}, "total_wall_ms": 97.11912495549768, "ttft_ms": 13.201583991758525, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13543391232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12991980632, "mlx_cache_bytes": 14951067392, "process_rss_bytes": 13543391232}, "peak_prefill_memory": null, "peak_decode_memory": 12991980632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1002ac802b861ed3e1fadf173c8725897b360a2016fad6ee4afd1a6903fd95ba", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f457b29ac4990760e0e58eea", "attempt_id": "dbdcc649384f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:50.639774Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.287874998524785, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.336750058457255, "ttft_ms": 22.336750058457255, "decode_ms": 82.1775000076741}, "total_wall_ms": 110.91220797970891, "ttft_ms": 22.336750058457255, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 47}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976755964, "mlx_cache_bytes": 15565779065, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976755964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varsheshlesh-7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "24db24e3221c77393317964af218346fdc2c67ce7a293ba2bfbac90d7821e63e"} | ||||
| 182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c1a649edb0a1375eba10e013", "attempt_id": "e58f3eca0822", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:50.775551Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.720709027722478, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.276499938219786, "ttft_ms": 23.276499938219786, "decode_ms": 13.52608297020197}, "total_wall_ms": 42.9535829462111, "ttft_ms": 23.276499938219786, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12924441608, "mlx_peak_bytes": 12966909180, "mlx_cache_bytes": 15601348729, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12966909180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "16bd7889e53f622c037f45ed", "attempt_id": "f5e5cd8f971f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:50.843805Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.74791703466326, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.899874951690435, "ttft_ms": 22.899874951690435, "decode_ms": 13.46270798239857}, "total_wall_ms": 42.366874986328185, "ttft_ms": 22.899874951690435, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12924441608, "mlx_peak_bytes": 12966909180, "mlx_cache_bytes": 15601348729, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12966909180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "59911b504f5d51f7e6b22a15", "attempt_id": "e7da15694497", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:50.910165Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 51, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.7600830178707838, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.267250042408705, "ttft_ms": 23.267250042408705, "decode_ms": 83.34341598674655}, "total_wall_ms": 112.64370800927281, "ttft_ms": 23.267250042408705, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 51}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12982392076, "mlx_cache_bytes": 15645684241, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12982392076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "123456", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "8d969eef6ecad3c29a3a629280e686cf0c3f5d5a86aff3ca12020c923adc6c92"} | ||||
| 185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9962c3946556cf692a6d4acd", "attempt_id": "c978355651a6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:51.046974Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 44, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.7116250237450004, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.478042101487517, "ttft_ms": 23.478042101487517, "decode_ms": 95.79504211433232}, "total_wall_ms": 125.51800010260195, "ttft_ms": 23.478042101487517, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12974806268, "mlx_cache_bytes": 15676766625, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12974806268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1250000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "f0d0684b111b4511f2e151a0065852129b79cf0c3e12b20ed59117e81a3f7fb8"} | ||||
| 186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc486b42aee0d7c29b657204", "attempt_id": "be8bc84864ff", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:51.196887Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 53, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.6523340018466115, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.06158298254013, "ttft_ms": 24.06158298254013, "decode_ms": 69.52091702260077}, "total_wall_ms": 99.53608294017613, "ttft_ms": 24.06158298254013, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12984194324, "mlx_cache_bytes": 15720758089, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12984194324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "3123ff87d1ad9b263e28f2fddd4604886e24c865be647de72d7f2b49c4adf9e4"} | ||||
| 187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c5acbb289480a6952f85690f", "attempt_id": "0084ddaf0afd", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:51.319940Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.607749960385263, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.70408400706947, "ttft_ms": 21.70408400706947, "decode_ms": 95.69087496493012}, "total_wall_ms": 123.59649990685284, "ttft_ms": 21.70408400706947, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976755964, "mlx_cache_bytes": 15720758089, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976755964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5911407", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "1acc4d215c205a724eb36a81dc02bbfee9ec4c4f7287c77a7f63cdc1932f3acd"} | ||||
| 188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f5e00bf3b7f52c24e5085f8b", "attempt_id": "eec82d9fc372", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:51.467820Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 43, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.7335410229861736, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.138124961405993, "ttft_ms": 23.138124961405993, "decode_ms": 81.64737490005791}, "total_wall_ms": 110.83658295683563, "ttft_ms": 23.138124961405993, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 43}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12975084796, "mlx_cache_bytes": 15738436425, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975084796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "123.45", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "4ebc4a141b378980461430980948a55988fbf56f85d084ac33d8a8f61b9fab88"} | ||||
| 189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "924e826b6fe9279342e38945", "attempt_id": "64e583de5050", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:51.603126Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 48, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.7166660400107503, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.621917003765702, "ttft_ms": 23.621917003765702, "decode_ms": 13.493333011865616}, "total_wall_ms": 43.28733403235674, "ttft_ms": 23.621917003765702, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13652017152, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12978509068, "mlx_cache_bytes": 15772203849, "process_rss_bytes": 13652017152}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12978509068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a54826ac3e63a9ba279a97fa", "attempt_id": "cecb38f8fd9e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:51.670916Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5828, "keep": 1457, "compress_ms": 8.694082964211702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 49, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727036, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 693.1003329809755, "doc_prefill_ms": 662.9004999995232, "compress_ms": 8.732167072594166, "serialize_ms": 12.248374987393618, "load_ms": 1.7899579834192991, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.481540963985026, "ttft_ms": 23.481540963985026, "decode_ms": 13.655874994583428}, "total_wall_ms": 43.3220419799909, "ttft_ms": 23.481540963985026, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13652033536, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981114124, "mlx_cache_bytes": 15806561097, "process_rss_bytes": 13652033536}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981114124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b845a9e5138adad2d20d395ffd767f173ed0d3bfebb60adcde18d22c786e536", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1ce4c421bae2f7ecaf8aac5b", "attempt_id": "ae94358a0e17", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:51.738657Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 47, "compress_ms": 92.40745892748237}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.91591697651893, "doc_prefill_ms": 662.9004999995232, "compress_ms": 96.74941701814532, "serialize_ms": 18.94070894923061, "load_ms": 1.6604169504716992, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.505792043171823, "ttft_ms": 21.505792043171823, "decode_ms": 136.24270807486027}, "total_wall_ms": 279.76837498135865, "ttft_ms": 21.505792043171823, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 13509378048, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976755964, "mlx_cache_bytes": 16072939233, "process_rss_bytes": 13509378048}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976755964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86d0e05ae7646788bf9b6e41", "attempt_id": "66f0f07764f7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:52.043002Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 36, "compress_ms": 62.16045806650072}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 79.59054200910032, "doc_prefill_ms": 662.9004999995232, "compress_ms": 66.53504201676697, "serialize_ms": 12.844250071793795, "load_ms": 2.5427499786019325, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.75416604243219, "ttft_ms": 22.75416604243219, "decode_ms": 13.766625081188977}, "total_wall_ms": 123.03150002844632, "ttft_ms": 22.75416604243219, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13563641856, "backend_memory": {"mlx_active_bytes": 12924441608, "mlx_peak_bytes": 12966909180, "mlx_cache_bytes": 16110835425, "process_rss_bytes": 13563641856}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12966909180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8a01926a69ebd33ee2332615", "attempt_id": "c065e2d3b668", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:52.190306Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 36, "compress_ms": 61.93012499716133}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 79.92454094346613, "doc_prefill_ms": 662.9004999995232, "compress_ms": 66.28400005865842, "serialize_ms": 13.41762498486787, "load_ms": 1.5400410629808903, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.783000022172928, "ttft_ms": 22.783000022172928, "decode_ms": 13.759583001956344}, "total_wall_ms": 122.34308407641947, "ttft_ms": 22.783000022172928, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13562314752, "backend_memory": {"mlx_active_bytes": 12924441608, "mlx_peak_bytes": 12966909180, "mlx_cache_bytes": 16117094113, "process_rss_bytes": 13562314752}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12966909180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f2d16f757b653103202028b7", "attempt_id": "6b6d44a3c6e8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:52.338069Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 51, "compress_ms": 63.276040949858725}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 51, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727077, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 83.29595800023526, "doc_prefill_ms": 662.9004999995232, "compress_ms": 67.63687508646399, "serialize_ms": 15.453499974682927, "load_ms": 0.6176250753924251, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.865832899697125, "ttft_ms": 22.865832899697125, "decode_ms": 82.8811249230057}, "total_wall_ms": 194.0508330008015, "ttft_ms": 22.865832899697125, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 51}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 13497565184, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981310732, "mlx_cache_bytes": 16145684193, "process_rss_bytes": 13497565184}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981310732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "558245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "349c206f136e2075bf170e3618071220073342eb12ea83576fe384e95585538b", "output_hash": "bf1e1ad9c92a91909b8448a33f04b9fd947df22d5a64782685ea43a420a92e65"} | ||||
| 195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aee09664f35257d8b92c1d41", "attempt_id": "93883c0ef86b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:52.557298Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 44, "compress_ms": 62.78699997346848}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 44, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.84275007806718, "doc_prefill_ms": 662.9004999995232, "compress_ms": 67.14387505780905, "serialize_ms": 14.476416981779039, "load_ms": 1.9205419812351465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.13041698653251, "ttft_ms": 23.13041698653251, "decode_ms": 95.05508397705853}, "total_wall_ms": 206.4602089812979, "ttft_ms": 23.13041698653251, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 13415923712, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12974363900, "mlx_cache_bytes": 16166426337, "process_rss_bytes": 13415923712}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12974363900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4435020", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "755dd23f281fca2fe90d9352e46fc6ba55bafe221e2b000a0d4ce869eb60a3f2"} | ||||
| 196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "32e44b4130118cd882b73c4a", "attempt_id": "6b1a8f58f4fa", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:52.788527Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 53, "compress_ms": 62.92337493505329}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 53, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 82.5567920692265, "doc_prefill_ms": 662.9004999995232, "compress_ms": 67.02425004914403, "serialize_ms": 15.320333070121706, "load_ms": 0.6347079761326313, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.656292003579438, "ttft_ms": 23.656292003579438, "decode_ms": 67.83187505789101}, "total_wall_ms": 179.11999998614192, "ttft_ms": 23.656292003579438, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13308755968, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12983555348, "mlx_cache_bytes": 16203847393, "process_rss_bytes": 13308755968}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12983555348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1a44bd81adf81e7bf3cd28a1", "attempt_id": "4f3d563db368", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:52.992495Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 47, "compress_ms": 63.76787507906556}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 82.91391690727323, "doc_prefill_ms": 662.9004999995232, "compress_ms": 68.17720795515925, "serialize_ms": 14.51729191467166, "load_ms": 1.4861670788377523, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.67241694405675, "ttft_ms": 21.67241694405675, "decode_ms": 108.5491250269115}, "total_wall_ms": 218.98929099552333, "ttft_ms": 21.67241694405675, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 13208092672, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976755964, "mlx_cache_bytes": 16203847393, "process_rss_bytes": 13208092672}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976755964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20444469", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "947ffd43f07d21900185b91f5662a36739970d7778f7e4e48480714d85d637f7"} | ||||
| 198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d347ddf429f12a96c8035df9", "attempt_id": "93e94c3dd380", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:53.236945Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 43, "compress_ms": 62.60908301919699}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 43, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.32254192605615, "doc_prefill_ms": 662.9004999995232, "compress_ms": 66.75637501757592, "serialize_ms": 14.341416070237756, "load_ms": 1.7649999354034662, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.58458302821964, "ttft_ms": 22.58458302821964, "decode_ms": 68.25258303433657}, "total_wall_ms": 178.50758403073996, "ttft_ms": 22.58458302821964, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 13087899648, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12973724924, "mlx_cache_bytes": 16221869793, "process_rss_bytes": 13087899648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12973724924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "26500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "e58d320067065d418dd9864f479a1956cd90493af5e094fbd88e7e63bd3738fe"} | ||||
| 199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "87509562e41207a0a731f6fe", "attempt_id": "dc6af21edd07", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:53.440773Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 48, "compress_ms": 63.32562502939254}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 48, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.98924997728318, "doc_prefill_ms": 662.9004999995232, "compress_ms": 67.50537501648068, "serialize_ms": 8.269582991488278, "load_ms": 0.5944590084254742, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.71058305632323, "ttft_ms": 22.71058305632323, "decode_ms": 13.705208082683384}, "total_wall_ms": 117.35529196448624, "ttft_ms": 22.71058305632323, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13087899648, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12978509068, "mlx_cache_bytes": 16239777505, "process_rss_bytes": 13087899648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12978509068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "faae26a5f40ee734750a1d71", "attempt_id": "a095a0828210", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:53.583292Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5828, "keep": 1457, "window_tokens": 49, "compress_ms": 62.00508400797844}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 49, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 53710848, "serialized_payload_bytes": 53727076, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 80.53808391559869, "doc_prefill_ms": 662.9004999995232, "compress_ms": 66.37004192452878, "serialize_ms": 13.94945802167058, "load_ms": 1.7440420342609286, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.101874976418912, "ttft_ms": 23.101874976418912, "decode_ms": 13.567458954639733}, "total_wall_ms": 123.47058299928904, "ttft_ms": 23.101874976418912, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 13004013568, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12979918092, "mlx_cache_bytes": 16258062049, "process_rss_bytes": 13004013568}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979918092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb70c922765a6d6dcc922b13ad2a825debade2864c3872f1deb9a395b0bff6b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "564fd5894cbaf62cfa8291e2", "attempt_id": "a9c67feb1a28", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:54.520775Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 297.3465420072898, "receiver_prefill_ms": 0.0, "query_prefill_ms": 610.7877079630271, "ttft_ms": 610.7877079630271, "decode_ms": 155.1922910148278}, "total_wall_ms": 1067.9557910189033, "ttft_ms": 610.7877079630271, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9126068224, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13175691176, "mlx_cache_bytes": 16460898449, "process_rss_bytes": 9126068224}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13175691176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "34b20deae874b100cff18eff", "attempt_id": "06140f63b5c4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:55.625185Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 2.288874937221408, "receiver_prefill_ms": 0.0, "query_prefill_ms": 33.80370803643018, "ttft_ms": 33.80370803643018, "decode_ms": 16.408500028774142}, "total_wall_ms": 56.90279207192361, "ttft_ms": 33.80370803643018, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8906653696, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13150934200, "mlx_cache_bytes": 16515031185, "process_rss_bytes": 8906653696}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13150934200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f81c195c59c396fb9fdece5", "attempt_id": "d53c4b1a7eda", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:55.716043Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 36, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 1.7972079804167151, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.237583046779037, "ttft_ms": 29.237583046779037, "decode_ms": 16.87862491235137}, "total_wall_ms": 54.26779098343104, "ttft_ms": 29.237583046779037, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8448966656, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13150934200, "mlx_cache_bytes": 16515031185, "process_rss_bytes": 8448966656}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13150934200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe588260dd624ba5c7f63ba9", "attempt_id": "b0aa14bce96e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:55.831604Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 51, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 1.9064589869230986, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.422791023738682, "ttft_ms": 30.422791023738682, "decode_ms": 139.87841689959168}, "total_wall_ms": 176.54912499710917, "ttft_ms": 30.422791023738682, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 51}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 8449163264, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13184487800, "mlx_cache_bytes": 16592053985, "process_rss_bytes": 8449163264}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13184487800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,588,115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "6e5b387355d2edb1ffd589b58491594fa792b2b6e99363b2e5710b42eb6429b0"} | ||||
| 205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0b191fae013c95a1b3ee055c", "attempt_id": "c1a7bb99e51d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:56.033900Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 44, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 2.3341249907389283, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.899375068955123, "ttft_ms": 27.899375068955123, "decode_ms": 105.89416592847556}, "total_wall_ms": 140.38991706911474, "ttft_ms": 27.899375068955123, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 8449179648, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13168988328, "mlx_cache_bytes": 16658245345, "process_rss_bytes": 8449179648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13168988328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4439515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "428041758b16a119eefbcb06d172852931ea08ef516d1c13ef1c0ae220e36a5a"} | ||||
| 206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "48e3b82c25904f3f2d05657a", "attempt_id": "a0e675a93006", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:56.198482Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 53, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 1.893125008791685, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.58795800805092, "ttft_ms": 29.58795800805092, "decode_ms": 76.10325003042817}, "total_wall_ms": 112.16716701164842, "ttft_ms": 29.58795800805092, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8449179648, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13189492320, "mlx_cache_bytes": 16738618897, "process_rss_bytes": 8449179648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13189492320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "92b3f39cbd3a6c9441eb0c25", "attempt_id": "566f52376759", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:56.334802Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 47, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 1.4075420331209898, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.914457954466343, "ttft_ms": 27.914457954466343, "decode_ms": 121.04662496130913}, "total_wall_ms": 154.68120900914073, "ttft_ms": 27.914457954466343, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 8449179648, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13175689784, "mlx_cache_bytes": 16738618897, "process_rss_bytes": 8449179648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13175689784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "24444459", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "d31999fefd7e7a1c91f8600d76661819bc2196dae29af528671e05cf60295ca2"} | ||||
| 208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dad1da7930ab424552ce9828", "attempt_id": "2d6de079a839", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:56.513806Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 43, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 2.348416019231081, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.789541985839605, "ttft_ms": 27.789541985839605, "decode_ms": 75.9060001000762}, "total_wall_ms": 110.42624991387129, "ttft_ms": 27.789541985839605, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8449179648, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13167873864, "mlx_cache_bytes": 16803368465, "process_rss_bytes": 8449179648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13167873864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "26500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "e58d320067065d418dd9864f479a1956cd90493af5e094fbd88e7e63bd3738fe"} | ||||
| 209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "75b137ad4e3239637f6538cc", "attempt_id": "929e0ac3b5f5", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:56.648676Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 48, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 2.4089579237625003, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.24925002641976, "ttft_ms": 28.24925002641976, "decode_ms": 15.481499955058098}, "total_wall_ms": 50.616584019735456, "ttft_ms": 28.24925002641976, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8449179648, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13177572872, "mlx_cache_bytes": 16875589137, "process_rss_bytes": 8449179648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13177572872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d750ffa524e544c34d59fd24", "attempt_id": "553ef08b8ef2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:56.724141Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931830792}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5789, "source_tokens_receiver": 5789, "query_tokens": 49, "message_tokens": 5828, "message_utf8_bytes": 29253, "cache_tensor_bytes": 114135552, "serialized_payload_bytes": 114169877, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 789.4667080836371, "doc_prefill_ms": 662.9004999995232, "compress_ms": 26.30600007250905, "serialize_ms": 762.2612920822576, "load_ms": 2.303916960954666, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.33008300513029, "ttft_ms": 28.33008300513029, "decode_ms": 15.299624996259809}, "total_wall_ms": 50.40720908436924, "ttft_ms": 28.33008300513029, "input_usage": {"receiver_prefix_tokens": 5828, "dense_cache_bytes": 214843392, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8449196032, "backend_memory": {"mlx_active_bytes": 13047436296, "mlx_peak_bytes": 13180456456, "mlx_cache_bytes": 16949382673, "process_rss_bytes": 8449196032}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13180456456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ad1b0c42deff3f962676443080f7100ed02811704a13ddbcd6deaa4e433e3d5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9df76bec1d60cd9a54ad255a", "attempt_id": "2936fc44e53e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:57.494624Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5715, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1037.3541249427944, "ttft_ms": 15.285708010196686, "decode_ms": 102.98533295281231}, "total_wall_ms": 1163.5222909972072, "ttft_ms": 15.285708010196686, "input_usage": {"receiver_prompt_tokens": 5715}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 8444706816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13745509428, "mlx_cache_bytes": 2688639320, "process_rss_bytes": 8444706816}, "peak_prefill_memory": null, "peak_decode_memory": 13745509428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "183fe53626389d614825fab4", "attempt_id": "1a431859792a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:58.682774Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5706, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 659.2167079215869, "ttft_ms": 14.914500061422586, "decode_ms": 29.465792002156377}, "total_wall_ms": 711.3407080760226, "ttft_ms": 14.914500061422586, "input_usage": {"receiver_prompt_tokens": 5706}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8444739584, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13743543348, "mlx_cache_bytes": 3064521048, "process_rss_bytes": 8444739584}, "peak_prefill_memory": null, "peak_decode_memory": 13743543348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "73030585a5ab790065d60eb9", "attempt_id": "1f62ad16c5a9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:44:59.417434Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5706, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 700.6017079111189, "ttft_ms": 16.103000030852854, "decode_ms": 30.743875075131655}, "total_wall_ms": 755.0959159852937, "ttft_ms": 16.103000030852854, "input_usage": {"receiver_prompt_tokens": 5706}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8444739584, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13743543348, "mlx_cache_bytes": 3064521048, "process_rss_bytes": 8444739584}, "peak_prefill_memory": null, "peak_decode_memory": 13743543348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed37fb2c3a9cc12a3845ad8d", "attempt_id": "9948504a37fa", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:00.195167Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5721, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 712.6406249590218, "ttft_ms": 15.36979095544666, "decode_ms": 74.35941696166992}, "total_wall_ms": 810.329083004035, "ttft_ms": 15.36979095544666, "input_usage": {"receiver_prompt_tokens": 5721}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8444755968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746820148, "mlx_cache_bytes": 3443679576, "process_rss_bytes": 8444755968}, "peak_prefill_memory": null, "peak_decode_memory": 13746820148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,588,115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "6e5b387355d2edb1ffd589b58491594fa792b2b6e99363b2e5710b42eb6429b0"} | ||||
| 215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "22825f88dbf16bf9ea07a1ba", "attempt_id": "86cbbd643d15", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:01.028018Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5714, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 678.6917500430718, "ttft_ms": 15.341375023126602, "decode_ms": 74.39541700296104}, "total_wall_ms": 776.0821249103174, "ttft_ms": 15.341375023126602, "input_usage": {"receiver_prompt_tokens": 5714}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8444772352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13745509428, "mlx_cache_bytes": 3443679576, "process_rss_bytes": 8444772352}, "peak_prefill_memory": null, "peak_decode_memory": 13745509428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,439,515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "7e209a4c9dd6879d7024b31aa971d69ea31077909c7ea20bb771181ec5b64af9"} | ||||
| 216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3144908ed275b80b72ff479", "attempt_id": "6a041e4212aa", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:01.827102Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5723, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 681.6372079774737, "ttft_ms": 15.635957941412926, "decode_ms": 74.38158302102238}, "total_wall_ms": 779.2515830369666, "ttft_ms": 15.635957941412926, "input_usage": {"receiver_prompt_tokens": 5723}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8444772352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13747524660, "mlx_cache_bytes": 3853476184, "process_rss_bytes": 8444772352}, "peak_prefill_memory": null, "peak_decode_memory": 13747524660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "07da30dec895b37714d19c37", "attempt_id": "5f1ded518daa", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:02.629243Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5717, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 682.5191249372438, "ttft_ms": 15.619292040355504, "decode_ms": 74.46870801504701}, "total_wall_ms": 780.6998749729246, "ttft_ms": 15.619292040355504, "input_usage": {"receiver_prompt_tokens": 5717}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8444772352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13786240052, "mlx_cache_bytes": 4072497496, "process_rss_bytes": 8444772352}, "peak_prefill_memory": null, "peak_decode_memory": 13786240052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,919,106", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "2a52833af148d1d8a47a1cd5055d76a5529748d2004589e40a3df8de5f859863"} | ||||
| 218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35a538958d4471c242ae5edb", "attempt_id": "233e07dbe2dd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:03.433119Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5713, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 684.1149580432102, "ttft_ms": 15.463958960026503, "decode_ms": 45.01779202837497}, "total_wall_ms": 752.2304590092972, "ttft_ms": 15.463958960026503, "input_usage": {"receiver_prompt_tokens": 5713}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 8444772352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13745312820, "mlx_cache_bytes": 4231356760, "process_rss_bytes": 8444772352}, "peak_prefill_memory": null, "peak_decode_memory": 13745312820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "26.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "a2937363dfca0decea2efd67970ec018de205dad421155e2d0edefd148a7a315"} | ||||
| 219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5c9e31e775f378e85909838e", "attempt_id": "ecc575c0ad40", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:04.207762Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5717, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 709.8357080249116, "ttft_ms": 15.900708036497235, "decode_ms": 15.417708083987236}, "total_wall_ms": 749.1860839072615, "ttft_ms": 15.900708036497235, "input_usage": {"receiver_prompt_tokens": 5717}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8444788736, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13796217908, "mlx_cache_bytes": 4231356760, "process_rss_bytes": 8444788736}, "peak_prefill_memory": null, "peak_decode_memory": 13796217908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a1f82fc8062ac90d523c017", "attempt_id": "bf6871d1c60b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:04.979445Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 5719, "message_tokens": 5609, "message_utf8_bytes": 29253, "cache_tensor_bytes": null, "serialized_payload_bytes": 29253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.010167015716433525, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.1536660091951, "ttft_ms": 15.350792091339827, "decode_ms": 14.969292096793652}, "total_wall_ms": 734.1934168944135, "ttft_ms": 15.350792091339827, "input_usage": {"receiver_prompt_tokens": 5719}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8444788736, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746623540, "mlx_cache_bytes": 4390805848, "process_rss_bytes": 8444788736}, "peak_prefill_memory": null, "peak_decode_memory": 13746623540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f10be2de5cd4a237dcb90f06", "attempt_id": "ffc903e7145a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:13.441651Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 583, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.00895811244845, "ttft_ms": 13.620167039334774, "decode_ms": 13.432416948489845}, "total_wall_ms": 103.24233397841454, "ttft_ms": 13.620167039334774, "input_usage": {"receiver_prompt_tokens": 583, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445706240, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13020241264, "mlx_cache_bytes": 6409470576, "process_rss_bytes": 8445706240}, "peak_prefill_memory": null, "peak_decode_memory": 13020241264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f435d3ce4907e7f31c37f39", "attempt_id": "276d98e4c6c0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:13.568597Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 574, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.05666697397828, "ttft_ms": 13.622166938148439, "decode_ms": 26.55966696329415}, "total_wall_ms": 116.34379206225276, "ttft_ms": 13.622166938148439, "input_usage": {"receiver_prompt_tokens": 574, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8445706240, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13015014768, "mlx_cache_bytes": 6730023536, "process_rss_bytes": 8445706240}, "peak_prefill_memory": null, "peak_decode_memory": 13015014768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "978d628ef3bd47f846c94d03", "attempt_id": "55207d4a376e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:13.708032Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 574, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.29133297409862, "ttft_ms": 13.724541058763862, "decode_ms": 26.852749986574054}, "total_wall_ms": 115.96041708253324, "ttft_ms": 13.724541058763862, "input_usage": {"receiver_prompt_tokens": 574, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8445706240, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13015014768, "mlx_cache_bytes": 6730023536, "process_rss_bytes": 8445706240}, "peak_prefill_memory": null, "peak_decode_memory": 13015014768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1f08e0001efb11725842ed53", "attempt_id": "665e6da0a52c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:13.846982Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 589, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.71620792057365, "ttft_ms": 13.535333913750947, "decode_ms": 67.09508295170963}, "total_wall_ms": 156.4954579807818, "ttft_ms": 13.535333913750947, "input_usage": {"receiver_prompt_tokens": 589, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445722624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13023616392, "mlx_cache_bytes": 7080954784, "process_rss_bytes": 8445722624}, "peak_prefill_memory": null, "peak_decode_memory": 13023616392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,026,882", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "9f134490c89d6a69c02b1dff05c129e920067129d7cc3d1a9e37f23a46dfd844"} | ||||
| 225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c60626fffa4d56d374716423", "attempt_id": "7bbfad111cfa", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:14.026323Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 582, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.62083303835243, "ttft_ms": 13.43337504658848, "decode_ms": 67.24108301568776}, "total_wall_ms": 156.4171250211075, "ttft_ms": 13.43337504658848, "input_usage": {"receiver_prompt_tokens": 582, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445722624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048782192, "mlx_cache_bytes": 7116671904, "process_rss_bytes": 8445722624}, "peak_prefill_memory": null, "peak_decode_memory": 13048782192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,124,515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "fe93179238c3954b9c607b7c4051ddf50991fe2de302b8385c5af647ff36b336"} | ||||
| 226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0aae106e8579fe69a85f6873", "attempt_id": "34fccbbdc14e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:14.206007Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 591, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.39629104919732, "ttft_ms": 13.649667031131685, "decode_ms": 67.42529210168868}, "total_wall_ms": 156.61304211243987, "ttft_ms": 13.649667031131685, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445722624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13024877968, "mlx_cache_bytes": 7447074008, "process_rss_bytes": 8445722624}, "peak_prefill_memory": null, "peak_decode_memory": 13024877968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "3123ff87d1ad9b263e28f2fddd4604886e24c865be647de72d7f2b49c4adf9e4"} | ||||
| 227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b0c36c00e1ec08591c1cf9a", "attempt_id": "754a94e1dcfe", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:14.385291Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 585, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.21666709706187, "ttft_ms": 13.393458095379174, "decode_ms": 67.32649996411055}, "total_wall_ms": 156.05170803610235, "ttft_ms": 13.393458095379174, "input_usage": {"receiver_prompt_tokens": 585, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445722624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13020798344, "mlx_cache_bytes": 7619302616, "process_rss_bytes": 8445722624}, "peak_prefill_memory": null, "peak_decode_memory": 13020798344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,507,962", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "e25cba42f5ff0d11e203b9b26f5e405ba40056abcde65a55b1c72df080addfeb"} | ||||
| 228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4cf9f6d6d0940e8a0ccedce8", "attempt_id": "d5131cce46e6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:14.564177Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 581, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.37608297914267, "ttft_ms": 13.461124966852367, "decode_ms": 13.597667100839317}, "total_wall_ms": 102.54233295563608, "ttft_ms": 13.461124966852367, "input_usage": {"receiver_prompt_tokens": 581, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445722624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13055597936, "mlx_cache_bytes": 7733335256, "process_rss_bytes": 8445722624}, "peak_prefill_memory": null, "peak_decode_memory": 13055597936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d6a0e7c0bf8d79cf1053c191", "attempt_id": "9c374d4703aa", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:14.690070Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 585, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.43208293989301, "ttft_ms": 13.83741688914597, "decode_ms": 13.845790992490947}, "total_wall_ms": 103.20883302483708, "ttft_ms": 13.83741688914597, "input_usage": {"receiver_prompt_tokens": 585, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445739008, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13020798344, "mlx_cache_bytes": 7733335256, "process_rss_bytes": 8445739008}, "peak_prefill_memory": null, "peak_decode_memory": 13020798344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4acf2167310a5ea5980b289b", "attempt_id": "d038cc03c4b0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:14.816155Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 587, "message_tokens": 473, "message_utf8_bytes": 1953, "cache_tensor_bytes": null, "serialized_payload_bytes": 1953, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7705.345749971457, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.46808402892202, "ttft_ms": 13.517499901354313, "decode_ms": 13.562500011175871}, "total_wall_ms": 102.6316670468077, "ttft_ms": 13.517499901354313, "input_usage": {"receiver_prompt_tokens": 587, "sender_input_tokens": 5743, "sender_output_tokens": 473, "sender_prefill_ms": 703.4832920180634, "sender_ttft_ms": 15.307791996747255, "sender_decode_ms": 6982.442416949198}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445739008, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13052059016, "mlx_cache_bytes": 7884592344, "process_rss_bytes": 8445739008}, "peak_prefill_memory": null, "peak_decode_memory": 13052059016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02bad07103df31c9d6bb1470058e42c7ae29b2eef0f20520d62e62f60fa44e1b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b34d1bd8b5f3fe3fd0b9f350", "attempt_id": "4baa33c42c7b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.177270Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 392, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.026124998927116, "ttft_ms": 13.360333046875894, "decode_ms": 13.52641696576029}, "total_wall_ms": 81.80554094724357, "ttft_ms": 13.360333046875894, "input_usage": {"receiver_prompt_tokens": 392, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445919232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12881026136, "mlx_cache_bytes": 8599180504, "process_rss_bytes": 8445919232}, "peak_prefill_memory": null, "peak_decode_memory": 12881026136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c1f672733bb40655cec50aee", "attempt_id": "408aa0d94432", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.282380Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 383, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.361875073984265, "ttft_ms": 13.361833989620209, "decode_ms": 13.651167042553425}, "total_wall_ms": 80.19670809153467, "ttft_ms": 13.361833989620209, "input_usage": {"receiver_prompt_tokens": 383, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445935616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12876307544, "mlx_cache_bytes": 8813286616, "process_rss_bytes": 8445935616}, "peak_prefill_memory": null, "peak_decode_memory": 12876307544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8b2b519088a7f7decb5e80af", "attempt_id": "b1850423866f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.385730Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 383, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.26145905908197, "ttft_ms": 13.395082904025912, "decode_ms": 13.527874951250851}, "total_wall_ms": 79.95116710662842, "ttft_ms": 13.395082904025912, "input_usage": {"receiver_prompt_tokens": 383, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445935616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12876307544, "mlx_cache_bytes": 8813286616, "process_rss_bytes": 8445935616}, "peak_prefill_memory": null, "peak_decode_memory": 12876307544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "563c4366c09fc4f16b7ad419", "attempt_id": "b05f708cd207", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.488551Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 398, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.22591704316437, "ttft_ms": 13.346291962079704, "decode_ms": 13.717417023144662}, "total_wall_ms": 81.15933404769748, "ttft_ms": 13.346291962079704, "input_usage": {"receiver_prompt_tokens": 398, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445935616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12884401240, "mlx_cache_bytes": 9050182872, "process_rss_bytes": 8445935616}, "peak_prefill_memory": null, "peak_decode_memory": 12884401240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52d884e2ef3ad1a28a4746e3", "attempt_id": "2125d3e2bd37", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.593231Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 391, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.398333955556154, "ttft_ms": 13.588166912086308, "decode_ms": 13.36683297995478}, "total_wall_ms": 81.11437491606921, "ttft_ms": 13.588166912086308, "input_usage": {"receiver_prompt_tokens": 391, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445935616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12881026136, "mlx_cache_bytes": 9050182872, "process_rss_bytes": 8445935616}, "peak_prefill_memory": null, "peak_decode_memory": 12881026136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6d73198680ac7c063f98184a", "attempt_id": "8ef7ad90a1b0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.697571Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 400, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.11104201246053, "ttft_ms": 13.510209042578936, "decode_ms": 13.572708005085588}, "total_wall_ms": 81.02029107976705, "ttft_ms": 13.510209042578936, "input_usage": {"receiver_prompt_tokens": 400, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445935616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885662808, "mlx_cache_bytes": 9273627864, "process_rss_bytes": 8445935616}, "peak_prefill_memory": null, "peak_decode_memory": 12885662808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f046bf8c29b08a34e49b5953", "attempt_id": "fbed99f84499", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.801838Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 394, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.30570798832923, "ttft_ms": 14.088416006416082, "decode_ms": 67.6329170819372}, "total_wall_ms": 135.87345799896866, "ttft_ms": 14.088416006416082, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445952000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902653016, "mlx_cache_bytes": 9413874904, "process_rss_bytes": 8445952000}, "peak_prefill_memory": null, "peak_decode_memory": 12902653016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,780,705", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "aa60bff3f5fe656dcc7102faaa222de3742cedc7fefc3df0d3568bb135b13185"} | ||||
| 238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a6e58ad83876ea46e250708c", "attempt_id": "cee9a9122c33", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:23.961119Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 390, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.73245803639293, "ttft_ms": 13.477665954269469, "decode_ms": 13.525167014449835}, "total_wall_ms": 81.51641697622836, "ttft_ms": 13.477665954269469, "input_usage": {"receiver_prompt_tokens": 390, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445952000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899769432, "mlx_cache_bytes": 9514276056, "process_rss_bytes": 8445952000}, "peak_prefill_memory": null, "peak_decode_memory": 12899769432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3a2716004befffc616545e36", "attempt_id": "2b7592a49424", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:24.065923Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 394, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.0340420557186, "ttft_ms": 13.520500040613115, "decode_ms": 13.353292015381157}, "total_wall_ms": 81.68954192660749, "ttft_ms": 13.520500040613115, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445952000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907535448, "mlx_cache_bytes": 9514276056, "process_rss_bytes": 8445952000}, "peak_prefill_memory": null, "peak_decode_memory": 12907535448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7b2c182965886ffc1c8076fb", "attempt_id": "9f6736cdd269", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:24.170774Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 396, "message_tokens": 270, "message_utf8_bytes": 745, "cache_tensor_bytes": null, "serialized_payload_bytes": 745, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8235.13808392454, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.07158408686519, "ttft_ms": 13.385833008214831, "decode_ms": 13.510582968592644}, "total_wall_ms": 80.81391698215157, "ttft_ms": 13.385833008214831, "input_usage": {"receiver_prompt_tokens": 396, "sender_input_tokens": 5773, "sender_output_tokens": 512, "sender_prefill_ms": 676.0044579859823, "sender_ttft_ms": 14.794166083447635, "sender_decode_ms": 7540.120666963048}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445952000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12884040792, "mlx_cache_bytes": 9591936216, "process_rss_bytes": 8445952000}, "peak_prefill_memory": null, "peak_decode_memory": 12884040792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dff392d82fdbfb56e59951ec5598cd3d4810852f5e40487f79bb0eca63301d17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "665b40966595641086afcec5", "attempt_id": "664562613175", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:24.278789Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 609, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.79854102712125, "ttft_ms": 13.777999905869365, "decode_ms": 13.696583919227123}, "total_wall_ms": 103.31866703927517, "ttft_ms": 13.777999905869365, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8445984768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034806744, "mlx_cache_bytes": 9834749528, "process_rss_bytes": 8445984768}, "peak_prefill_memory": null, "peak_decode_memory": 13034806744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f68f9224ec4f5af6f5749dc1", "attempt_id": "a4d7d82b2f11", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:24.404910Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 600, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.54645808320493, "ttft_ms": 13.833249919116497, "decode_ms": 27.24366693291813}, "total_wall_ms": 116.66833399794996, "ttft_ms": 13.833249919116497, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8445984768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13030186456, "mlx_cache_bytes": 10170015320, "process_rss_bytes": 8445984768}, "peak_prefill_memory": null, "peak_decode_memory": 13030186456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7421db85daedf449f9470342", "attempt_id": "1beca3a6b515", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:24.544231Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 600, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.4560839375481, "ttft_ms": 13.540124986320734, "decode_ms": 27.029791031964123}, "total_wall_ms": 116.02391698397696, "ttft_ms": 13.540124986320734, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8445984768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13030186456, "mlx_cache_bytes": 10170015320, "process_rss_bytes": 8445984768}, "peak_prefill_memory": null, "peak_decode_memory": 13030186456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "267fe70fd5f2018a099cd3dd", "attempt_id": "eea4c80284bf", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:24.683134Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 615, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.72808307688683, "ttft_ms": 13.758542016148567, "decode_ms": 67.93533300515264}, "total_wall_ms": 159.53570802230388, "ttft_ms": 13.758542016148567, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445984768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038788080, "mlx_cache_bytes": 10536544240, "process_rss_bytes": 8445984768}, "peak_prefill_memory": null, "peak_decode_memory": 13038788080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,588,115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "6e5b387355d2edb1ffd589b58491594fa792b2b6e99363b2e5710b42eb6429b0"} | ||||
| 245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "40bced554b912c07f286383c", "attempt_id": "23ada3e8b718", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:24.865382Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 608, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.41133295651525, "ttft_ms": 13.660750002600253, "decode_ms": 67.60808289982378}, "total_wall_ms": 156.68916702270508, "ttft_ms": 13.660750002600253, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445984768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034528216, "mlx_cache_bytes": 10536544240, "process_rss_bytes": 8445984768}, "peak_prefill_memory": null, "peak_decode_memory": 13034528216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,439,515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "7e209a4c9dd6879d7024b31aa971d69ea31077909c7ea20bb771181ec5b64af9"} | ||||
| 246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bec8874b33d9c00f1d9d8737", "attempt_id": "27d96e596b66", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:25.044984Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 617, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.21837500482798, "ttft_ms": 13.538416009396315, "decode_ms": 67.51208298373967}, "total_wall_ms": 158.39116706047207, "ttft_ms": 13.538416009396315, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8445984768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039345144, "mlx_cache_bytes": 10718212496, "process_rss_bytes": 8445984768}, "peak_prefill_memory": null, "peak_decode_memory": 13039345144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8280f4be5171c55bf81eae8", "attempt_id": "d2c0ec1f2c91", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:25.226740Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 611, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.13475003745407, "ttft_ms": 13.3971250616014, "decode_ms": 67.42237508296967}, "total_wall_ms": 157.99579198937863, "ttft_ms": 13.3971250616014, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8446017536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036264944, "mlx_cache_bytes": 10939511184, "process_rss_bytes": 8446017536}, "peak_prefill_memory": null, "peak_decode_memory": 13036264944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,911,111", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "f82c2af986f164528bf62ad1f6c282fb1865ac18d22ab006ca1cbcd0c32289f6"} | ||||
| 248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f69fe21f9cf2b42b0813ed09", "attempt_id": "86966b454c71", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:25.407874Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 607, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.49812500271946, "ttft_ms": 13.703458942472935, "decode_ms": 13.51783296559006}, "total_wall_ms": 102.73862502072006, "ttft_ms": 13.703458942472935, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8446017536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034528216, "mlx_cache_bytes": 10939511184, "process_rss_bytes": 8446017536}, "peak_prefill_memory": null, "peak_decode_memory": 13034528216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed85b6deacda2d731fd4037e", "attempt_id": "884d8c01b54d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:25.533349Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 611, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.23229105956852, "ttft_ms": 13.62133293878287, "decode_ms": 13.7126250192523}, "total_wall_ms": 104.59500004071742, "ttft_ms": 13.62133293878287, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8446017536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036264944, "mlx_cache_bytes": 10939511184, "process_rss_bytes": 8446017536}, "peak_prefill_memory": null, "peak_decode_memory": 13036264944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "03139b5ef94ddacfe8c9df36", "attempt_id": "23d0b3cbae8a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:25.660686Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 613, "message_tokens": 502, "message_utf8_bytes": 1526, "cache_tensor_bytes": null, "serialized_payload_bytes": 1526, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.301417036913335, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.98783308640122, "ttft_ms": 13.468040968291461, "decode_ms": 13.879040954634547}, "total_wall_ms": 104.34299998451024, "ttft_ms": 13.468040968291461, "input_usage": {"receiver_prompt_tokens": 613}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8446017536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13068541424, "mlx_cache_bytes": 11097518480, "process_rss_bytes": 8446017536}, "peak_prefill_memory": null, "peak_decode_memory": 13068541424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3cf5572f3078662253c397f8d91dc7482e1391bdc5f10fc51b02837c97afd89f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0832270db6526dafb88c5bfe", "attempt_id": "4a4c29e502fc", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:26.495867Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 46, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 1.9450420513749123, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.83062499575317, "ttft_ms": 23.83062499575317, "decode_ms": 103.00616698805243}, "total_wall_ms": 132.660707924515, "ttft_ms": 23.83062499575317, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13667587304, "mlx_cache_bytes": 10703571713, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13667587304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NS-33W-3403", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "b6768ed8e24d81429bbe2edbdc8db993331f9232cf1110d4cbea2859005fc4bf"} | ||||
| 252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93dce0245368a9b2fd3840f8", "attempt_id": "d5a9ce1348b9", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:26.652371Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 37, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 1.012834021821618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.533249924890697, "ttft_ms": 22.533249924890697, "decode_ms": 14.64474992826581}, "total_wall_ms": 42.034209007397294, "ttft_ms": 22.533249924890697, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13659149544, "mlx_cache_bytes": 10931047169, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13659149544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6a6bf212ec833b1f1b322930", "attempt_id": "adfeb2e9f748", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:26.717885Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 37, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 2.098708995617926, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.92970796022564, "ttft_ms": 21.92970796022564, "decode_ms": 14.617750071920455}, "total_wall_ms": 42.79870807658881, "ttft_ms": 21.92970796022564, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13659149544, "mlx_cache_bytes": 10931047169, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13659149544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "12f191936a8bdfb762455d85", "attempt_id": "ddeaa87c5c04", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:26.783593Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 52, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 2.0752500277012587, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.43837504647672, "ttft_ms": 22.43837504647672, "decode_ms": 28.81908300332725}, "total_wall_ms": 57.21945804543793, "ttft_ms": 22.43837504647672, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 52}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13671814400, "mlx_cache_bytes": 10968618801, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13671814400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d5afce36879554e8fb7f7365", "attempt_id": "f66af0d74dbb", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:26.863570Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 45, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 2.040624967776239, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.121750051155686, "ttft_ms": 22.121750051155686, "decode_ms": 28.735833009704947}, "total_wall_ms": 57.01862496789545, "ttft_ms": 22.121750051155686, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13669553384, "mlx_cache_bytes": 10982954801, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13669553384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5e12b542ad55659898c99070", "attempt_id": "67422baeb750", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:26.943940Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 54, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 1.9662500126287341, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.590334061533213, "ttft_ms": 22.590334061533213, "decode_ms": 73.03016702644527}, "total_wall_ms": 101.47216694895178, "ttft_ms": 22.590334061533213, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13673338120, "mlx_cache_bytes": 11233141829, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13673338120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "3123ff87d1ad9b263e28f2fddd4604886e24c865be647de72d7f2b49c4adf9e4"} | ||||
| 257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e7a5ddc6643ad6f7a9bd52f", "attempt_id": "05f6be1e589c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:27.068917Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 48, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 1.93408306222409, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.521917009726167, "ttft_ms": 22.521917009726167, "decode_ms": 72.15791696216911}, "total_wall_ms": 100.77987494878471, "ttft_ms": 22.521917009726167, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668717824, "mlx_cache_bytes": 11246380101, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13668717824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12,555,868", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "8bcdb3d5bfffe1c9a7d2ed541fded3644e1caf66ae612597bb65968f5e7c890a"} | ||||
| 258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "569cfbe5cbf1bb2e4ce62115", "attempt_id": "15e875a33492", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:27.192950Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 44, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 2.0724580390378833, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.33429194893688, "ttft_ms": 22.33429194893688, "decode_ms": 28.714540996588767}, "total_wall_ms": 56.981791043654084, "ttft_ms": 22.33429194893688, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 44}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668848872, "mlx_cache_bytes": 11266319429, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13668848872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "04067fb55d4425f66e6f584b", "attempt_id": "a1743e1057e2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:27.272977Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 48, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 2.0795840537175536, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.34699996188283, "ttft_ms": 22.34699996188283, "decode_ms": 14.383625006303191}, "total_wall_ms": 42.62441711034626, "ttft_ms": 22.34699996188283, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668717824, "mlx_cache_bytes": 11266319429, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13668717824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86abf51c3474580b727f534d", "attempt_id": "4d1ef14dda0d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:27.338457Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5669, "keep": 1417, "compress_ms": 9.705417091026902}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 50, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526006, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 708.0533329863101, "doc_prefill_ms": 660.9323329757899, "compress_ms": 9.74508305080235, "serialize_ms": 29.26679200027138, "load_ms": 1.9862080225721002, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.151792072691023, "ttft_ms": 22.151792072691023, "decode_ms": 14.498208067379892}, "total_wall_ms": 42.424125014804304, "ttft_ms": 22.151792072691023, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8771944448, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13673387264, "mlx_cache_bytes": 11282261061, "process_rss_bytes": 8771944448}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13673387264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1399a27345d953dce858fe5a0077f318cc7c2ec5c11061f5afb53414001103bf", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "066532d6902dbb9cbb327d98", "attempt_id": "752b2e04b326", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:27.403986Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 46, "compress_ms": 87.59891695808619}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 46, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 118.08891606051475, "doc_prefill_ms": 660.9323329757899, "compress_ms": 91.33433294482529, "serialize_ms": 26.57400001771748, "load_ms": 1.7409169813618064, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.820208989083767, "ttft_ms": 21.820208989083767, "decode_ms": 101.13395901862532}, "total_wall_ms": 246.8857920030132, "ttft_ms": 21.820208989083767, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 8775499776, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13667587304, "mlx_cache_bytes": 12665169069, "process_rss_bytes": 8775499776}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13667587304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "17a705d83f2b1c08cedbfb1a", "attempt_id": "2075552e78de", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:27.674468Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 37, "compress_ms": 76.87604194507003}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 37, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 110.28975003864616, "doc_prefill_ms": 660.9323329757899, "compress_ms": 80.64000005833805, "serialize_ms": 29.46962509304285, "load_ms": 1.4086670707911253, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.435791975818574, "ttft_ms": 21.435791975818574, "decode_ms": 28.643083991482854}, "total_wall_ms": 165.74445797596127, "ttft_ms": 21.435791975818574, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13659149544, "mlx_cache_bytes": 12701377709, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13659149544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e181c9a7169ae013971ac111", "attempt_id": "ce82d5469465", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:27.864828Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 37, "compress_ms": 76.60466607194394}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 37, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 108.92429202795029, "doc_prefill_ms": 660.9323329757899, "compress_ms": 80.41441603563726, "serialize_ms": 28.337334049865603, "load_ms": 1.7118339892476797, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.545458934269845, "ttft_ms": 21.545458934269845, "decode_ms": 28.52316596545279}, "total_wall_ms": 164.69699994195253, "ttft_ms": 21.545458934269845, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13659149544, "mlx_cache_bytes": 12701377709, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13659149544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1d94c6052e22800052ade474", "attempt_id": "6c03d95c74d9", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:28.054404Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 52, "compress_ms": 78.94729194231331}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 52, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 108.62937499769032, "doc_prefill_ms": 660.9323329757899, "compress_ms": 82.89520791731775, "serialize_ms": 25.556666892953217, "load_ms": 1.7999170813709497, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.793624968267977, "ttft_ms": 21.793624968267977, "decode_ms": 72.47708295471966}, "total_wall_ms": 208.69420794770122, "ttft_ms": 21.793624968267977, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13671814400, "mlx_cache_bytes": 12734457005, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13671814400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,588,245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "df678f9e2fef5fbe31ac574b8e5f42d82b79bba3aee00c2c52b8bae21397056a"} | ||||
| 265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "640de8e950de27145171407c", "attempt_id": "791d19ab8853", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:28.287196Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 45, "compress_ms": 78.20070895832032}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 45, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.21454103663564, "doc_prefill_ms": 660.9323329757899, "compress_ms": 82.00575003866106, "serialize_ms": 27.039292035624385, "load_ms": 1.6343750758096576, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.70058398041874, "ttft_ms": 21.70058398041874, "decode_ms": 72.04508304130286}, "total_wall_ms": 208.56900000944734, "ttft_ms": 21.70058398041874, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13669487848, "mlx_cache_bytes": 12760425645, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13669487848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,439,515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "7e209a4c9dd6879d7024b31aa971d69ea31077909c7ea20bb771181ec5b64af9"} | ||||
| 266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8359e030dffb38ab65868ad", "attempt_id": "e31edb29c35b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:28.520250Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 54, "compress_ms": 76.88329101074487}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 54, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 110.10295804589987, "doc_prefill_ms": 660.9323329757899, "compress_ms": 80.65404195804149, "serialize_ms": 29.26804102025926, "load_ms": 2.399084041826427, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.803540992550552, "ttft_ms": 21.803540992550552, "decode_ms": 71.77229097578675}, "total_wall_ms": 210.17870807554573, "ttft_ms": 21.803540992550552, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13673338120, "mlx_cache_bytes": 12810216621, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13673338120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5924a9fe4a27d8101e708bd1", "attempt_id": "79631b7fc50c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:28.754937Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 48, "compress_ms": 78.07212497573346}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 48, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.17012502532452, "doc_prefill_ms": 660.9323329757899, "compress_ms": 81.92933304235339, "serialize_ms": 23.05729198269546, "load_ms": 1.7987500177696347, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.99904201552272, "ttft_ms": 21.99904201552272, "decode_ms": 71.78058300632983}, "total_wall_ms": 204.69737506937236, "ttft_ms": 21.99904201552272, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668717824, "mlx_cache_bytes": 12837266605, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13668717824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,911,750", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "9ee843fece38cd69e632dda1cabdf4f2546f1fb5279d0426596826d6d0a3c419"} | ||||
| 268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "91e34511287422e7a281b632", "attempt_id": "4cf22817e5f1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:28.984513Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 44, "compress_ms": 78.34591704886407}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 44, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.05429201293737, "doc_prefill_ms": 660.9323329757899, "compress_ms": 82.16720796190202, "serialize_ms": 22.706000017933547, "load_ms": 1.2179159093648195, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.629792056046426, "ttft_ms": 21.629792056046426, "decode_ms": 43.117167078889906}, "total_wall_ms": 174.96183305047452, "ttft_ms": 21.629792056046426, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668816104, "mlx_cache_bytes": 12861760685, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13668816104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "26.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "a2937363dfca0decea2efd67970ec018de205dad421155e2d0edefd148a7a315"} | ||||
| 269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ba842cecfcc837c569d977c1", "attempt_id": "026ed38565a4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:29.183741Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 48, "compress_ms": 77.81620800960809}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 48, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.60495797451586, "doc_prefill_ms": 660.9323329757899, "compress_ms": 81.581125035882, "serialize_ms": 22.84874999895692, "load_ms": 1.7224999610334635, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.917750011198223, "ttft_ms": 21.917750011198223, "decode_ms": 28.767207986675203}, "total_wall_ms": 161.0292079858482, "ttft_ms": 21.917750011198223, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 48}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668717824, "mlx_cache_bytes": 12861760685, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13668717824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "4dd633b1f2ee444666fd70af2b36443331fc00e69f3e569847cf278ca625c041"} | ||||
| 270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d8ceedabd6a7d9d84ff0aeaf", "attempt_id": "b5b8831b0c73", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:29.369058Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5669, "keep": 1417, "window_tokens": 50, "compress_ms": 77.55916705355048}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 50, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 162512896, "serialized_payload_bytes": 162526046, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.22966699115932, "doc_prefill_ms": 660.9323329757899, "compress_ms": 81.44754194654524, "serialize_ms": 22.58720900863409, "load_ms": 1.736292033456266, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.74108289182186, "ttft_ms": 21.74108289182186, "decode_ms": 14.59254208020866}, "total_wall_ms": 146.30629203747958, "ttft_ms": 21.74108289182186, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8938815488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13670274304, "mlx_cache_bytes": 12899558573, "process_rss_bytes": 8938815488}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 13670274304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "640e2cc7f91c7594c33845f4892b1b6ffc8d172168e704793c884dca27434cb6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "788b31fbf929a0f6bc6532c8", "attempt_id": "655220afe0d8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:29.623940Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 46, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 6.769041996449232, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.67487503681332, "ttft_ms": 28.67487503681332, "decode_ms": 115.38700002711266}, "total_wall_ms": 154.80324998497963, "ttft_ms": 28.67487503681332, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14147017552, "mlx_cache_bytes": 13708122925, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14147017552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "GY-13E-6844", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "2ca6ddf54be9e197af2f12973eddba19b3d0c78d0073a82218a23e1d9bbad92e"} | ||||
| 272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "97f46527ff672018f172dbc5", "attempt_id": "cf12267cc284", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:29.802640Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 37, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 3.0540419975295663, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.121084043756127, "ttft_ms": 27.121084043756127, "decode_ms": 32.90799993555993}, "total_wall_ms": 67.18287488911301, "ttft_ms": 27.121084043756127, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14127055344, "mlx_cache_bytes": 13769388621, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14127055344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "92dcd28a3f3804b2618d1a7d", "attempt_id": "e429e0215087", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:29.893218Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 37, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 2.8709579491987824, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.85170795302838, "ttft_ms": 26.85170795302838, "decode_ms": 32.93779096566141}, "total_wall_ms": 66.49483402725309, "ttft_ms": 26.85170795302838, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14127055344, "mlx_cache_bytes": 13769388621, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14127055344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "71604cfdb3179169f71a9c78", "attempt_id": "725bbaf50c95", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:29.983425Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 52, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 3.1253329943865538, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.3674169331789, "ttft_ms": 28.3674169331789, "decode_ms": 82.18116604257375}, "total_wall_ms": 117.76604200713336, "ttft_ms": 28.3674169331789, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14160125160, "mlx_cache_bytes": 13855801165, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14160125160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,588,115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "6e5b387355d2edb1ffd589b58491594fa792b2b6e99363b2e5710b42eb6429b0"} | ||||
| 275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "523e442248a19b86b66f8974", "attempt_id": "b5d81b37beb5", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:30.124797Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 45, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 2.0520410034805536, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.893833932466805, "ttft_ms": 27.893833932466805, "decode_ms": 82.48874999117106}, "total_wall_ms": 116.29320902284235, "ttft_ms": 27.893833932466805, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14148670532, "mlx_cache_bytes": 13929922381, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14148670532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,439,515", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "7e209a4c9dd6879d7024b31aa971d69ea31077909c7ea20bb771181ec5b64af9"} | ||||
| 276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c31085755e77057ecad9cf2d", "attempt_id": "714a88f8e264", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:30.264498Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 54, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 2.8981249779462814, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.753750026226044, "ttft_ms": 28.753750026226044, "decode_ms": 82.93712500017136}, "total_wall_ms": 118.42575005721301, "ttft_ms": 28.753750026226044, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14164614512, "mlx_cache_bytes": 14018989261, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14164614512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Banmunruk-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "858197b99462f9923666f025810f174515ef1dac3462c948b1ea68e0be358384"} | ||||
| 277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9723b2159d582093a5ef418a", "attempt_id": "3521f6121a0f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:30.405209Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 48, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 3.0215830774977803, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.12641696073115, "ttft_ms": 28.12641696073115, "decode_ms": 81.7942499415949}, "total_wall_ms": 116.76216695923358, "ttft_ms": 28.12641696073115, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14150800952, "mlx_cache_bytes": 14098025677, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14150800952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,919,106", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "2a52833af148d1d8a47a1cd5055d76a5529748d2004589e40a3df8de5f859863"} | ||||
| 278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a1a8b1091df6f61072070efc", "attempt_id": "e933a2f9ac00", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:30.545718Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 44, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 3.1555830501019955, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.960874955169857, "ttft_ms": 27.960874955169857, "decode_ms": 49.27458299789578}, "total_wall_ms": 84.26812500692904, "ttft_ms": 27.960874955169857, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14146637484, "mlx_cache_bytes": 14170475725, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14146637484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "26.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "a2937363dfca0decea2efd67970ec018de205dad421155e2d0edefd148a7a315"} | ||||
| 279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c038803b2244f23f204c5383", "attempt_id": "167c96ab76a6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:30.653415Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 48, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 2.884250017814338, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.542916941456497, "ttft_ms": 27.542916941456497, "decode_ms": 16.51550002861768}, "total_wall_ms": 50.79612508416176, "ttft_ms": 27.542916941456497, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14150800952, "mlx_cache_bytes": 14170475725, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14150800952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cd589e5896342596e5a4df59", "attempt_id": "2ad7bf5d109d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:30.727770Z", "task_family": "synthetic", "document_id": "syn_03001_8000", "document_hash": "bada8ba4956b59f8a22a68843c4c56f104029ebc33a4c35fcf192e0cf7667914", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03001_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5609, "source_tokens_receiver": 5609, "query_tokens": 50, "message_tokens": 5669, "message_utf8_bytes": 29253, "cache_tensor_bytes": 345400832, "serialized_payload_bytes": 345428168, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 84.52391601167619, "doc_prefill_ms": 660.9323329757899, "compress_ms": 18.31308309920132, "serialize_ms": 65.93475001864135, "load_ms": 3.0813749181106687, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.23725000862032, "ttft_ms": 32.23725000862032, "decode_ms": 16.38649997767061}, "total_wall_ms": 55.52020901814103, "ttft_ms": 32.23725000862032, "input_usage": {"receiver_prefix_tokens": 5669, "dense_cache_bytes": 650166272, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9631858688, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14156011064, "mlx_cache_bytes": 14252854477, "process_rss_bytes": 9631858688}, "peak_prefill_memory": 13734073396, "peak_decode_memory": 14156011064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03001_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5466fc7f7c5a7deac4547080d839546017b5acb4d1c786e4f04af1e4a779274", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a9c398d97328ed13ccf8b288", "attempt_id": "a54a56d41a4e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:30.882873Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10951, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1431.3228339888155, "ttft_ms": 19.376541953533888, "decode_ms": 142.89041596930474}, "total_wall_ms": 1609.849457978271, "ttft_ms": 19.376541953533888, "input_usage": {"receiver_prompt_tokens": 10951}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9191866368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 3836043704, "process_rss_bytes": 9191866368}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HP-87A-7363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "01cab9bf8c940208717157372a3dbb7eadb8344dd420795a32306f27bfae243d"} | ||||
| 282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2c241c16a91c50a5bb1d304e", "attempt_id": "bfc3514d32d3", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:32.524614Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10940, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1471.2305420543998, "ttft_ms": 14.779999968595803, "decode_ms": 14.433832955546677}, "total_wall_ms": 1516.7287499643862, "ttft_ms": 14.779999968595803, "input_usage": {"receiver_prompt_tokens": 10940}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191866368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4247265720, "process_rss_bytes": 9191866368}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f8a89ec99c99aa34e04ee822", "attempt_id": "78103d47da16", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:34.072659Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10942, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1491.077332990244, "ttft_ms": 14.705250039696693, "decode_ms": 14.389166957698762}, "total_wall_ms": 1536.404125043191, "ttft_ms": 14.705250039696693, "input_usage": {"receiver_prompt_tokens": 10942}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191866368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4659880376, "process_rss_bytes": 9191866368}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e6456e73e888500b98fe9af", "attempt_id": "87ac7c9dad2c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:35.640747Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10957, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1462.963082944043, "ttft_ms": 14.604624942876399, "decode_ms": 127.92200001422316}, "total_wall_ms": 1621.9260420184582, "ttft_ms": 14.604624942876399, "input_usage": {"receiver_prompt_tokens": 10957}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5098594744, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f76628938c60a1c49c1a088", "attempt_id": "d33ae266eaf0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:37.294267Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10948, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1478.53933298029, "ttft_ms": 14.71929089166224, "decode_ms": 99.62162503506988}, "total_wall_ms": 1609.1244580456987, "ttft_ms": 14.71929089166224, "input_usage": {"receiver_prompt_tokens": 10948}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5418869176, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7139200", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "6c191104b2cbba9d5e063581eeed72d5c3b10426572a63c1f1ac1a255a348c3f"} | ||||
| 286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "06d37497617037bb055892e3", "attempt_id": "fa40a0b14361", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:38.935035Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10958, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1480.7505410863087, "ttft_ms": 14.634457998909056, "decode_ms": 71.0537499981001}, "total_wall_ms": 1582.3579999851063, "ttft_ms": 14.634457998909056, "input_usage": {"receiver_prompt_tokens": 10958}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5840986552, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2193bebede97fb48e2a34202", "attempt_id": "82944a1665a8", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:40.549109Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10952, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1492.5863749813288, "ttft_ms": 14.478500001132488, "decode_ms": 114.13625010754913}, "total_wall_ms": 1637.4548330204561, "ttft_ms": 14.478500001132488, "input_usage": {"receiver_prompt_tokens": 10952}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6133834168, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20833709", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "5273b83535a4288f667cc1978a62374ff952e3a9f48477eebb248a3d43120933"} | ||||
| 288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d2f66f2d5fb9ef8bb2bbe639", "attempt_id": "cc195e112732", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:42.218076Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10947, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1504.2474169749767, "ttft_ms": 14.390124939382076, "decode_ms": 71.06466602999717}, "total_wall_ms": 1605.6867080042139, "ttft_ms": 14.390124939382076, "input_usage": {"receiver_prompt_tokens": 10947}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6424519096, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37190", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "cf7a4e6456cc08174a919f9bd8830e7d8e94bccd6d92a67fabd0620b3d8acc79"} | ||||
| 289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "14c2711fc4fc0871709e095d", "attempt_id": "a1b58597ce8c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:43.855706Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10951, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1512.7693749964237, "ttft_ms": 14.521333039738238, "decode_ms": 14.089709031395614}, "total_wall_ms": 1557.8760829521343, "ttft_ms": 14.521333039738238, "input_usage": {"receiver_prompt_tokens": 10951}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6424519096, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8a8d4624cc40c1e1b7e36608", "attempt_id": "9ef357487cdf", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:45.445403Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 10954, "message_tokens": 10866, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02545793540775776, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1519.0465420018882, "ttft_ms": 14.405542053282261, "decode_ms": 14.196458039805293}, "total_wall_ms": 1564.0794999198988, "ttft_ms": 14.405542053282261, "input_usage": {"receiver_prompt_tokens": 10954}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6718251448, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "351a6bcf4819144b7cc0ce7e", "attempt_id": "f5eca61fc5d8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:55.861678Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.67112496588379, "ttft_ms": 13.032416929490864, "decode_ms": 131.85462495312095}, "total_wall_ms": 216.72587504144758, "ttft_ms": 13.032416929490864, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994421848, "mlx_cache_bytes": 8409761208, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12994421848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HP-87A-7363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "01cab9bf8c940208717157372a3dbb7eadb8344dd420795a32306f27bfae243d"} | ||||
| 292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "196c12b857491ea0afb91900", "attempt_id": "b8b3968e16e0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:56.110917Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.72566701006144, "ttft_ms": 13.159459107555449, "decode_ms": 12.97600008547306}, "total_wall_ms": 96.93750005681068, "ttft_ms": 13.159459107555449, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989817944, "mlx_cache_bytes": 8769062328, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12989817944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cbde42276978d9c43fd3f7c8", "attempt_id": "5c2f0df85071", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:56.239530Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.68233396764845, "ttft_ms": 13.292624964378774, "decode_ms": 12.921041925437748}, "total_wall_ms": 96.95208305492997, "ttft_ms": 13.292624964378774, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 9012856248, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8a44b3d459cb137a0167dd0a", "attempt_id": "645b697e7ca1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:56.368948Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.02979195769876, "ttft_ms": 13.268332928419113, "decode_ms": 118.23058396112174}, "total_wall_ms": 203.7037080153823, "ttft_ms": 13.268332928419113, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997551192, "mlx_cache_bytes": 9367438776, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12997551192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2fedd2f72d4b6924a3155a03", "attempt_id": "13c61a2c1c69", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:56.604122Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.98983398079872, "ttft_ms": 13.331207912415266, "decode_ms": 119.17229206301272}, "total_wall_ms": 203.56950000859797, "ttft_ms": 13.331207912415266, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13015262296, "mlx_cache_bytes": 9635808696, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13015262296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "73fd1f06ee233c2f9d51f591", "attempt_id": "90a2ddbb82fb", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:56.839419Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.48891608044505, "ttft_ms": 13.268207898363471, "decode_ms": 65.98075001966208}, "total_wall_ms": 149.83191597275436, "ttft_ms": 13.268207898363471, "input_usage": {"receiver_prompt_tokens": 609, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997846104, "mlx_cache_bytes": 9886090680, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12997846104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f8f10021d45de64966f0da5", "attempt_id": "a2bdf6a2443a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:57.021180Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.04941697232425, "ttft_ms": 13.353749993257225, "decode_ms": 91.24099998734891}, "total_wall_ms": 175.73612509295344, "ttft_ms": 13.353749993257225, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 10133915064, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2058429", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "f4c033623d6239c2839e576445d9aacff1d51dcdf12956d5d68c9388a124e9f8"} | ||||
| 298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "416703cdd9ae181e4e29a277", "attempt_id": "b51286b9bd13", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:57.229029Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.94387495797127, "ttft_ms": 13.269166927784681, "decode_ms": 65.93787495512515}, "total_wall_ms": 150.20925004500896, "ttft_ms": 13.269166927784681, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012788312, "mlx_cache_bytes": 10133915064, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 13012788312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37190", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "cf7a4e6456cc08174a919f9bd8830e7d8e94bccd6d92a67fabd0620b3d8acc79"} | ||||
| 299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8fe06318a9c23db5958c289c", "attempt_id": "562a15132a48", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:57.410625Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.46358392108232, "ttft_ms": 13.332624919712543, "decode_ms": 13.002875028178096}, "total_wall_ms": 97.93929103761911, "ttft_ms": 13.332624919712543, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994421848, "mlx_cache_bytes": 10133915064, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12994421848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2793f1a25617f2670f613dba", "attempt_id": "b390e0bfd9f8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:45:57.539893Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1340, "cache_tensor_bytes": null, "serialized_payload_bytes": 1340, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8820.624666055664, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.31716592609882, "ttft_ms": 13.30195798072964, "decode_ms": 13.051374931819737}, "total_wall_ms": 97.74845791980624, "ttft_ms": 13.30195798072964, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 10982, "sender_output_tokens": 512, "sender_prefill_ms": 1535.9429579693824, "sender_ttft_ms": 14.663040987215936, "sender_decode_ms": 7261.908791959286}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191882752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995601496, "mlx_cache_bytes": 10382624184, "process_rss_bytes": 9191882752}, "peak_prefill_memory": null, "peak_decode_memory": 12995601496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89a203c3c0c99b3e1fca1ab5887c3e7ddedb85a5ae53163497c975080c7677e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cecf3dc964137744cb3ced2", "attempt_id": "fba1da75a1a2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:06.443726Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 472, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.21633301395923, "ttft_ms": 13.140624971129, "decode_ms": 13.010457972995937}, "total_wall_ms": 82.38558389712125, "ttft_ms": 13.140624971129, "input_usage": {"receiver_prompt_tokens": 472, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12908846004, "mlx_cache_bytes": 11614162196, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12908846004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bbd3984f874a62bd31f39baf", "attempt_id": "dbbdb9442ed4", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:06.559716Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 461, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.09262497071177, "ttft_ms": 13.054999988526106, "decode_ms": 12.990457937121391}, "total_wall_ms": 82.0670829853043, "ttft_ms": 13.054999988526106, "input_usage": {"receiver_prompt_tokens": 461, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902308788, "mlx_cache_bytes": 11884711188, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12902308788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f191ffded8a74299445722c9", "attempt_id": "cba5ee712f3d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:06.673798Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 463, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.78845804464072, "ttft_ms": 13.003499945625663, "decode_ms": 13.459417037665844}, "total_wall_ms": 82.18912500888109, "ttft_ms": 13.003499945625663, "input_usage": {"receiver_prompt_tokens": 463, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12903701428, "mlx_cache_bytes": 12156652820, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12903701428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5417e77db03e30f42b629341", "attempt_id": "fb960d88b588", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:06.787847Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 478, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.04970799665898, "ttft_ms": 13.317041913978755, "decode_ms": 13.203207985498011}, "total_wall_ms": 82.54058298189193, "ttft_ms": 13.317041913978755, "input_usage": {"receiver_prompt_tokens": 478, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12912909260, "mlx_cache_bytes": 12449404040, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12912909260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7102921d474cf6e8407175ed", "attempt_id": "eeba78e58fdd", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:06.902461Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 469, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.04762509372085, "ttft_ms": 13.279416947625577, "decode_ms": 13.083165977150202}, "total_wall_ms": 82.29916694108397, "ttft_ms": 13.279416947625577, "input_usage": {"receiver_prompt_tokens": 469, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907568052, "mlx_cache_bytes": 12642079880, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12907568052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93d1f7699cf2e25b3a419a16", "attempt_id": "7e6cab3bbd95", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.016391Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 479, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.82112499885261, "ttft_ms": 13.283167034387589, "decode_ms": 13.274332974106073}, "total_wall_ms": 82.29570800904185, "ttft_ms": 13.283167034387589, "input_usage": {"receiver_prompt_tokens": 479, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913400784, "mlx_cache_bytes": 12838984704, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12913400784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3d816dc57961e8d4294969ac", "attempt_id": "f8c041f76eeb", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.130131Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 473, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.09674991481006, "ttft_ms": 13.042208971455693, "decode_ms": 92.13758399710059}, "total_wall_ms": 161.2299579428509, "ttft_ms": 13.042208971455693, "input_usage": {"receiver_prompt_tokens": 473, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909337548, "mlx_cache_bytes": 13033430016, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12909337548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7332537", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "9211c3c368be6b8cc9ab290aaa3b949a676fbe4acbcf6d35c741b74d04dcf9d2"} | ||||
| 308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2d769369885a9e73ae19af1f", "attempt_id": "5da714817384", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.323152Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 468, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.319499991834164, "ttft_ms": 13.088165898807347, "decode_ms": 65.45824999921024}, "total_wall_ms": 133.84195801336318, "ttft_ms": 13.088165898807347, "input_usage": {"receiver_prompt_tokens": 468, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12922887092, "mlx_cache_bytes": 13050682368, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12922887092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37190", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "cf7a4e6456cc08174a919f9bd8830e7d8e94bccd6d92a67fabd0620b3d8acc79"} | ||||
| 309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25b498e5a37cfe6558142431", "attempt_id": "fe6687ee35d6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.488870Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 472, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.869166924618185, "ttft_ms": 14.237374998629093, "decode_ms": 13.027209090068936}, "total_wall_ms": 83.10329099185765, "ttft_ms": 14.237374998629093, "input_usage": {"receiver_prompt_tokens": 472, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12908846004, "mlx_cache_bytes": 13050682368, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12908846004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff9f6899ccec2c2ae212a3df", "attempt_id": "d811f68add39", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.603390Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 475, "message_tokens": 372, "message_utf8_bytes": 905, "cache_tensor_bytes": null, "serialized_payload_bytes": 905, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8774.465374997817, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.355333955958486, "ttft_ms": 13.07054201606661, "decode_ms": 13.564875000156462}, "total_wall_ms": 82.93291693553329, "ttft_ms": 13.07054201606661, "input_usage": {"receiver_prompt_tokens": 475, "sender_input_tokens": 11010, "sender_output_tokens": 512, "sender_prefill_ms": 1496.6473750537261, "sender_ttft_ms": 14.684249996207654, "sender_decode_ms": 7254.7214169753715}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191899136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12927212492, "mlx_cache_bytes": 13263363072, "process_rss_bytes": 9191899136}, "peak_prefill_memory": null, "peak_decode_memory": 12927212492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "16c2f19a1cd6f15fece5575c99a6ac8d23a8afa6850aef4848e40557f63bb4e0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "696e727964bcc61afbb0457c", "attempt_id": "916585cfa315", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.725673Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 586, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.38624992128462, "ttft_ms": 13.406708021648228, "decode_ms": 13.354083988815546}, "total_wall_ms": 98.20274997036904, "ttft_ms": 13.406708021648228, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191931904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007201368, "mlx_cache_bytes": 13526080512, "process_rss_bytes": 9191931904}, "peak_prefill_memory": null, "peak_decode_memory": 13007201368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f73803a752eafffef5c23633", "attempt_id": "8217b042710e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.855534Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 575, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 66.96729199029505, "ttft_ms": 13.294957927428186, "decode_ms": 13.288125046528876}, "total_wall_ms": 94.57379207015038, "ttft_ms": 13.294957927428186, "input_usage": {"receiver_prompt_tokens": 575}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191931904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12980184152, "mlx_cache_bytes": 13875747840, "process_rss_bytes": 9191931904}, "peak_prefill_memory": null, "peak_decode_memory": 12980184152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "130738c1987d5dccece94453", "attempt_id": "1a9a8afacf05", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:07.981512Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 577, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 66.07274990528822, "ttft_ms": 13.149417005479336, "decode_ms": 12.974875047802925}, "total_wall_ms": 93.23179197963327, "ttft_ms": 13.149417005479336, "input_usage": {"receiver_prompt_tokens": 577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191981056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12980872280, "mlx_cache_bytes": 14112857088, "process_rss_bytes": 9191981056}, "peak_prefill_memory": null, "peak_decode_memory": 12980872280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f5183e775408cb032c2f9db", "attempt_id": "2786f35d4ef5", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:08.106351Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 592, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.58437501452863, "ttft_ms": 13.261875021271408, "decode_ms": 118.42733295634389}, "total_wall_ms": 202.31637510005385, "ttft_ms": 13.261875021271408, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9191997440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 14112857088, "process_rss_bytes": 9191997440}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6328bddbbf856ba14bee8ae0", "attempt_id": "16493d40f70a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:08.339984Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 583, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.63154091499746, "ttft_ms": 13.608957990072668, "decode_ms": 91.94445901084691}, "total_wall_ms": 176.21454095933586, "ttft_ms": 13.608957990072668, "input_usage": {"receiver_prompt_tokens": 583}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9191997440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997403736, "mlx_cache_bytes": 14443518976, "process_rss_bytes": 9191997440}, "peak_prefill_memory": null, "peak_decode_memory": 12997403736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5511225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "7e5a4e8c080f9c0d3d11b3e94c200b7a827fa90144d5163815b1f01dad3fecb8"} | ||||
| 316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe7247590b0a09dadc776618", "attempt_id": "675c153db083", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:08.547696Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 593, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 68.92445893026888, "ttft_ms": 13.039959012530744, "decode_ms": 65.71466696914285}, "total_wall_ms": 148.69795902632177, "ttft_ms": 13.039959012530744, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9191997440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 14443518976, "process_rss_bytes": 9191997440}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a01822ec46307ca6880157a5", "attempt_id": "c19791ef0dee", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:08.727804Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 587, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.62754193227738, "ttft_ms": 13.11858301050961, "decode_ms": 105.23087496403605}, "total_wall_ms": 189.05345897655934, "ttft_ms": 13.11858301050961, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 9191997440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13005071448, "mlx_cache_bytes": 14684855296, "process_rss_bytes": 9191997440}, "peak_prefill_memory": null, "peak_decode_memory": 13005071448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20683848", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "f982db5c08f4cae7fc44076b4fab2a220ac383c65fcbc4e5824e6d0a5a32b3ad"} | ||||
| 318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93e118d9575d63943122a308", "attempt_id": "4cd80e99ef6f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:08.949039Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 582, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.18370793573558, "ttft_ms": 13.216292019933462, "decode_ms": 13.024500105530024}, "total_wall_ms": 96.44245798699558, "ttft_ms": 13.216292019933462, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191997440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997010520, "mlx_cache_bytes": 14838406144, "process_rss_bytes": 9191997440}, "peak_prefill_memory": null, "peak_decode_memory": 12997010520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6916b5b469d5005e6757ccaf", "attempt_id": "b4be16255961", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:09.076956Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 586, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.71325003542006, "ttft_ms": 13.20683304220438, "decode_ms": 13.14866601023823}, "total_wall_ms": 97.08366601262242, "ttft_ms": 13.20683304220438, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191997440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13004776536, "mlx_cache_bytes": 14838406144, "process_rss_bytes": 9191997440}, "peak_prefill_memory": null, "peak_decode_memory": 13004776536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1dd00ab2e6756031f3558884", "attempt_id": "1eff9afc99c4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:09.205433Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 589, "message_tokens": 500, "message_utf8_bytes": 1252, "cache_tensor_bytes": null, "serialized_payload_bytes": 1252, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.627083105035126, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.97545796912163, "ttft_ms": 13.287334004417062, "decode_ms": 13.123583048582077}, "total_wall_ms": 97.45545801706612, "ttft_ms": 13.287334004417062, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9191997440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12988982360, "mlx_cache_bytes": 15080627200, "process_rss_bytes": 9191997440}, "peak_prefill_memory": null, "peak_decode_memory": 12988982360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90621e675e744007fb0dfe12e0ed2c035d86abbf4946cf85f4d01ff78c7bd459", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b56194794f9f62efd5cbb65", "attempt_id": "5319193ca860", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:11.226630Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 46, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.9367500208318233, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.88341706804931, "ttft_ms": 29.88341706804931, "decode_ms": 28.518624952994287}, "total_wall_ms": 68.29308404121548, "ttft_ms": 29.88341706804931, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 46}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 9395109888, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13268292856, "mlx_cache_bytes": 15248891249, "process_rss_bytes": 9395109888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268292856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "d83b9ff3c07a8390e2ea0a2af45fba37595da25f31b85ba625363ee98c0c796f"} | ||||
| 322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f6aeef4cbea229bd459921c5", "attempt_id": "c6fc31307be4", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:11.327023Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 35, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.4980410924181342, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.234208028763533, "ttft_ms": 31.234208028763533, "decode_ms": 14.055709005333483}, "total_wall_ms": 54.70020789653063, "ttft_ms": 31.234208028763533, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9395109888, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13258691832, "mlx_cache_bytes": 15283035505, "process_rss_bytes": 9395109888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13258691832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3631d773a21c14680313141f", "attempt_id": "3ec1516fc0c7", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:11.413201Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 37, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.937124994583428, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.780999921262264, "ttft_ms": 30.780999921262264, "decode_ms": 13.823165907524526}, "total_wall_ms": 54.67316601425409, "ttft_ms": 30.780999921262264, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9395109888, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13260707064, "mlx_cache_bytes": 15319194993, "process_rss_bytes": 9395109888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13260707064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4d38892909176fc82c54e2c2", "attempt_id": "637777bd52a8", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:11.500196Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 52, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.8859159899875522, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.74362501502037, "ttft_ms": 30.74362501502037, "decode_ms": 126.82537490036339}, "total_wall_ms": 167.8468749159947, "ttft_ms": 30.74362501502037, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 52}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 9374171136, "backend_memory": {"mlx_active_bytes": 13208638472, "mlx_peak_bytes": 13273077008, "mlx_cache_bytes": 15479938833, "process_rss_bytes": 9374171136}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273077008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "123450000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "0f21a66a362123a6225d5a52886520c86a7a15611815f671e23b4fd29aa63d3b"} | ||||
| 325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "842745c791f0c178a9d5e56a", "attempt_id": "3aa2f43dd611", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:11.699317Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 43, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.5592500567436218, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.810207943432033, "ttft_ms": 30.810207943432033, "decode_ms": 97.90683398023248}, "total_wall_ms": 138.56974989175797, "ttft_ms": 30.810207943432033, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9374171136, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13269439736, "mlx_cache_bytes": 15500091153, "process_rss_bytes": 9374171136}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13269439736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1200000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "0d9760fbd449ca8e13c614acdd941e77e4c0e795831b641763c361934463ade4"} | ||||
| 326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4edb95bf43fdb058d63cf3ab", "attempt_id": "75f3ba89288a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:11.871750Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 53, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.540833036415279, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.919166980311275, "ttft_ms": 30.919166980311275, "decode_ms": 69.6816659765318}, "total_wall_ms": 110.12383305933326, "ttft_ms": 30.919166980311275, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 9374171136, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13280236828, "mlx_cache_bytes": 15534284985, "process_rss_bytes": 9374171136}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280236828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "115ec1ac90ab18b2fdf768c7", "attempt_id": "4cfb4b272cdb", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:12.014300Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 47, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.7553330399096012, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.125000048428774, "ttft_ms": 30.125000048428774, "decode_ms": 97.24137501325458}, "total_wall_ms": 137.1041249949485, "ttft_ms": 30.125000048428774, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 9352085504, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13269128464, "mlx_cache_bytes": 15534284985, "process_rss_bytes": 9352085504}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13269128464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2489928", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "f090bcbc9d72e4cc9435967ec920844287af8a042219706336d29fdb822baa92"} | ||||
| 328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "739ee2d5e9d5712d1aea9e0c", "attempt_id": "e3cd65b374a2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:12.185399Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 42, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.8951670499518514, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.034208972007036, "ttft_ms": 29.034208972007036, "decode_ms": 55.2683329442516}, "total_wall_ms": 94.21862498857081, "ttft_ms": 29.034208972007036, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 42}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 9312616448, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13268767992, "mlx_cache_bytes": 15558254777, "process_rss_bytes": 9312616448}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268767992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "dfcafae694259c719203dd502252ab975bf6849dc6c8f5fcbe1eda19a821db4d"} | ||||
| 329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0d4f031300790897fa32e121", "attempt_id": "55c85cfab537", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:12.311051Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 46, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.896000001579523, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.991124941967428, "ttft_ms": 28.991124941967428, "decode_ms": 138.51029193028808}, "total_wall_ms": 177.37704108003527, "ttft_ms": 28.991124941967428, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 9312616448, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13268292856, "mlx_cache_bytes": 15558254777, "process_rss_bytes": 9312616448}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268292856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NN-96B-2697", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "777b2f6383978a1fec0570f4b5a859580d5cfdc77ca3bc82d0d550aba21ebea5"} | ||||
| 330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "71a4909a219c221da6a2518e", "attempt_id": "5ee7d62c6617", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:12.519942Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10905, "keep": 2726, "compress_ms": 11.578000034205616}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 49, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507542, "side_information_bytes": 16278, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1892.1285829273984, "doc_prefill_ms": 1514.429375063628, "compress_ms": 11.614207993261516, "serialize_ms": 349.19558302499354, "load_ms": 1.934707979671657, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.672583961859345, "ttft_ms": 30.672583961859345, "decode_ms": 13.8649579603225}, "total_wall_ms": 54.91095804609358, "ttft_ms": 30.672583961859345, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 9312616448, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13271110928, "mlx_cache_bytes": 15592612025, "process_rss_bytes": 9312616448}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13271110928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "382eae835010351fd62e1c0b302dbd7e2eb6434b950488cdb29bb773a918f507", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "90d11742008b5ddc75c151f6", "attempt_id": "09d9cf735079", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:12.607051Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 46, "compress_ms": 132.31266697403044}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 46, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507582, "side_information_bytes": 16318, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 903.9893749868497, "doc_prefill_ms": 1514.429375063628, "compress_ms": 140.17866703215986, "serialize_ms": 763.4810000890866, "load_ms": 2.4245830718427896, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.11916597280651, "ttft_ms": 39.11916597280651, "decode_ms": 139.57816699985415}, "total_wall_ms": 1104.4234579894692, "ttft_ms": 39.11916597280651, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 8479686656, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13268292856, "mlx_cache_bytes": 16446939457, "process_rss_bytes": 8479686656}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268292856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HP-87A-7363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c570eb8c98a96dd284d2fb510d84c0fe0cc43ee66b94311e01435706f5e44f0d", "output_hash": "01cab9bf8c940208717157372a3dbb7eadb8344dd420795a32306f27bfae243d"} | ||||
| 332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49cb07f9e356aa17dac08688", "attempt_id": "bb66fd84c6d4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:13.743344Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 35, "compress_ms": 90.18262499012053}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 35, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 440.121416002512, "doc_prefill_ms": 1514.429375063628, "compress_ms": 97.93679101858288, "serialize_ms": 341.9684579130262, "load_ms": 1.67758297175169, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.540125026367605, "ttft_ms": 31.540125026367605, "decode_ms": 14.009415986947715}, "total_wall_ms": 495.564040960744, "ttft_ms": 31.540125026367605, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8580808704, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13258691832, "mlx_cache_bytes": 16473727297, "process_rss_bytes": 8580808704}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13258691832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2eac9ba4408b5a1fdbad2a80", "attempt_id": "786b821f13b0", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:14.269470Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 37, "compress_ms": 89.15554208215326}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 37, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 309.3582500005141, "doc_prefill_ms": 1514.429375063628, "compress_ms": 97.33687492553145, "serialize_ms": 211.80299995467067, "load_ms": 1.6507909167557955, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.907000065781176, "ttft_ms": 30.907000065781176, "decode_ms": 14.068916905671358}, "total_wall_ms": 364.15329191368073, "ttft_ms": 30.907000065781176, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8576548864, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13260707064, "mlx_cache_bytes": 16512016705, "process_rss_bytes": 8576548864}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13260707064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "15b6ff099d3aabe6c70c96ae", "attempt_id": "2aab6337cde2", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:14.664544Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 52, "compress_ms": 92.68800006248057}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 52, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 122.83829203806818, "doc_prefill_ms": 1514.429375063628, "compress_ms": 100.5108329700306, "serialize_ms": 22.10583398118615, "load_ms": 1.318583032116294, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.548958107829094, "ttft_ms": 30.548958107829094, "decode_ms": 129.51879191678017}, "total_wall_ms": 292.4233339726925, "ttft_ms": 30.548958107829094, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 52}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 8576581632, "backend_memory": {"mlx_active_bytes": 13208638472, "mlx_peak_bytes": 13273077008, "mlx_cache_bytes": 16553337153, "process_rss_bytes": 8576581632}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273077008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,284,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "d3a51d5e0b046a6f159ce6fdf802819487132b8b297a0c920014a42c5b8a650f"} | ||||
| 335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0f11950d43d4ea7f659ee07b", "attempt_id": "84123eda9dcf", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:14.986965Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 43, "compress_ms": 91.79900004528463}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 43, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 233.20608399808407, "doc_prefill_ms": 1514.429375063628, "compress_ms": 99.94404099415988, "serialize_ms": 133.04508302826434, "load_ms": 1.395000028423965, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.806916998699307, "ttft_ms": 30.806916998699307, "decode_ms": 99.37641699798405}, "total_wall_ms": 373.0647909687832, "ttft_ms": 30.806916998699307, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 8576352256, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13267031288, "mlx_cache_bytes": 16591216961, "process_rss_bytes": 8576352256}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13267031288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7132650", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "9dc6cfeebae90cf5b5663f9a5b8c671cbfaf599428cbbbf638dff3b12203b2a3"} | ||||
| 336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "201121f6f714de2542f0c751", "attempt_id": "daf8c1196c36", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:15.390027Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 53, "compress_ms": 90.84470802918077}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 53, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.72274996433407, "doc_prefill_ms": 1514.429375063628, "compress_ms": 99.30808306671679, "serialize_ms": 16.19416708126664, "load_ms": 1.5364170540124178, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.13308299705386, "ttft_ms": 30.13308299705386, "decode_ms": 70.21229201927781}, "total_wall_ms": 225.69141699932516, "ttft_ms": 30.13308299705386, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8576434176, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13274748180, "mlx_cache_bytes": 16645857601, "process_rss_bytes": 8576434176}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274748180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "baa06056b3f95e9ac2923b19", "attempt_id": "03fed9cd327a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:15.646356Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 47, "compress_ms": 91.2140830187127}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 47, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507580, "side_information_bytes": 16316, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.36050001066178, "doc_prefill_ms": 1514.429375063628, "compress_ms": 98.96908397786319, "serialize_ms": 15.159250004217029, "load_ms": 1.6687079332768917, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.06345801986754, "ttft_ms": 30.06345801986754, "decode_ms": 112.48379200696945}, "total_wall_ms": 266.7332909768447, "ttft_ms": 30.06345801986754, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 8576483328, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13269128464, "mlx_cache_bytes": 16678674753, "process_rss_bytes": 8576483328}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13269128464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20833709", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b8a4c2d1ae6d93cf25e094c26c4365eeb63238c7127a7da0d5c9b14b1586bfcf", "output_hash": "5273b83535a4288f667cc1978a62374ff952e3a9f48477eebb248a3d43120933"} | ||||
| 338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cffe1759fc9c8dbb724fe78f", "attempt_id": "750461e91f97", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:15.943337Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 42, "compress_ms": 90.16454196535051}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 42, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 113.2328340318054, "doc_prefill_ms": 1514.429375063628, "compress_ms": 97.97758294735104, "serialize_ms": 15.032749972306192, "load_ms": 1.5679580392315984, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.934000059962273, "ttft_ms": 28.934000059962273, "decode_ms": 69.7944590356201}, "total_wall_ms": 221.6401669429615, "ttft_ms": 28.934000059962273, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 42}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8576516096, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13266359544, "mlx_cache_bytes": 16708002113, "process_rss_bytes": 8576516096}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13266359544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37190", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "cf7a4e6456cc08174a919f9bd8830e7d8e94bccd6d92a67fabd0620b3d8acc79"} | ||||
| 339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "acbb62b985d66d3838534eae", "attempt_id": "8e2c96c75ef4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:16.195226Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 46, "compress_ms": 92.24845806602389}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 46, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.9651669440791, "doc_prefill_ms": 1514.429375063628, "compress_ms": 100.55899992585182, "serialize_ms": 15.18870797008276, "load_ms": 1.6022910131141543, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.932625078596175, "ttft_ms": 28.932625078596175, "decode_ms": 13.916666968725622}, "total_wall_ms": 168.5131249250844, "ttft_ms": 28.932625078596175, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8576516096, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13268292856, "mlx_cache_bytes": 16708002113, "process_rss_bytes": 8576516096}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268292856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "611fc33cd94aa86ce9e308b5", "attempt_id": "a2830a9e4dd1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:16.393997Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10905, "keep": 2726, "window_tokens": 49, "compress_ms": 91.83600009419024}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 49, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 100491264, "serialized_payload_bytes": 100507581, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.65954203251749, "doc_prefill_ms": 1514.429375063628, "compress_ms": 99.69341603573412, "serialize_ms": 15.730250044725835, "load_ms": 0.7467500399798155, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.4169999435544, "ttft_ms": 30.4169999435544, "decode_ms": 14.15116700809449}, "total_wall_ms": 169.12325005978346, "ttft_ms": 30.4169999435544, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8576548864, "backend_memory": {"mlx_active_bytes": 13207262216, "mlx_peak_bytes": 13271110928, "mlx_cache_bytes": 16742211905, "process_rss_bytes": 8576548864}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13271110928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "648676bb552cc5376d74486469903ac44166496f96daa49e75d6b9e4bf0d28c7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa2d9e3014be3788341f2de6", "attempt_id": "bd6bebf80e4e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:16.747556Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 46, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 10.85837499704212, "receiver_prefill_ms": 0.0, "query_prefill_ms": 40.93970893882215, "ttft_ms": 40.93970893882215, "decode_ms": 182.20049992669374}, "total_wall_ms": 242.16258304659277, "ttft_ms": 40.93970893882215, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 8174354432, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13639273048, "mlx_cache_bytes": 17328388513, "process_rss_bytes": 8174354432}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13639273048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HP-87A-7363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "01cab9bf8c940208717157372a3dbb7eadb8344dd420795a32306f27bfae243d"} | ||||
| 342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "74203d02bcdb2abb353d07bb", "attempt_id": "b3e39dc62e8b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:17.020890Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 35, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.3767920210957527, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.72862497437745, "ttft_ms": 34.72862497437745, "decode_ms": 16.306792036630213}, "total_wall_ms": 61.4026669645682, "ttft_ms": 34.72862497437745, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8174387200, "backend_memory": {"mlx_active_bytes": 13435229192, "mlx_peak_bytes": 13604574709, "mlx_cache_bytes": 17427348433, "process_rss_bytes": 8174387200}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13604574709, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0b848b8b864128c297f73dd", "attempt_id": "d33fb6f20a9b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:17.113328Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 37, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 1.7769999103620648, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.25279197655618, "ttft_ms": 43.25279197655618, "decode_ms": 16.271375003270805}, "total_wall_ms": 69.16495796758682, "ttft_ms": 43.25279197655618, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 8174387200, "backend_memory": {"mlx_active_bytes": 13435229192, "mlx_peak_bytes": 13611783701, "mlx_cache_bytes": 17427349025, "process_rss_bytes": 8174387200}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13611783701, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "288341487378114353da5e6b", "attempt_id": "938258a76ef2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:17.212701Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 52, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.5125410174950957, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.41595905739814, "ttft_ms": 37.41595905739814, "decode_ms": 145.13383305165917}, "total_wall_ms": 192.8838329622522, "ttft_ms": 37.41595905739814, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 52}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 8174419968, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13662380569, "mlx_cache_bytes": 17573500129, "process_rss_bytes": 8174419968}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13662380569, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "919374b22395f7621171750d", "attempt_id": "233e298a0aa6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:17.435106Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 43, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.758749993517995, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.55324992723763, "ttft_ms": 36.55324992723763, "decode_ms": 114.203582983464}, "total_wall_ms": 161.4281659713015, "ttft_ms": 36.55324992723763, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 8082145280, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13634409093, "mlx_cache_bytes": 17695036641, "process_rss_bytes": 8082145280}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13634409093, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7139200", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "6c191104b2cbba9d5e063581eeed72d5c3b10426572a63c1f1ac1a255a348c3f"} | ||||
| 346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0192d52980181178bfc8761e", "attempt_id": "00615362d3bf", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:17.626871Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 53, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.338542020879686, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.47775009833276, "ttft_ms": 37.47775009833276, "decode_ms": 81.3805409707129}, "total_wall_ms": 129.33916703332216, "ttft_ms": 37.47775009833276, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 8082161664, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13666837137, "mlx_cache_bytes": 17844988945, "process_rss_bytes": 8082161664}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13666837137, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6eac0687646dfd42b358bceb", "attempt_id": "1c0886084236", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:17.786196Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 47, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.5115410098806024, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.28050003014505, "ttft_ms": 39.28050003014505, "decode_ms": 129.6040409943089}, "total_wall_ms": 179.73220895510167, "ttft_ms": 39.28050003014505, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 7861616640, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13645733193, "mlx_cache_bytes": 17976847377, "process_rss_bytes": 7861616640}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13645733193, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20833709", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "5273b83535a4288f667cc1978a62374ff952e3a9f48477eebb248a3d43120933"} | ||||
| 348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed03540b8825123a0fbefd98", "attempt_id": "ea2ea02de6ab", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:17.996075Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 42, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.6738750748336315, "receiver_prefill_ms": 0.0, "query_prefill_ms": 82.78683293610811, "ttft_ms": 82.78683293610811, "decode_ms": 80.84641594905406}, "total_wall_ms": 174.53087493777275, "ttft_ms": 82.78683293610811, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 42}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7300038656, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13628097478, "mlx_cache_bytes": 18094550033, "process_rss_bytes": 7300038656}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13628097478, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37190", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "cf7a4e6456cc08174a919f9bd8830e7d8e94bccd6d92a67fabd0620b3d8acc79"} | ||||
| 349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c75e57bafa75112ae1628602", "attempt_id": "364ae136c8b3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:18.199972Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 46, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.694917027838528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.79341706447303, "ttft_ms": 36.79341706447303, "decode_ms": 16.259416937828064}, "total_wall_ms": 63.990166992880404, "ttft_ms": 36.79341706447303, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 46}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7300055040, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13642357017, "mlx_cache_bytes": 18094550033, "process_rss_bytes": 7300055040}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13642357017, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "10eff41ff9b9f975d941906a", "attempt_id": "2059f97fbc94", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:18.294874Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13219058696}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10866, "source_tokens_receiver": 10866, "query_tokens": 49, "message_tokens": 10905, "message_utf8_bytes": 58595, "cache_tensor_bytes": 213563520, "serialized_payload_bytes": 213598582, "side_information_bytes": 35062, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 154.09620804712176, "doc_prefill_ms": 1514.429375063628, "compress_ms": 22.42087502963841, "serialize_ms": 131.31245807744563, "load_ms": 2.6201660512015224, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.41475002001971, "ttft_ms": 43.41475002001971, "decode_ms": 16.273166984319687}, "total_wall_ms": 70.18425001297146, "ttft_ms": 43.41475002001971, "input_usage": {"receiver_prefix_tokens": 10905, "dense_cache_bytes": 402001920, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7300071424, "backend_memory": {"mlx_active_bytes": 13436113928, "mlx_peak_bytes": 13652942153, "mlx_cache_bytes": 18130005009, "process_rss_bytes": 7300071424}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13652942153, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b48b95198e0a6c83aaaf9fbd6a428d11d80bf79af4e166697aa5e657d17509e4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28b9b94871291c9672f84747", "attempt_id": "cb645b04507c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:19.036305Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10788, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1951.9776670495048, "ttft_ms": 34.65070796664804, "decode_ms": 111.99624999426305}, "total_wall_ms": 2114.4816250307485, "ttft_ms": 34.65070796664804, "input_usage": {"receiver_prompt_tokens": 10788}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 7077281792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6133195096, "process_rss_bytes": 7077281792}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HP-87A-7363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "01cab9bf8c940208717157372a3dbb7eadb8344dd420795a32306f27bfae243d"} | ||||
| 352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ac03a53c5e5a9852d54541e", "attempt_id": "5a8e7448b29c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:21.193849Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10779, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1555.02870795317, "ttft_ms": 16.85749995522201, "decode_ms": 33.15249993465841}, "total_wall_ms": 1619.8533329879865, "ttft_ms": 16.85749995522201, "input_usage": {"receiver_prompt_tokens": 10779}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 7077298176, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6334947672, "process_rss_bytes": 7077298176}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5dc5fe7cfde7a0cd3a2d9e3", "attempt_id": "8072ad1dd599", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:22.842219Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10781, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1558.7624999461696, "ttft_ms": 16.653166036121547, "decode_ms": 32.66070794779807}, "total_wall_ms": 1622.9309160262346, "ttft_ms": 16.653166036121547, "input_usage": {"receiver_prompt_tokens": 10781}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 7077281792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6537568600, "process_rss_bytes": 7077281792}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "58c8270f3589787e7d05b636", "attempt_id": "9f24545cb678", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:24.493333Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10796, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1591.7817499721423, "ttft_ms": 16.245041973888874, "decode_ms": 80.41391591541469}, "total_wall_ms": 1703.4258339554071, "ttft_ms": 16.245041973888874, "input_usage": {"receiver_prompt_tokens": 10796}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7077314560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6759817560, "process_rss_bytes": 7077314560}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85e077b5368f6a29cf63ea69", "attempt_id": "57dfa990a843", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:26.225214Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10787, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1548.1833330122754, "ttft_ms": 16.35945902671665, "decode_ms": 80.28870797716081}, "total_wall_ms": 1662.656500004232, "ttft_ms": 16.35945902671665, "input_usage": {"receiver_prompt_tokens": 10787}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7077363712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6786687320, "process_rss_bytes": 7077363712}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,511,225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "12aa63a099b22b4b0010b2f086f960310910b50dc51abd280190d5b38c1d4add"} | ||||
| 356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1e674c2a03d355aede29049a", "attempt_id": "59c17e3ba339", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:27.916064Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10797, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1566.992082982324, "ttft_ms": 16.28600002732128, "decode_ms": 80.24679194204509}, "total_wall_ms": 1678.4000000916421, "ttft_ms": 16.28600002732128, "input_usage": {"receiver_prompt_tokens": 10797}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7077363712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6859563352, "process_rss_bytes": 7077363712}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "485da600f8158c4a27b62a2c", "attempt_id": "e9b6b066e06d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:29.623331Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10791, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1583.6994999554008, "ttft_ms": 16.50054205674678, "decode_ms": 80.23437496740371}, "total_wall_ms": 1694.9477919843048, "ttft_ms": 16.50054205674678, "input_usage": {"receiver_prompt_tokens": 10791}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7077380096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 7066050904, "process_rss_bytes": 7077380096}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,461,750", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "1b11db6b06c0e850c951403f5f67938110767c7a0fb171fc7cbbf09690a5c483"} | ||||
| 358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c504c17bd2886459f76dd60", "attempt_id": "308fb4f7806c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:31.346253Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10786, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1561.94887496531, "ttft_ms": 16.710542025975883, "decode_ms": 48.63541608210653}, "total_wall_ms": 1642.5353330560029, "ttft_ms": 16.710542025975883, "input_usage": {"receiver_prompt_tokens": 10786}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 7077429248, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 7137485144, "process_rss_bytes": 7077429248}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "05609c541cd313d21e411017ccacbafb3f60f8c03386a081948de3d7daa5795b"} | ||||
| 359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "efd9d850626256cc9d165638", "attempt_id": "523ba43568fd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:33.017165Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10790, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1566.3452909793705, "ttft_ms": 16.255958005785942, "decode_ms": 16.244124970398843}, "total_wall_ms": 1613.9018749818206, "ttft_ms": 16.255958005785942, "input_usage": {"receiver_prompt_tokens": 10790}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7077429248, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 7137485144, "process_rss_bytes": 7077429248}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ee1fae690905f5c9e56d0eda", "attempt_id": "56608e4b5dc7", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:34.659774Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 10793, "message_tokens": 10683, "message_utf8_bytes": 58595, "cache_tensor_bytes": null, "serialized_payload_bytes": 58595, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416020475327969, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1579.8964579589665, "ttft_ms": 16.477749915793538, "decode_ms": 16.131749958731234}, "total_wall_ms": 1627.8587089618668, "ttft_ms": 16.477749915793538, "input_usage": {"receiver_prompt_tokens": 10793}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7077429248, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 7246012760, "process_rss_bytes": 7077429248}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e1bc5245054dfd289726a73d", "attempt_id": "0170aaa58515", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:46.087046Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.24570797290653, "ttft_ms": 13.519875006750226, "decode_ms": 13.519415981136262}, "total_wall_ms": 106.32891696877778, "ttft_ms": 13.519875006750226, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078019072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 10539254540, "process_rss_bytes": 7078019072}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f2e052163270dd6a74d43e6", "attempt_id": "fba930c65e58", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:46.222668Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.55616703536361, "ttft_ms": 13.693207991309464, "decode_ms": 27.200666023418307}, "total_wall_ms": 124.58099995274097, "ttft_ms": 13.693207991309464, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 7078019072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821452, "mlx_cache_bytes": 10881778444, "process_rss_bytes": 7078019072}, "peak_prefill_memory": null, "peak_decode_memory": 13037821452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6e593d4ffceabf157868160d", "attempt_id": "094820e0e0ed", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:46.375536Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.77541603334248, "ttft_ms": 13.576790923252702, "decode_ms": 27.148541994392872}, "total_wall_ms": 118.58958401717246, "ttft_ms": 13.576790923252702, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 7078019072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083020, "mlx_cache_bytes": 11225596684, "process_rss_bytes": 7078019072}, "peak_prefill_memory": null, "peak_decode_memory": 13039083020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52ce927563ec401f974c03e2", "attempt_id": "6d1cb7ef135d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:46.522426Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 630, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.81145896296948, "ttft_ms": 13.446375029161572, "decode_ms": 13.609209097921848}, "total_wall_ms": 105.98320805002004, "ttft_ms": 13.446375029161572, "input_usage": {"receiver_prompt_tokens": 630, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078019072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047176748, "mlx_cache_bytes": 11600760032, "process_rss_bytes": 7078019072}, "peak_prefill_memory": null, "peak_decode_memory": 13047176748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db11b9b7e7f69af07ae2331e", "attempt_id": "8df083fb3094", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:46.657267Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.87833299860358, "ttft_ms": 13.501000008545816, "decode_ms": 13.825041009113193}, "total_wall_ms": 105.3402089746669, "ttft_ms": 13.501000008545816, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078019072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 11600760032, "process_rss_bytes": 7078019072}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fd82fa9622951b6fcf6bb4f7", "attempt_id": "fb2eb6565e21", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:46.791213Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.54600001499057, "ttft_ms": 13.451540959067643, "decode_ms": 67.21029104664922}, "total_wall_ms": 159.3102499609813, "ttft_ms": 13.451540959067643, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7078019072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 11891594936, "process_rss_bytes": 7078019072}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ad69d38d6abb08b0555ac162", "attempt_id": "22f7945fa893", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:46.978936Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.19508302398026, "ttft_ms": 13.460625079460442, "decode_ms": 257.4483749922365}, "total_wall_ms": 349.2165000643581, "ttft_ms": 13.460625079460442, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": 7078035456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981868, "mlx_cache_bytes": 12240475832, "process_rss_bytes": 7078035456}, "peak_prefill_memory": null, "peak_decode_memory": 13043981868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,801,225 + 6,309,300 = 14,110,525", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "a7f009a4019ed01b3f72acd87f0588b7b3880468650836400efcfee8bc4011db"} | ||||
| 368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed3203102fbbf851b59c9499", "attempt_id": "85f90481f1ec", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:47.356822Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.43891603220254, "ttft_ms": 13.566749985329807, "decode_ms": 40.76158395037055}, "total_wall_ms": 131.82879204396158, "ttft_ms": 13.566749985329807, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 7078035456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042179596, "mlx_cache_bytes": 12362176184, "process_rss_bytes": 7078035456}, "peak_prefill_memory": null, "peak_decode_memory": 13042179596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "05609c541cd313d21e411017ccacbafb3f60f8c03386a081948de3d7daa5795b"} | ||||
| 369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e16149e59364dc5a1acd8bf9", "attempt_id": "371f1f4d0664", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:47.517512Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.5714580193162, "ttft_ms": 13.521083048544824, "decode_ms": 13.70812498498708}, "total_wall_ms": 104.92270800750703, "ttft_ms": 13.521083048544824, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078035456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981868, "mlx_cache_bytes": 12362176184, "process_rss_bytes": 7078035456}, "peak_prefill_memory": null, "peak_decode_memory": 13043981868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b211d9ae026854497f046511", "attempt_id": "07eba4692677", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:47.651456Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1679, "cache_tensor_bytes": null, "serialized_payload_bytes": 1679, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9771.319334045984, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.57237495388836, "ttft_ms": 13.507625088095665, "decode_ms": 13.688207953236997}, "total_wall_ms": 105.8744170004502, "ttft_ms": 13.507625088095665, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 10817, "sender_output_tokens": 512, "sender_prefill_ms": 1608.0505000427365, "sender_ttft_ms": 16.517666052095592, "sender_decode_ms": 8133.1572498893365}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078035456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077012012, "mlx_cache_bytes": 12585293496, "process_rss_bytes": 7078035456}, "peak_prefill_memory": null, "peak_decode_memory": 13077012012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fb2ac6155be534186888afc8f043e9f21b67bc8520d9f1227ffe0d84fa89bde", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "460b887575c18af2b2c1cd24", "attempt_id": "4f5ec1735510", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:57.569535Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 461, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.862292017787695, "ttft_ms": 13.469457975588739, "decode_ms": 13.458082918077707}, "total_wall_ms": 85.64179099630564, "ttft_ms": 13.469457975588739, "input_usage": {"receiver_prompt_tokens": 461, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078297600, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12921117784, "mlx_cache_bytes": 13115856568, "process_rss_bytes": 7078297600}, "peak_prefill_memory": null, "peak_decode_memory": 12921117784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4d7f508607b6f0b80ff08531", "attempt_id": "cb5be14fe840", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:57.684333Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 452, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.287708015181124, "ttft_ms": 13.628666056320071, "decode_ms": 13.410374987870455}, "total_wall_ms": 82.29325001593679, "ttft_ms": 13.628666056320071, "input_usage": {"receiver_prompt_tokens": 452, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078297600, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950920280, "mlx_cache_bytes": 13248960184, "process_rss_bytes": 7078297600}, "peak_prefill_memory": null, "peak_decode_memory": 12950920280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e2dc2d063c31b50eefe3b1f7", "attempt_id": "589d6d4b1846", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:57.795354Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 454, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.29412494413555, "ttft_ms": 13.59283400233835, "decode_ms": 13.439707923680544}, "total_wall_ms": 82.24445895757526, "ttft_ms": 13.59283400233835, "input_usage": {"receiver_prompt_tokens": 454, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12951673944, "mlx_cache_bytes": 13338023608, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12951673944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2750f889ecd3f31748e79793", "attempt_id": "b51a42aa558a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:57.905566Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 469, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.39433304127306, "ttft_ms": 13.433750020340085, "decode_ms": 40.3031250461936}, "total_wall_ms": 109.02262502349913, "ttft_ms": 13.433750020340085, "input_usage": {"receiver_prompt_tokens": 469, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12925754456, "mlx_cache_bytes": 13571430072, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12925754456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "43.95", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "d0b2a8ea5223074f450fecfb3bf149cfa664fa9fbb1629cef4b10a4bca3a0908"} | ||||
| 375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86dbf21c61a5bd96a807f057", "attempt_id": "1c4c857bf279", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.042360Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 460, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.751583957113326, "ttft_ms": 13.875582953915, "decode_ms": 13.489459059201181}, "total_wall_ms": 82.9942919081077, "ttft_ms": 13.875582953915, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12921117784, "mlx_cache_bytes": 13571430072, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12921117784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86b995365b3ddf3849c517e7", "attempt_id": "b7cd879a8e64", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.153856Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 470, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.69420808367431, "ttft_ms": 13.642624951899052, "decode_ms": 80.89862507767975}, "total_wall_ms": 150.10612492915243, "ttft_ms": 13.642624951899052, "input_usage": {"receiver_prompt_tokens": 470, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12926164056, "mlx_cache_bytes": 13663639224, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12926164056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Prawenban-4", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "dc02d2cc8584093b5b4d84fb4997c6da9469a81fcb5382dc8d03a5fafd83b224"} | ||||
| 377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a064b4007f92e1d8b158fbf8", "attempt_id": "4f178bb00385", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.332434Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 464, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.77570800576359, "ttft_ms": 13.473083032295108, "decode_ms": 13.418834074400365}, "total_wall_ms": 82.55545806605369, "ttft_ms": 13.473083032295108, "input_usage": {"receiver_prompt_tokens": 464, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12922952792, "mlx_cache_bytes": 13877253816, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12922952792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a3330776548bb3e7e79c877", "attempt_id": "4e14c23820d9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.443826Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 459, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.74816600326449, "ttft_ms": 13.468415942043066, "decode_ms": 40.396915981546044}, "total_wall_ms": 109.52270892448723, "ttft_ms": 13.468415942043066, "input_usage": {"receiver_prompt_tokens": 459, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12943268952, "mlx_cache_bytes": 13995480760, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12943268952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.19", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "05609c541cd313d21e411017ccacbafb3f60f8c03386a081948de3d7daa5795b"} | ||||
| 379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52a2e96e4c342b3e11bec4d9", "attempt_id": "91f3b902546f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.581999Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 463, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.73283294122666, "ttft_ms": 13.54112511035055, "decode_ms": 13.473624945618212}, "total_wall_ms": 82.62408303562552, "ttft_ms": 13.54112511035055, "input_usage": {"receiver_prompt_tokens": 463, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12922559576, "mlx_cache_bytes": 13995480760, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12922559576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b7365da47fe08726941ac386", "attempt_id": "55696c2603f9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.692776Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 466, "message_tokens": 340, "message_utf8_bytes": 928, "cache_tensor_bytes": null, "serialized_payload_bytes": 928, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9783.731666975655, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.62858302053064, "ttft_ms": 13.681375072337687, "decode_ms": 13.4350840235129}, "total_wall_ms": 82.6894158963114, "ttft_ms": 13.681375072337687, "input_usage": {"receiver_prompt_tokens": 466, "sender_input_tokens": 10847, "sender_output_tokens": 512, "sender_prefill_ms": 1601.339708082378, "sender_ttft_ms": 16.451333067379892, "sender_decode_ms": 8157.843625056557}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078313984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12947922008, "mlx_cache_bytes": 14115575480, "process_rss_bytes": 7078313984}, "peak_prefill_memory": null, "peak_decode_memory": 12947922008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92d6ee4063582dc7544590b4613da12ee717a4fdb1b3f75a9726bfcc1593dcd2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed9b7bab103d1251a3103e16", "attempt_id": "71844ef84617", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.811592Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 607, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.16587497573346, "ttft_ms": 13.472125050611794, "decode_ms": 13.499375083483756}, "total_wall_ms": 102.19062492251396, "ttft_ms": 13.472125050611794, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078346752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034151436, "mlx_cache_bytes": 14234916536, "process_rss_bytes": 7078346752}, "peak_prefill_memory": null, "peak_decode_memory": 13034151436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "928458220c2a610126cb807b", "attempt_id": "09f7910bc984", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:58.942585Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 598, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.5179170044139, "ttft_ms": 13.519125059247017, "decode_ms": 27.01237506698817}, "total_wall_ms": 116.07829108834267, "ttft_ms": 13.519125059247017, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 7078346752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13028924940, "mlx_cache_bytes": 14568887992, "process_rss_bytes": 7078346752}, "peak_prefill_memory": null, "peak_decode_memory": 13028924940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26934021af71539f16fc6448", "attempt_id": "208503ae50fb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:59.087041Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 600, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.60433302912861, "ttft_ms": 13.544457964599133, "decode_ms": 27.020624955184758}, "total_wall_ms": 116.22850003186613, "ttft_ms": 13.544457964599133, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 7078346752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041442316, "mlx_cache_bytes": 14870976184, "process_rss_bytes": 7078346752}, "peak_prefill_memory": null, "peak_decode_memory": 13041442316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8e6a4ff877a7704c64fcf1c", "attempt_id": "3e2ada6fbd93", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:59.231998Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 615, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.04987504985183, "ttft_ms": 13.583958963863552, "decode_ms": 67.5181660335511}, "total_wall_ms": 159.20583298429847, "ttft_ms": 13.583958963863552, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7078346752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083020, "mlx_cache_bytes": 14870976184, "process_rss_bytes": 7078346752}, "peak_prefill_memory": null, "peak_decode_memory": 13039083020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e864090d5c3a51047996dc5d", "attempt_id": "6ac834eb756a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:59.419678Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 606, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.18816594872624, "ttft_ms": 13.587875058874488, "decode_ms": 67.87562498357147}, "total_wall_ms": 156.76662500482053, "ttft_ms": 13.587875058874488, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7078363136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13063872012, "mlx_cache_bytes": 14908167864, "process_rss_bytes": 7078363136}, "peak_prefill_memory": null, "peak_decode_memory": 13063872012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,511,225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "12aa63a099b22b4b0010b2f086f960310910b50dc51abd280190d5b38c1d4add"} | ||||
| 386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d2d6dc433c6da5aed879d621", "attempt_id": "37d288fd592d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:59.604498Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 616, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.64300000760704, "ttft_ms": 13.57841701246798, "decode_ms": 68.19333299063146}, "total_wall_ms": 159.5040000975132, "ttft_ms": 13.57841701246798, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 7078363136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039459852, "mlx_cache_bytes": 15089637048, "process_rss_bytes": 7078363136}, "peak_prefill_memory": null, "peak_decode_memory": 13039459852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c27ec4092b6c06dc5790c543", "attempt_id": "5065564809dc", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:46:59.794238Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 610, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.79241604637355, "ttft_ms": 13.817999977618456, "decode_ms": 642.8587919799611}, "total_wall_ms": 735.1717500714585, "ttft_ms": 13.817999977618456, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 47}, "provider_cached_usage": null, "process_memory": 7078494208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067263500, "mlx_cache_bytes": 15246890680, "process_rss_bytes": 7078494208}, "peak_prefill_memory": null, "peak_decode_memory": 13067263500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,801,225 + 6,309,300 + 6,873,860 + 2,466,604 + 6,070,550 + 5,511,225 = 28,322,854", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "32c9e720aaed16a05a9236cc569fe030cc047ea464624ea8971517321a2ec32e"} | ||||
| 388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "297a9cb5f9a53f07a7d2fab5", "attempt_id": "6bf211cced0a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:00.557294Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 605, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.86445805989206, "ttft_ms": 13.536875019781291, "decode_ms": 13.651832938194275}, "total_wall_ms": 103.16025000065565, "ttft_ms": 13.536875019781291, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078494208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13070982668, "mlx_cache_bytes": 15365641912, "process_rss_bytes": 7078494208}, "peak_prefill_memory": null, "peak_decode_memory": 13070982668, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8e007a63c795f450ddb740bb", "attempt_id": "0638c2ab539c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:00.689105Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 609, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.54887498170137, "ttft_ms": 13.675500056706369, "decode_ms": 13.801541994325817}, "total_wall_ms": 103.08224998880178, "ttft_ms": 13.675500056706369, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078494208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034888716, "mlx_cache_bytes": 15425410744, "process_rss_bytes": 7078494208}, "peak_prefill_memory": null, "peak_decode_memory": 13034888716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3402df01c5a7df4268b2baf4", "attempt_id": "8ad364ef14a0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:00.820860Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 502, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 612, "message_tokens": 501, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.706458913162351, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.41149999108166, "ttft_ms": 13.627707958221436, "decode_ms": 13.649000087752938}, "total_wall_ms": 104.74249999970198, "ttft_ms": 13.627707958221436, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 7078494208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821452, "mlx_cache_bytes": 15425410744, "process_rss_bytes": 7078494208}, "peak_prefill_memory": null, "peak_decode_memory": 13037821452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "691ffabf56394d32610ec04eb7785b49128612877239010be1fc5c45f7657150", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "681549b8f118f60d238f5de4", "attempt_id": "691ccba8831e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:02.655462Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 45, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.605249988846481, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.79437494650483, "ttft_ms": 29.79437494650483, "decode_ms": 170.65154190640897}, "total_wall_ms": 210.87916602846235, "ttft_ms": 29.79437494650483, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 7068057600, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14540346604, "mlx_cache_bytes": 16020215841, "process_rss_bytes": 7068057600}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14540346604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NN-96B-2697", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "777b2f6383978a1fec0570f4b5a859580d5cfdc77ca3bc82d0d550aba21ebea5"} | ||||
| 392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5c158c76f0dee0bf82c39e80", "attempt_id": "48e968a9cd9e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:02.898117Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 36, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 1.5648329863324761, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.880750014446676, "ttft_ms": 27.880750014446676, "decode_ms": 15.703167067840695}, "total_wall_ms": 53.0451670056209, "ttft_ms": 27.880750014446676, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6950600704, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14536627436, "mlx_cache_bytes": 16048003105, "process_rss_bytes": 6950600704}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14536627436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0134a10b7e5fee0733b8e9e8", "attempt_id": "0b31d4508cd5", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:02.981494Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 38, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.4452920770272613, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.523749973624945, "ttft_ms": 27.523749973624945, "decode_ms": 15.597249963320792}, "total_wall_ms": 52.922083996236324, "ttft_ms": 27.523749973624945, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 6891880448, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14537725164, "mlx_cache_bytes": 16075298849, "process_rss_bytes": 6891880448}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14537725164, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85a17e78c6afd910f3f39820", "attempt_id": "e0c7a47828fe", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.062798Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 53, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.7195829898118973, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.939041007310152, "ttft_ms": 29.939041007310152, "decode_ms": 81.96587499696761}, "total_wall_ms": 121.9842080026865, "ttft_ms": 29.939041007310152, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 5926993920, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14547834116, "mlx_cache_bytes": 16113378498, "process_rss_bytes": 5926993920}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14547834116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,000,000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "50891936fc76a98c62e59a25cac7b61eb512c3e7cc7ab95cc7bd75b9f554fc3b"} | ||||
| 395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c4fafd34bdcccce0b460d4e7", "attempt_id": "0530d5d696d4", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.214290Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 44, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.119292039424181, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.381834039464593, "ttft_ms": 28.381834039464593, "decode_ms": 32.57029200904071}, "total_wall_ms": 71.55287498608232, "ttft_ms": 28.381834039464593, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 44}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4808343552, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14540346604, "mlx_cache_bytes": 16126502082, "process_rss_bytes": 4808343552}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14540346604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "264e1ce888796973b2d88730", "attempt_id": "7e3ec3c32e85", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.321800Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 54, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.266500028781593, "receiver_prefill_ms": 0.0, "query_prefill_ms": 82.51945802476257, "ttft_ms": 82.51945802476257, "decode_ms": 79.7854169504717}, "total_wall_ms": 172.97612503170967, "ttft_ms": 82.51945802476257, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4465197056, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14548931848, "mlx_cache_bytes": 16163762646, "process_rss_bytes": 4465197056}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14548931848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3275542980d80f856ef8f15", "attempt_id": "a587f4d0a6af", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.529539Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 48, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.4445829913020134, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.721499955281615, "ttft_ms": 28.721499955281615, "decode_ms": 80.0613749306649}, "total_wall_ms": 118.55258408468217, "ttft_ms": 28.721499955281615, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 4465197056, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14542214404, "mlx_cache_bytes": 16197906902, "process_rss_bytes": 4465197056}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14542214404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,542,362", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "ac0601ea422acb384c0b3bbb8550e37db9278826ad4eb580424e1b2a4c0172f7"} | ||||
| 398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc32c1017654fc43e9d3baf2", "attempt_id": "697a9da7c24d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.676524Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 43, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.3131670895963907, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.24804198462516, "ttft_ms": 28.24804198462516, "decode_ms": 30.872750096023083}, "total_wall_ms": 68.66762496065348, "ttft_ms": 28.24804198462516, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 43}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 4465213440, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14539986156, "mlx_cache_bytes": 16219238870, "process_rss_bytes": 4465213440}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14539986156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78e8e707f036698bf79b3a1d", "attempt_id": "69cfd9d77a59", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.774102Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 47, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.4744579568505287, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.737208059988916, "ttft_ms": 27.737208059988916, "decode_ms": 15.480792033486068}, "total_wall_ms": 52.94712504837662, "ttft_ms": 27.737208059988916, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 4465213440, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14541935876, "mlx_cache_bytes": 16231297494, "process_rss_bytes": 4465213440}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14541935876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1fcf8884cdcae78f75d96fa0", "attempt_id": "3c757fafe14b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.855799Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14138790920}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10743, "keep": 2686, "compress_ms": 14.123708941042423}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 50, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065173, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1701.2504580197856, "doc_prefill_ms": 1584.577374975197, "compress_ms": 14.161458006128669, "serialize_ms": 86.65125002153218, "load_ms": 2.536791027523577, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.653333032503724, "ttft_ms": 27.653333032503724, "decode_ms": 15.419124974869192}, "total_wall_ms": 53.3187499968335, "ttft_ms": 27.653333032503724, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 4465229824, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14547129604, "mlx_cache_bytes": 16255234518, "process_rss_bytes": 4465229824}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14547129604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a803068205044ac6b9db596ec1624216787d9f3af39fab90d3b8231215055c3", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e160ce88d866ace5ee3a4a1", "attempt_id": "ce2de35f5abf", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:03.940082Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 45, "compress_ms": 2617.1944580273703}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 45, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065213, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2707.087583024986, "doc_prefill_ms": 1584.577374975197, "compress_ms": 2624.409958953038, "serialize_ms": 82.46766601223499, "load_ms": 6.65695802308619, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.58441699575633, "ttft_ms": 46.58441699575633, "decode_ms": 141.83408301323652}, "total_wall_ms": 2910.3229999309406, "ttft_ms": 46.58441699575633, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1121058816, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14540346604, "mlx_cache_bytes": 17718604350, "process_rss_bytes": 1121058816}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14540346604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HP-87A-7363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2de575ac597ed977e0b4df76033f0f2a20770cb2739290ee866219c8c0a8d918", "output_hash": "01cab9bf8c940208717157372a3dbb7eadb8344dd420795a32306f27bfae243d"} | ||||
| 402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6392dc3c0bd9a0176b60efa1", "attempt_id": "5bf63fa234a2", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:06.880945Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 36, "compress_ms": 133.4867919795215}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 36, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065212, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 213.90224993228912, "doc_prefill_ms": 1584.577374975197, "compress_ms": 141.8591249966994, "serialize_ms": 71.82837498839945, "load_ms": 2.0698750158771873, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.338875039480627, "ttft_ms": 28.338875039480627, "decode_ms": 32.99008298199624}, "total_wall_ms": 285.63112497795373, "ttft_ms": 28.338875039480627, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1437663232, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14536627436, "mlx_cache_bytes": 17761923646, "process_rss_bytes": 1437663232}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14536627436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60e7df2428df5fbd7a825cb934535f425b87ddcafa6cc7879625ac9097dde28a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "673a796ae113741b6d98ffba", "attempt_id": "5c9d75b10814", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:07.202381Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 38, "compress_ms": 128.37725004646927}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 38, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065213, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 180.90629193466157, "doc_prefill_ms": 1584.577374975197, "compress_ms": 136.7682919371873, "serialize_ms": 43.9135420601815, "load_ms": 2.3539999965578318, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.79108300153166, "ttft_ms": 30.79108300153166, "decode_ms": 30.93858400825411}, "total_wall_ms": 252.46475008316338, "ttft_ms": 30.79108300153166, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1440530432, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14537692396, "mlx_cache_bytes": 17815351870, "process_rss_bytes": 1440530432}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14537692396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2de575ac597ed977e0b4df76033f0f2a20770cb2739290ee866219c8c0a8d918", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2429fc1da99c08858743ce0a", "attempt_id": "706fc64b26b1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:07.489630Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 53, "compress_ms": 135.3173330426216}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 53, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065212, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 185.66316703800112, "doc_prefill_ms": 1584.577374975197, "compress_ms": 143.0725830141455, "serialize_ms": 42.404416017234325, "load_ms": 2.404791070148349, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.892457950860262, "ttft_ms": 28.892457950860262, "decode_ms": 77.52295897807926}, "total_wall_ms": 301.91233300138265, "ttft_ms": 28.892457950860262, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1442594816, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14547834116, "mlx_cache_bytes": 17874088510, "process_rss_bytes": 1442594816}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14547834116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60e7df2428df5fbd7a825cb934535f425b87ddcafa6cc7879625ac9097dde28a", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0daa0ec19006859d3c15012b", "attempt_id": "25be54eb6feb", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:07.822777Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 44, "compress_ms": 131.92358403466642}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 44, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065213, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 180.49966695252806, "doc_prefill_ms": 1584.577374975197, "compress_ms": 139.25912498962134, "serialize_ms": 41.04183299932629, "load_ms": 2.367084030993283, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.02308294828981, "ttft_ms": 27.02308294828981, "decode_ms": 77.89970794692636}, "total_wall_ms": 295.34962493926287, "ttft_ms": 27.02308294828981, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1443807232, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14540346604, "mlx_cache_bytes": 17921307198, "process_rss_bytes": 1443807232}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14540346604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,511,225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2de575ac597ed977e0b4df76033f0f2a20770cb2739290ee866219c8c0a8d918", "output_hash": "12aa63a099b22b4b0010b2f086f960310910b50dc51abd280190d5b38c1d4add"} | ||||
| 406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31f918cfde4e5959c2838d69", "attempt_id": "e7ebe5aadd1e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:08.150439Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 54, "compress_ms": 136.6512089734897}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 54, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065212, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 187.84083297941834, "doc_prefill_ms": 1584.577374975197, "compress_ms": 145.36254201084375, "serialize_ms": 42.26000001654029, "load_ms": 2.2512500872835517, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.559999984689057, "ttft_ms": 30.559999984689057, "decode_ms": 76.90845802426338}, "total_wall_ms": 305.1054159877822, "ttft_ms": 30.559999984689057, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1448017920, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14548931848, "mlx_cache_bytes": 17994773054, "process_rss_bytes": 1448017920}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14548931848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60e7df2428df5fbd7a825cb934535f425b87ddcafa6cc7879625ac9097dde28a", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "61c6a9a05b9769634f66f2b8", "attempt_id": "0f6d693c0485", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:08.492199Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 48, "compress_ms": 132.52245797775686}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 48, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065213, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 183.2833340158686, "doc_prefill_ms": 1584.577374975197, "compress_ms": 140.43183403555304, "serialize_ms": 42.662457912229, "load_ms": 2.4530409136787057, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.498540934175253, "ttft_ms": 27.498540934175253, "decode_ms": 77.84954190719873}, "total_wall_ms": 298.48020791541785, "ttft_ms": 27.498540934175253, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1452228608, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14542214404, "mlx_cache_bytes": 18057261630, "process_rss_bytes": 1452228608}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14542214404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15,841,170", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2de575ac597ed977e0b4df76033f0f2a20770cb2739290ee866219c8c0a8d918", "output_hash": "51488302eef5e83caef5b83bbf78cba556149a5367ff5b645b594ae792bed3ae"} | ||||
| 408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce33b894387a874f63f0f468", "attempt_id": "e45e6a4b3d82", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:08.822205Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 43, "compress_ms": 130.895790993236}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 43, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065211, "side_information_bytes": 13243, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 179.40595804248005, "doc_prefill_ms": 1584.577374975197, "compress_ms": 138.11708404682577, "serialize_ms": 41.10645898617804, "load_ms": 2.1894160890951753, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.883416041731834, "ttft_ms": 27.883416041731834, "decode_ms": 46.4283749461174}, "total_wall_ms": 263.68362503126264, "ttft_ms": 27.883416041731834, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1455013888, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14539986156, "mlx_cache_bytes": 18103448126, "process_rss_bytes": 1455013888}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14539986156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6bd951b88dff2f776e0647ab1b9b3d60f2caba0e02a5a82ced80806fd8155e89", "output_hash": "05609c541cd313d21e411017ccacbafb3f60f8c03386a081948de3d7daa5795b"} | ||||
| 409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1b5e48d1fde89f3b34734b20", "attempt_id": "295f1339320b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:09.117706Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 47, "compress_ms": 132.38854194059968}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 47, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065213, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 182.54895799327642, "doc_prefill_ms": 1584.577374975197, "compress_ms": 139.64995800051838, "serialize_ms": 42.712709051556885, "load_ms": 2.3547500604763627, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.82220800872892, "ttft_ms": 27.82220800872892, "decode_ms": 15.954457921907306}, "total_wall_ms": 236.2757499795407, "ttft_ms": 27.82220800872892, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1462321152, "backend_memory": {"mlx_active_bytes": 14452577288, "mlx_peak_bytes": 14541935876, "mlx_cache_bytes": 18152223294, "process_rss_bytes": 1462321152}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14541935876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2de575ac597ed977e0b4df76033f0f2a20770cb2739290ee866219c8c0a8d918", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "89b726cacd4b44c261e9e4d4", "attempt_id": "f3903fae0098", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:09.385007Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13830509576}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10743, "keep": 2686, "window_tokens": 50, "compress_ms": 133.05175001733005}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 50, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 308051968, "serialized_payload_bytes": 308065213, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.8792500095442, "doc_prefill_ms": 1584.577374975197, "compress_ms": 140.69558400660753, "serialize_ms": 43.98841701913625, "load_ms": 2.427165978588164, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.180584057234228, "ttft_ms": 30.180584057234228, "decode_ms": 15.527707990258932}, "total_wall_ms": 240.77929195482284, "ttft_ms": 30.180584057234228, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1465499648, "backend_memory": {"mlx_active_bytes": 14454412296, "mlx_peak_bytes": 14544016644, "mlx_cache_bytes": 18212549182, "process_rss_bytes": 1465499648}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14544016644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2de575ac597ed977e0b4df76033f0f2a20770cb2739290ee866219c8c0a8d918", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "79d8b77ac09214d40ccf3b3a", "attempt_id": "1aead637d418", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:09.965048Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 45, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 20.393625018186867, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.30220796633512, "ttft_ms": 58.30220796633512, "decode_ms": 144.1395409638062}, "total_wall_ms": 244.65683300513774, "ttft_ms": 58.30220796633512, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2493661184, "backend_memory": {"mlx_active_bytes": 15145292808, "mlx_peak_bytes": 15450524708, "mlx_cache_bytes": 19742142206, "process_rss_bytes": 2493661184}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15450524708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HP-87A-7363", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "01cab9bf8c940208717157372a3dbb7eadb8344dd420795a32306f27bfae243d"} | ||||
| 412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dfa9320dac20c284ad447324", "attempt_id": "da14c205e209", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:10.269623Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 36, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 3.766541020013392, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.30120796151459, "ttft_ms": 36.30120796151459, "decode_ms": 37.30233304668218}, "total_wall_ms": 85.0346670486033, "ttft_ms": 36.30120796151459, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2492891136, "backend_memory": {"mlx_active_bytes": 15145276424, "mlx_peak_bytes": 15418308804, "mlx_cache_bytes": 19853934846, "process_rss_bytes": 2492891136}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15418308804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5b35a7db69a36c1e85aaa852", "attempt_id": "b60fcaa0ef13", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:10.386130Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 38, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 3.961083013564348, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.39637504238635, "ttft_ms": 36.39637504238635, "decode_ms": 36.877166014164686}, "total_wall_ms": 85.44212498236448, "ttft_ms": 36.39637504238635, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2492907520, "backend_memory": {"mlx_active_bytes": 15145276424, "mlx_peak_bytes": 15425796548, "mlx_cache_bytes": 19972412414, "process_rss_bytes": 2492907520}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15425796548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5755fbe8a4894d5f68b6563e", "attempt_id": "206f0822eb62", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:10.505428Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 53, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 4.046958987601101, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.4534169677645, "ttft_ms": 37.4534169677645, "decode_ms": 135.7462500454858}, "total_wall_ms": 185.60620909556746, "ttft_ms": 37.4534169677645, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2294382592, "backend_memory": {"mlx_active_bytes": 15146210312, "mlx_peak_bytes": 15479477917, "mlx_cache_bytes": 20758050078, "process_rss_bytes": 2294382592}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15479477917, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,287,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "098ee7831aa285fe65842367dc0163199af571c0b18c8373699a0b4b1cd76153"} | ||||
| 415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9f34228c121be1067cf185ac", "attempt_id": "115487f5f3f2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:10.721161Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 44, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 4.09258296713233, "receiver_prefill_ms": 0.0, "query_prefill_ms": 70.09487506002188, "ttft_ms": 70.09487506002188, "decode_ms": 92.28991600684822}, "total_wall_ms": 174.30962494108826, "ttft_ms": 70.09487506002188, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1928577024, "backend_memory": {"mlx_active_bytes": 15145292808, "mlx_peak_bytes": 15447375844, "mlx_cache_bytes": 20895708446, "process_rss_bytes": 1928577024}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15447375844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,511,225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "12aa63a099b22b4b0010b2f086f960310910b50dc51abd280190d5b38c1d4add"} | ||||
| 416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52019e34ea3ad623a23f4364", "attempt_id": "7274dcffb480", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:10.929000Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 54, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 4.144458100199699, "receiver_prefill_ms": 0.0, "query_prefill_ms": 58.787374990060925, "ttft_ms": 58.787374990060925, "decode_ms": 98.96650002337992}, "total_wall_ms": 169.3849159637466, "ttft_ms": 58.787374990060925, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1841709056, "backend_memory": {"mlx_active_bytes": 15146210312, "mlx_peak_bytes": 15486428294, "mlx_cache_bytes": 21195708126, "process_rss_bytes": 1841709056}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15486428294, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardvar-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "e31f421890706f13f05e3648ff3c6165b54f9aff1af8b32963889eed430413f0"} | ||||
| 417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2907b82772c053ac562ab57d", "attempt_id": "07f87dfbd939", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:11.127747Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 48, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 4.1498750215396285, "receiver_prefill_ms": 0.0, "query_prefill_ms": 41.41183290630579, "ttft_ms": 41.41183290630579, "decode_ms": 93.0529999313876}, "total_wall_ms": 146.00816695019603, "ttft_ms": 41.41183290630579, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1841676288, "backend_memory": {"mlx_active_bytes": 15145292808, "mlx_peak_bytes": 15461222404, "mlx_cache_bytes": 21345851102, "process_rss_bytes": 1841676288}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15461222404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,461,750", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "1b11db6b06c0e850c951403f5f67938110767c7a0fb171fc7cbbf09690a5c483"} | ||||
| 418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "09c7577770994a34dd7b4499", "attempt_id": "74c0639c8b7e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:11.302254Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 43, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 3.750292002223432, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.79545895103365, "ttft_ms": 45.79545895103365, "decode_ms": 57.54395807161927}, "total_wall_ms": 114.65450003743172, "ttft_ms": 45.79545895103365, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1839480832, "backend_memory": {"mlx_active_bytes": 15145292808, "mlx_peak_bytes": 15443868068, "mlx_cache_bytes": 21479446238, "process_rss_bytes": 1839480832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15443868068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37.19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "05609c541cd313d21e411017ccacbafb3f60f8c03386a081948de3d7daa5795b"} | ||||
| 419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ce445a2d9c19cad5b88ae37", "attempt_id": "c579584a403e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:11.446623Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 47, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 4.244792042300105, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.47383294347674, "ttft_ms": 49.47383294347674, "decode_ms": 18.92883307300508}, "total_wall_ms": 80.00304200686514, "ttft_ms": 49.47383294347674, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1800945664, "backend_memory": {"mlx_active_bytes": 15145292808, "mlx_peak_bytes": 15458076676, "mlx_cache_bytes": 21625525982, "process_rss_bytes": 1800945664}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15458076676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3028bfbffbbe75113b7ca2a0", "attempt_id": "efa276163f29", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:11.558257Z", "task_family": "synthetic", "document_id": "syn_03002_16000", "document_hash": "8feef92ef95bf03a3e7a6bca1fb872fd63a3c24afe5f864d21503915fce9f163", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03002_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14485607432}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10683, "source_tokens_receiver": 10683, "query_tokens": 50, "message_tokens": 10743, "message_utf8_bytes": 58595, "cache_tensor_bytes": 654549504, "serialized_payload_bytes": 654577345, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.26491701230407, "doc_prefill_ms": 1584.577374975197, "compress_ms": 27.190207969397306, "serialize_ms": 268.3880419936031, "load_ms": 3.810207941569388, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.1537500070408, "ttft_ms": 38.1537500070408, "decode_ms": 18.69654201436788}, "total_wall_ms": 68.16675001755357, "ttft_ms": 38.1537500070408, "input_usage": {"receiver_prefix_tokens": 10743, "dense_cache_bytes": 1232093184, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1800962048, "backend_memory": {"mlx_active_bytes": 15145292808, "mlx_peak_bytes": 15469692932, "mlx_cache_bytes": 21781583582, "process_rss_bytes": 1800962048}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15469692932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03002_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f55f6b272532b140da4ab2e53dfd6a515fe49da8b3d5e5b09ad8936c4e97257e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c07fc5551795f90f78a44d1", "attempt_id": "b4c4aa6942a4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:12.354542Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1951, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 9234.417999978177, "ttft_ms": 46.87270789872855, "decode_ms": 137.84199999645352}, "total_wall_ms": 9422.219458036125, "ttft_ms": 46.87270789872855, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13449884344, "mlx_cache_bytes": 2749125680, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13449884344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "58e03bbca9107ce6b4435d30", "attempt_id": "53591b47fefd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:21.802884Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1943, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 204.6502089360729, "ttft_ms": 13.47654196433723, "decode_ms": 13.462750008329749}, "total_wall_ms": 234.23025000374764, "ttft_ms": 13.47654196433723, "input_usage": {"receiver_prompt_tokens": 1943}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13446705848, "mlx_cache_bytes": 3513046064, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13446705848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "55a250e6a67e5942048b22ee", "attempt_id": "aa7339069deb", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:22.052955Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1940, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 204.28450009785593, "ttft_ms": 13.714707922190428, "decode_ms": 13.313582981936634}, "total_wall_ms": 233.9244589675218, "ttft_ms": 13.714707922190428, "input_usage": {"receiver_prompt_tokens": 1940}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13485617848, "mlx_cache_bytes": 4100887600, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13485617848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f57d24cea81a0a06b423ba83", "attempt_id": "0728e067718d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:22.303580Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1958, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 206.995457992889, "ttft_ms": 13.718499918468297, "decode_ms": 83.14833301119506}, "total_wall_ms": 306.6246249945834, "ttft_ms": 13.718499918468297, "input_usage": {"receiver_prompt_tokens": 1958}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13452932160, "mlx_cache_bytes": 4883026992, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13452932160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "679a540dc4739f0ace623448b8fd925fb234f554838d7e87da223228ee81b112"} | ||||
| 425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e577bd81c2f30b57bf74453b", "attempt_id": "f991b362dd3f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:22.626632Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1951, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 214.08183395396918, "ttft_ms": 13.689458020962775, "decode_ms": 96.24995803460479}, "total_wall_ms": 326.7348750960082, "ttft_ms": 13.689458020962775, "input_usage": {"receiver_prompt_tokens": 1951}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13449884344, "mlx_cache_bytes": 4883026992, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13449884344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6e49a93fc2b36b99d9b83e71", "attempt_id": "d580521b123b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:22.969057Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1958, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 225.97908310126513, "ttft_ms": 13.915999908931553, "decode_ms": 81.47254097275436}, "total_wall_ms": 324.0669169463217, "ttft_ms": 13.915999908931553, "input_usage": {"receiver_prompt_tokens": 1958}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13452932160, "mlx_cache_bytes": 4883026992, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13452932160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "719ce7b5085c1239dc23fd9c", "attempt_id": "01eba1bae09d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:23.308877Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1952, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.82350005581975, "ttft_ms": 13.817416969686747, "decode_ms": 135.50816604401916}, "total_wall_ms": 379.8242079792544, "ttft_ms": 13.817416969686747, "input_usage": {"receiver_prompt_tokens": 1952}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13450146880, "mlx_cache_bytes": 5418521648, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13450146880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "43,478,764", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "0d19f8d26ee6f443a3a27aae06e31fceef8b4cc5e276e18d3c494c4cf730c5da"} | ||||
| 428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31fc3d1e7ab2522861102936", "attempt_id": "f838b7d055aa", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:23.704719Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1949, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 220.14841600321233, "ttft_ms": 13.823084067553282, "decode_ms": 67.36970797646791}, "total_wall_ms": 304.0208329912275, "ttft_ms": 13.823084067553282, "input_usage": {"receiver_prompt_tokens": 1949}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13449294520, "mlx_cache_bytes": 5953164336, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13449294520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "2575eaf3b748efc209b676518766751eb038c88f74578951345818bfe7f7194b"} | ||||
| 429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ba72880001c6580a7f56024f", "attempt_id": "d19c8f11b346", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:24.024546Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1953, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.9571250071749, "ttft_ms": 13.960957992821932, "decode_ms": 13.6569170281291}, "total_wall_ms": 257.1981669170782, "ttft_ms": 13.960957992821932, "input_usage": {"receiver_prompt_tokens": 1953}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13450343488, "mlx_cache_bytes": 6488855600, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13450343488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8c93aa51a1c6f171da6a724f", "attempt_id": "34ad7ac6fe2c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:24.297047Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 1954, "message_tokens": 1866, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011832918971776962, "decode_payload_ms": 0.0, "receiver_prefill_ms": 240.21937500219792, "ttft_ms": 13.84695793967694, "decode_ms": 13.689208077266812}, "total_wall_ms": 270.43045894242823, "ttft_ms": 13.84695793967694, "input_usage": {"receiver_prompt_tokens": 1954}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210040320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13491909696, "mlx_cache_bytes": 7081022512, "process_rss_bytes": 1210040320}, "peak_prefill_memory": null, "peak_decode_memory": 13491909696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "087f7afa2199334cb5d4037f", "attempt_id": "f0029d4f0c74", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:31.755648Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.65004110336304, "ttft_ms": 13.383666053414345, "decode_ms": 132.95041699893773}, "total_wall_ms": 219.68204202130437, "ttft_ms": 13.383666053414345, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1210318848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 8440435760, "process_rss_bytes": 1210318848}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2af876e498f72559ba02b8b6", "attempt_id": "45fdaa95d836", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:31.991709Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.06933307275176, "ttft_ms": 13.288417016156018, "decode_ms": 13.254458899609745}, "total_wall_ms": 97.58454200346023, "ttft_ms": 13.288417016156018, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210318848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 8786072624, "process_rss_bytes": 1210318848}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a84eac30610567f312d0285", "attempt_id": "33200438f450", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:32.105471Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 590, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.56583401188254, "ttft_ms": 13.368499930948019, "decode_ms": 13.268542010337114}, "total_wall_ms": 97.19025006052107, "ttft_ms": 13.368499930948019, "input_usage": {"receiver_prompt_tokens": 590, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210335232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989719640, "mlx_cache_bytes": 9028686896, "process_rss_bytes": 1210335232}, "peak_prefill_memory": null, "peak_decode_memory": 12989719640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a01be45644dfc8e99b8fb59a", "attempt_id": "44d447dc2bc0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:32.221325Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.79324999358505, "ttft_ms": 13.33441596943885, "decode_ms": 93.44675007741898}, "total_wall_ms": 178.571708034724, "ttft_ms": 13.33441596943885, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1210351616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997551192, "mlx_cache_bytes": 9398211632, "process_rss_bytes": 1210351616}, "peak_prefill_memory": null, "peak_decode_memory": 12997551192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8c7a15a1688c201016f9c125", "attempt_id": "8a48b82c6f24", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:32.415699Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.14770805835724, "ttft_ms": 13.414375018328428, "decode_ms": 80.36220807116479}, "total_wall_ms": 164.9033329449594, "ttft_ms": 13.414375018328428, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1210351616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 9398211632, "process_rss_bytes": 1210351616}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "679a540dc4739f0ace623448b8fd925fb234f554838d7e87da223228ee81b112"} | ||||
| 436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d28fe46d104ed2fd397067b", "attempt_id": "c7bbf05ba70d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:32.596307Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.63466701563448, "ttft_ms": 13.100084033794701, "decode_ms": 79.81108303647488}, "total_wall_ms": 163.52516692131758, "ttft_ms": 13.100084033794701, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1210351616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997551192, "mlx_cache_bytes": 9398211632, "process_rss_bytes": 1210351616}, "peak_prefill_memory": null, "peak_decode_memory": 12997551192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "428db668b03e7add8cd9aaec", "attempt_id": "1f2a0f3018ac", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:32.775314Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.92983305826783, "ttft_ms": 13.184458948671818, "decode_ms": 93.87691703159362}, "total_wall_ms": 178.00824996083975, "ttft_ms": 13.184458948671818, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1210368000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009888344, "mlx_cache_bytes": 9668006960, "process_rss_bytes": 1210368000}, "peak_prefill_memory": null, "peak_decode_memory": 13009888344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3297765", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "d56cdec245c790fa80a4acdc44fdc0b8a91bc5a691dccbf67225abece41f9c38"} | ||||
| 438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28c54a29529e0ad0ac71f8f2", "attempt_id": "5bcfd7e88524", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:32.969543Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.51950001530349, "ttft_ms": 13.494499959051609, "decode_ms": 66.75287510734051}, "total_wall_ms": 150.7704589748755, "ttft_ms": 13.494499959051609, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1210368000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994733144, "mlx_cache_bytes": 9914258480, "process_rss_bytes": 1210368000}, "peak_prefill_memory": null, "peak_decode_memory": 12994733144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "2575eaf3b748efc209b676518766751eb038c88f74578951345818bfe7f7194b"} | ||||
| 439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "be53f376dba6151ea132dcbd", "attempt_id": "57e8d89d20a8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:33.135679Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.17612492199987, "ttft_ms": 13.236083090305328, "decode_ms": 13.248624978587031}, "total_wall_ms": 97.62449993286282, "ttft_ms": 13.236083090305328, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210368000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 10162082864, "process_rss_bytes": 1210368000}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dff3135a498a282c3afb3d1d", "attempt_id": "599ea86371f7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:33.249342Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1200, "cache_tensor_bytes": null, "serialized_payload_bytes": 1200, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7169.974874937907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.14604099094868, "ttft_ms": 13.418667018413544, "decode_ms": 13.11112497933209}, "total_wall_ms": 97.60520898271352, "ttft_ms": 13.418667018413544, "input_usage": {"receiver_prompt_tokens": 604, "sender_input_tokens": 1982, "sender_output_tokens": 512, "sender_prefill_ms": 244.30012505035847, "sender_ttft_ms": 13.970791012980044, "sender_decode_ms": 6909.018916892819}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210368000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008282712, "mlx_cache_bytes": 10410497072, "process_rss_bytes": 1210368000}, "peak_prefill_memory": null, "peak_decode_memory": 13008282712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d2a2bad9425191f4568f7eb115d63c953e27080a86953f62a982ad73340e770", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35e1e38360327ff0ba1de995", "attempt_id": "81660e6be393", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:40.502822Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 453, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.56370795238763, "ttft_ms": 13.506625080481172, "decode_ms": 13.765582931227982}, "total_wall_ms": 84.17758299037814, "ttft_ms": 13.506625080481172, "input_usage": {"receiver_prompt_tokens": 453, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12976118656, "mlx_cache_bytes": 11606891328, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12976118656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "23d9e8db2f3350cc463b5fe6", "attempt_id": "6b18c8fd3477", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:40.604023Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 445, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.77529200632125, "ttft_ms": 13.593457988463342, "decode_ms": 13.206583098508418}, "total_wall_ms": 81.43654104787856, "ttft_ms": 13.593457988463342, "input_usage": {"receiver_prompt_tokens": 445, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12969991040, "mlx_cache_bytes": 11954346816, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12969991040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7efd679bd299ce19a0fb722", "attempt_id": "04c39aa81248", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:40.701984Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 442, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.83079207967967, "ttft_ms": 13.514957972802222, "decode_ms": 13.347667059861124}, "total_wall_ms": 81.60612499341369, "ttft_ms": 13.514957972802222, "input_usage": {"receiver_prompt_tokens": 442, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12968418176, "mlx_cache_bytes": 12196567872, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12968418176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c5d5ec602c6cd64d5d4f140f", "attempt_id": "ce8418da7f62", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:40.799459Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 460, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.998334031552076, "ttft_ms": 13.457958004437387, "decode_ms": 93.06699992157519}, "total_wall_ms": 162.45237493421882, "ttft_ms": 13.457958004437387, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901620612, "mlx_cache_bytes": 12478030444, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12901620612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f552feae88076587e85ee544", "attempt_id": "a7b3066689ef", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:40.977614Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 453, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.65279198344797, "ttft_ms": 13.25095898937434, "decode_ms": 79.89366597030312}, "total_wall_ms": 149.63387500029057, "ttft_ms": 13.25095898937434, "input_usage": {"receiver_prompt_tokens": 453, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12976118656, "mlx_cache_bytes": 12478030444, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12976118656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911925", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "679a540dc4739f0ace623448b8fd925fb234f554838d7e87da223228ee81b112"} | ||||
| 446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "63351393aa5d702c4782be28", "attempt_id": "69adbe3e988d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.142678Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 460, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.73054095637053, "ttft_ms": 13.848292059265077, "decode_ms": 13.267792062833905}, "total_wall_ms": 82.66058308072388, "ttft_ms": 13.848292059265077, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901620612, "mlx_cache_bytes": 12478030444, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12901620612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "312f41225db582774bc70da8", "attempt_id": "2e08c6877c75", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.240704Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 454, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.72091701813042, "ttft_ms": 13.354666996747255, "decode_ms": 13.847499969415367}, "total_wall_ms": 82.80079101677984, "ttft_ms": 13.354666996747255, "input_usage": {"receiver_prompt_tokens": 454, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12927523860, "mlx_cache_bytes": 12705112684, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12927523860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aab78f0d3580bc4e6a383261", "attempt_id": "c559ad464b35", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.339474Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 451, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.546834017150104, "ttft_ms": 13.775457977317274, "decode_ms": 65.89445902500302}, "total_wall_ms": 136.04474999010563, "ttft_ms": 13.775457977317274, "input_usage": {"receiver_prompt_tokens": 451, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12974939008, "mlx_cache_bytes": 12952183404, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12974939008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17430", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "2575eaf3b748efc209b676518766751eb038c88f74578951345818bfe7f7194b"} | ||||
| 449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "acce5e8801fcb7e3d5dc6038", "attempt_id": "358988c39b23", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.491137Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 455, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.820041987113655, "ttft_ms": 13.162042014300823, "decode_ms": 13.271500007249415}, "total_wall_ms": 82.09837495815009, "ttft_ms": 13.162042014300823, "input_usage": {"receiver_prompt_tokens": 455, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12927867972, "mlx_cache_bytes": 13159277164, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12927867972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "96197b2a3a42383ed14aa994", "attempt_id": "d5b2650fd107", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.589510Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 456, "message_tokens": 352, "message_utf8_bytes": 830, "cache_tensor_bytes": null, "serialized_payload_bytes": 830, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7139.372959034517, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.06491695996374, "ttft_ms": 13.267125003039837, "decode_ms": 13.196208979934454}, "total_wall_ms": 82.35933294054121, "ttft_ms": 13.267125003039837, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 2010, "sender_output_tokens": 512, "sender_prefill_ms": 209.054832928814, "sender_ttft_ms": 13.871332979761064, "sender_decode_ms": 6914.806333021261}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210499072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12928293956, "mlx_cache_bytes": 13366796908, "process_rss_bytes": 1210499072}, "peak_prefill_memory": null, "peak_decode_memory": 12928293956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a613cf19d60b1dbe7d9f51bbbf98459d9f181f51f14c39d755912e891ae7fd2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "19ea40695fa64fb3a41f1edd", "attempt_id": "f604827f01c9", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.691236Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 589, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.52725001610816, "ttft_ms": 13.915957999415696, "decode_ms": 13.35020805709064}, "total_wall_ms": 97.84608299378306, "ttft_ms": 13.915957999415696, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989523032, "mlx_cache_bytes": 13453501036, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 12989523032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "18b72c02cca695748f35114f", "attempt_id": "fa7ecb9a2aa6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.804782Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 581, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.54320904333144, "ttft_ms": 13.48116691224277, "decode_ms": 13.79266707226634}, "total_wall_ms": 97.85799996461719, "ttft_ms": 13.48116691224277, "input_usage": {"receiver_prompt_tokens": 581}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983526488, "mlx_cache_bytes": 13806510700, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 12983526488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "072b05802513d7295d28bdce", "attempt_id": "cb3016384a3e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:41.918748Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 578, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.31570905726403, "ttft_ms": 14.00416693650186, "decode_ms": 13.153749983757734}, "total_wall_ms": 97.42216707672924, "ttft_ms": 14.00416693650186, "input_usage": {"receiver_prompt_tokens": 578}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982346840, "mlx_cache_bytes": 14044209772, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 12982346840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cae0c58adb47d8c9b0af18b3", "attempt_id": "3ddd0045b32e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:42.031860Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 596, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.78374999016523, "ttft_ms": 13.174750027246773, "decode_ms": 93.62837497610599}, "total_wall_ms": 177.5466250255704, "ttft_ms": 13.174750027246773, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13013066840, "mlx_cache_bytes": 14311252588, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 13013066840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "009fe999caaabe62b80a429f", "attempt_id": "5457f6710e7a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:42.225288Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 589, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.8962080059573, "ttft_ms": 13.730249949730933, "decode_ms": 79.64270899537951}, "total_wall_ms": 164.24166702199727, "ttft_ms": 13.730249949730933, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989523032, "mlx_cache_bytes": 14311252588, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 12989523032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "679a540dc4739f0ace623448b8fd925fb234f554838d7e87da223228ee81b112"} | ||||
| 456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "06e6c3b0fa7fd9995e3edda4", "attempt_id": "efef32021421", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:42.405332Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 596, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.95704199653119, "ttft_ms": 13.405165984295309, "decode_ms": 80.58458298910409}, "total_wall_ms": 164.90879107732326, "ttft_ms": 13.405165984295309, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010609240, "mlx_cache_bytes": 14311252588, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 13010609240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "48e7d1b7536a99858cbb532e", "attempt_id": "cb05e141cd68", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:42.585925Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 590, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.26720798946917, "ttft_ms": 13.371041975915432, "decode_ms": 134.05633403453976}, "total_wall_ms": 217.71395800169557, "ttft_ms": 13.371041975915432, "input_usage": {"receiver_prompt_tokens": 590}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989719640, "mlx_cache_bytes": 14311252588, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 12989719640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "35,048,529", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "21a3ca2e64a3aae5de0b8b9e7ef08f179fc365600b1b9866e7f182e23cfc2624"} | ||||
| 458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0997cece37a06e8f37b219e", "attempt_id": "fdb47010a574", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:42.819225Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 587, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.94770898018032, "ttft_ms": 13.465458061546087, "decode_ms": 13.31408298574388}, "total_wall_ms": 97.70558297168463, "ttft_ms": 13.465458061546087, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 14574264940, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "63266a4559909d70bb7f227a", "attempt_id": "1e9f0c80c889", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:42.932790Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 591, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.32041700929403, "ttft_ms": 13.225625036284328, "decode_ms": 13.240542029961944}, "total_wall_ms": 96.764791989699, "ttft_ms": 13.225625036284328, "input_usage": {"receiver_prompt_tokens": 591}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990014552, "mlx_cache_bytes": 14817174124, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 12990014552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c0398ef40d739f0c6121dcb", "attempt_id": "f026b772c0be", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:43.045545Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 503, "n_sentences": 16}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 592, "message_tokens": 503, "message_utf8_bytes": 1392, "cache_tensor_bytes": null, "serialized_payload_bytes": 1392, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3.2390409614890814, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.4088339805603, "ttft_ms": 13.365959050133824, "decode_ms": 13.341583078727126}, "total_wall_ms": 97.11020905524492, "ttft_ms": 13.365959050133824, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1210515456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 14817174124, "process_rss_bytes": 1210515456}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b61d9a78fb26a560e5a9c0a55d69a93595e07a59c5d68725b607a17c5a2bd9ac", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "95bd202933de5c7450709f0a", "attempt_id": "1674751096f6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:43.427003Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.4900419628247619, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.826457999646664, "ttft_ms": 20.826457999646664, "decode_ms": 134.29504202213138}, "total_wall_ms": 158.01737504079938, "ttft_ms": 20.826457999646664, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12756145400, "mlx_cache_bytes": 15516234429, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12756145400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "TD-38J-5426", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "f3a7ba6b9bfe12c0b7441efae97f5c72e3714f3153a9be2e9b0d276b6b84b018"} | ||||
| 462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d04f7dbb38ed9e1ee5740f4c", "attempt_id": "dd7b82c650ef", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:43.601339Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 38, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.332875108346343, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.764625070616603, "ttft_ms": 18.764625070616603, "decode_ms": 13.33975000306964}, "total_wall_ms": 34.82637496199459, "ttft_ms": 18.764625070616603, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12749280504, "mlx_cache_bytes": 15553442493, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12749280504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "07005aad482d276d81af6eea", "attempt_id": "3cab4669ec6b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:43.651919Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.4720000326633453, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.20825005415827, "ttft_ms": 18.20825005415827, "decode_ms": 13.357167015783489}, "total_wall_ms": 34.39666598569602, "ttft_ms": 18.20825005415827, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711023624, "mlx_peak_bytes": 12748363000, "mlx_cache_bytes": 15580852925, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12748363000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7c41132c56f519ecf1b8ef01", "attempt_id": "bc7bf181a3c9", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:43.702492Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 53, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.504290965385735, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.613916006870568, "ttft_ms": 18.613916006870568, "decode_ms": 120.17275008838624}, "total_wall_ms": 141.7500419775024, "ttft_ms": 18.613916006870568, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 53}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12762486036, "mlx_cache_bytes": 15611016293, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12762486036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "124600000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "5cd32e6dd533b6503852b422d1cb6605bf7db9415d0ffdc283ccfae89d16cd0c"} | ||||
| 465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eb706a9a216571a1b54999bd", "attempt_id": "7b348846835e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:43.859713Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.4366660034283996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.19099998101592, "ttft_ms": 18.19099998101592, "decode_ms": 119.42229198757559}, "total_wall_ms": 140.48983401153237, "ttft_ms": 18.19099998101592, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 46}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12756145400, "mlx_cache_bytes": 15611016293, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12756145400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "120000000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "ab2ba9e49541ba79f254a055bec53ae0bddc9ad6a3a38bcc524e7046cede6bdf"} | ||||
| 466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a216d937337e6c2b1240a547", "attempt_id": "e39b65e0a420", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.016086Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 53, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.508957939222455, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.465333036147058, "ttft_ms": 18.465333036147058, "decode_ms": 80.01049992162734}, "total_wall_ms": 101.45112499594688, "ttft_ms": 18.465333036147058, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 53}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12762486036, "mlx_cache_bytes": 15611016293, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12762486036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "135f60f671b4dfc95f5d80cc", "attempt_id": "6aed9657bec2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.133527Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 47, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.4484160346910357, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.389582983218133, "ttft_ms": 18.389582983218133, "decode_ms": 106.21908295433968}, "total_wall_ms": 127.46754090767354, "ttft_ms": 18.389582983218133, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12756866324, "mlx_cache_bytes": 15637886053, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12756866324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11485475", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "1ff14b73e3b26dc8a98343ebda9bc8d0f501c3dc4462fe8b770aa6395d6db84a"} | ||||
| 468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f64176b3340f757d7f027b8", "attempt_id": "282c8585f8ab", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.277689Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 44, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.3965420657768846, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.244875012896955, "ttft_ms": 18.244875012896955, "decode_ms": 66.6473750025034}, "total_wall_ms": 87.72474993020296, "ttft_ms": 18.244875012896955, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12755080440, "mlx_cache_bytes": 15657171957, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12755080440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.46", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "6c95485c59a99bd91f507618a031c7ab722d541c22962a91c13f65f21c26de81"} | ||||
| 469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49eb1f72d70d0dca1af5cee4", "attempt_id": "e247d08e2ae6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.381053Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 48, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.4001670060679317, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.25520908460021, "ttft_ms": 18.25520908460021, "decode_ms": 13.021541992202401}, "total_wall_ms": 34.102374920621514, "ttft_ms": 18.25520908460021, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12757439764, "mlx_cache_bytes": 15690939381, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12757439764, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5853f17ebc5256d79fa4ec5", "attempt_id": "56dece3075c0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.431233Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691362824}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1905, "keep": 476, "compress_ms": 10.94604202080518}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 49, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563173, "side_information_bytes": 15909, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 268.5864589875564, "doc_prefill_ms": 214.82875000219792, "compress_ms": 10.990915936417878, "serialize_ms": 39.50254095252603, "load_ms": 1.4251250540837646, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.771457951515913, "ttft_ms": 18.771457951515913, "decode_ms": 13.229875010438263}, "total_wall_ms": 34.79295899160206, "ttft_ms": 18.771457951515913, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1246674944, "backend_memory": {"mlx_active_bytes": 12711416840, "mlx_peak_bytes": 12761765140, "mlx_cache_bytes": 15728278517, "process_rss_bytes": 1246674944}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12761765140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2c3ce03cd14d33918caedba306c910277ca3abbc3aee9acb880677404489d769", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "067816988614bde8fc81da8f", "attempt_id": "3e8980a2fda8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.482129Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 46, "compress_ms": 46.563791926018894}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563214, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.73091602511704, "doc_prefill_ms": 214.82875000219792, "compress_ms": 47.888125060126185, "serialize_ms": 8.63383396063, "load_ms": 1.509333960711956, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.35908298380673, "ttft_ms": 18.35908298380673, "decode_ms": 66.6263340972364}, "total_wall_ms": 144.68670799396932, "ttft_ms": 18.35908298380673, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1253916672, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12755588344, "mlx_cache_bytes": 15882516485, "process_rss_bytes": 1253916672}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12755588344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-523", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d79360c84082c242c149ea2337cf6d1cf528c92ae322313e9e5b801d7fdd8ad", "output_hash": "5e450f0fb8771d01936fa0ba22dac6f6ed425c6d1a9dc50334b8e5227cb816e3"} | ||||
| 472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd5e7f52969953f3caae415a", "attempt_id": "a32924e2ffcd", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.642542Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 38, "compress_ms": 42.1127500012517}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 38, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563212, "side_information_bytes": 15948, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.323582926765084, "doc_prefill_ms": 214.82875000219792, "compress_ms": 43.44350006431341, "serialize_ms": 3.672374994494021, "load_ms": 0.46725000720471144, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.94170797802508, "ttft_ms": 17.94170797802508, "decode_ms": 13.161082984879613}, "total_wall_ms": 80.38675005082041, "ttft_ms": 17.94170797802508, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1253949440, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12748723448, "mlx_cache_bytes": 15900424197, "process_rss_bytes": 1253949440}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12748723448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "643019d493df231fd29b9925892b9e8447721d859e231db73d4efd1448fea80b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "13e0623ad8f2a502818b98dc", "attempt_id": "abd7222939e8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.739118Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 35, "compress_ms": 40.807000012136996}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563214, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.47558296751231, "doc_prefill_ms": 214.82875000219792, "compress_ms": 42.12945804465562, "serialize_ms": 6.141666905023158, "load_ms": 0.9390409104526043, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.4952499801293, "ttft_ms": 17.4952499801293, "decode_ms": 13.155292021110654}, "total_wall_ms": 81.48441591765732, "ttft_ms": 17.4952499801293, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1253949440, "backend_memory": {"mlx_active_bytes": 12709745672, "mlx_peak_bytes": 12747576568, "mlx_cache_bytes": 15905585157, "process_rss_bytes": 1253949440}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12747576568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d79360c84082c242c149ea2337cf6d1cf528c92ae322313e9e5b801d7fdd8ad", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "39cc88f6321078da519b219b", "attempt_id": "e0c9b6650bf7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:44.836678Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 53, "compress_ms": 41.68504092376679}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 53, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563213, "side_information_bytes": 15949, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.02062497381121, "doc_prefill_ms": 214.82875000219792, "compress_ms": 43.0110830347985, "serialize_ms": 3.809457994066179, "load_ms": 1.1132078943774104, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.316500005312264, "ttft_ms": 18.316500005312264, "decode_ms": 92.8357500815764}, "total_wall_ms": 160.7997079845518, "ttft_ms": 18.316500005312264, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 53}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1253949440, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12761928980, "mlx_cache_bytes": 15914596357, "process_rss_bytes": 1253949440}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12761928980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "91428.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "de01306daf2ef2463b26fb5b78ffc7f9d192dc8025fa4074f1108bebf5ad6ffd", "output_hash": "5c1ac6fa7c084b5728c26d5d46b2e5a8a58650c0368dddb3c30bdfb4fb328214"} | ||||
| 475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "88bb62fa28b2bca437f62407", "attempt_id": "539a03984598", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:45.013895Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 46, "compress_ms": 40.71541700977832}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563213, "side_information_bytes": 15949, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 50.603457959368825, "doc_prefill_ms": 214.82875000219792, "compress_ms": 41.97858297266066, "serialize_ms": 8.422959013842046, "load_ms": 1.2479579309001565, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.976666917093098, "ttft_ms": 17.976666917093098, "decode_ms": 79.72791697829962}, "total_wall_ms": 151.0364169953391, "ttft_ms": 17.976666917093098, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1253949440, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12755588344, "mlx_cache_bytes": 15914596357, "process_rss_bytes": 1253949440}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12755588344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911421", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "de01306daf2ef2463b26fb5b78ffc7f9d192dc8025fa4074f1108bebf5ad6ffd", "output_hash": "d78afcb9c3a13c5c2c417c517f5a38252427bfb883024dee12dd21383b774c43"} | ||||
| 476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aecf8fa3daae42af5643a34c", "attempt_id": "44583ce6277b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:45.183965Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 53, "compress_ms": 41.14291595760733}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 53, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563213, "side_information_bytes": 15949, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.40637501142919, "doc_prefill_ms": 214.82875000219792, "compress_ms": 42.493208893574774, "serialize_ms": 3.6970420042052865, "load_ms": 0.49220805522054434, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.013292087242007, "ttft_ms": 20.013292087242007, "decode_ms": 79.49154207017273}, "total_wall_ms": 147.93962496332824, "ttft_ms": 20.013292087242007, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 53}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1254047744, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12761928980, "mlx_cache_bytes": 15914596357, "process_rss_bytes": 1254047744}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12761928980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "de01306daf2ef2463b26fb5b78ffc7f9d192dc8025fa4074f1108bebf5ad6ffd", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8c43c6defc4285f057894521", "attempt_id": "72e78cd79487", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:45.348608Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 47, "compress_ms": 41.70420905575156}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 47, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563213, "side_information_bytes": 15949, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.96912504732609, "doc_prefill_ms": 214.82875000219792, "compress_ms": 43.02225005812943, "serialize_ms": 3.744291956536472, "load_ms": 0.5565829342231154, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.384457915090024, "ttft_ms": 18.384457915090024, "decode_ms": 133.90354090370238}, "total_wall_ms": 201.29537489265203, "ttft_ms": 18.384457915090024, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1254064128, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12756309268, "mlx_cache_bytes": 15920330757, "process_rss_bytes": 1254064128}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12756309268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "43,476,444", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "de01306daf2ef2463b26fb5b78ffc7f9d192dc8025fa4074f1108bebf5ad6ffd", "output_hash": "eda1749a7db9ec2fd5ce7bef982eb3c8a14fac13e2c3f0492932c5ece71fc459"} | ||||
| 478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3e7c607ec2c47e99f0a0c301", "attempt_id": "3e68c6313d09", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:45.566154Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 44, "compress_ms": 41.6523750172928}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 44, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563212, "side_information_bytes": 15948, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.1787090646103, "doc_prefill_ms": 214.82875000219792, "compress_ms": 43.01766597200185, "serialize_ms": 3.9524169405922294, "load_ms": 1.1627919739112258, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.953250091522932, "ttft_ms": 17.953250091522932, "decode_ms": 79.90474998950958}, "total_wall_ms": 147.67654100432992, "ttft_ms": 17.953250091522932, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 44}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1254080512, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12754277624, "mlx_cache_bytes": 15944316933, "process_rss_bytes": 1254080512}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12754277624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17430 kW", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "643019d493df231fd29b9925892b9e8447721d859e231db73d4efd1448fea80b", "output_hash": "abf3e49db3d562e18b8eebd00e7c36c83838696b016621158970f90a181f0090"} | ||||
| 479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "79cf46061582101a874345b3", "attempt_id": "7c7b251e9a2c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:45.730190Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 48, "compress_ms": 41.9932910008356}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 48, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563212, "side_information_bytes": 15948, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.50350001268089, "doc_prefill_ms": 214.82875000219792, "compress_ms": 43.352541979402304, "serialize_ms": 3.937915898859501, "load_ms": 0.9977919980883598, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.43016699422151, "ttft_ms": 18.43016699422151, "decode_ms": 13.175582978874445}, "total_wall_ms": 81.63695794064552, "ttft_ms": 18.43016699422151, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1254129664, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12756882708, "mlx_cache_bytes": 15950182405, "process_rss_bytes": 1254129664}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12756882708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "643019d493df231fd29b9925892b9e8447721d859e231db73d4efd1448fea80b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6a9961383694363b85fc2197", "attempt_id": "7adb28388624", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:45.828135Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1905, "keep": 476, "window_tokens": 49, "compress_ms": 41.516541969031096}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 49, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 17547264, "serialized_payload_bytes": 17563214, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 49.80254208203405, "doc_prefill_ms": 214.82875000219792, "compress_ms": 42.83495794516057, "serialize_ms": 6.758416071534157, "load_ms": 1.2677919585257769, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.829999957233667, "ttft_ms": 18.829999957233667, "decode_ms": 13.223541900515556}, "total_wall_ms": 84.63054208550602, "ttft_ms": 18.829999957233667, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1254146048, "backend_memory": {"mlx_active_bytes": 12710630408, "mlx_peak_bytes": 12758291732, "mlx_cache_bytes": 15969777669, "process_rss_bytes": 1254146048}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12758291732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6d79360c84082c242c149ea2337cf6d1cf528c92ae322313e9e5b801d7fdd8ad", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb348cb8a4a5d9cdff4ea664", "attempt_id": "f58c997a9b93", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.066530Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 3.434375044889748, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.893333945423365, "ttft_ms": 20.893333945423365, "decode_ms": 147.42266607936472}, "total_wall_ms": 173.39504091069102, "ttft_ms": 20.893333945423365, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1330036736, "backend_memory": {"mlx_active_bytes": 12749375752, "mlx_peak_bytes": 12820066084, "mlx_cache_bytes": 16098783613, "process_rss_bytes": 1330036736}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12820066084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "59abac9f6dac3b89ef695596", "attempt_id": "38a4535b2a55", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.257893Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 38, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 1.9901669584214687, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.39225003682077, "ttft_ms": 20.39225003682077, "decode_ms": 14.847874990664423}, "total_wall_ms": 38.62904210109264, "ttft_ms": 20.39225003682077, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1330167808, "backend_memory": {"mlx_active_bytes": 12749430056, "mlx_peak_bytes": 12809269604, "mlx_cache_bytes": 16098729309, "process_rss_bytes": 1330167808}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12809269604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "54ca3a4d96bd2a8e4d0bc31b", "attempt_id": "d090e3feacd6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.312435Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 35, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 2.103875041939318, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.189000060781837, "ttft_ms": 20.189000060781837, "decode_ms": 14.445291017182171}, "total_wall_ms": 38.128833984956145, "ttft_ms": 20.189000060781837, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1330167808, "backend_memory": {"mlx_active_bytes": 12749430056, "mlx_peak_bytes": 12808384868, "mlx_cache_bytes": 16118340957, "process_rss_bytes": 1330167808}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12808384868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2863fae1cb884d64d676937e", "attempt_id": "a43b036749d1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.367116Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 53, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 1.189708011224866, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.887000020593405, "ttft_ms": 20.887000020593405, "decode_ms": 86.96650003548712}, "total_wall_ms": 110.46137497760355, "ttft_ms": 20.887000020593405, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 53}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1330610176, "backend_memory": {"mlx_active_bytes": 12749444744, "mlx_peak_bytes": 12829668400, "mlx_cache_bytes": 16155051597, "process_rss_bytes": 1330610176}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12829668400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "679a540dc4739f0ace623448b8fd925fb234f554838d7e87da223228ee81b112"} | ||||
| 485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dbe9bb91509e3e9f58ee1738", "attempt_id": "326e8045aef4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.493797Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 46, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 1.7587080365046859, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.025125053711236, "ttft_ms": 21.025125053711236, "decode_ms": 87.13058289140463}, "total_wall_ms": 111.35466699488461, "ttft_ms": 21.025125053711236, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 46}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1330659328, "backend_memory": {"mlx_active_bytes": 12749436680, "mlx_peak_bytes": 12819917620, "mlx_cache_bytes": 16155059661, "process_rss_bytes": 1330659328}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12819917620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "679a540dc4739f0ace623448b8fd925fb234f554838d7e87da223228ee81b112"} | ||||
| 486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "07a74fbbebd33e0a16d6b7f5", "attempt_id": "4d21716817ed", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.621542Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 53, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 2.0363329676911235, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.971833961084485, "ttft_ms": 20.971833961084485, "decode_ms": 86.95391693618149}, "total_wall_ms": 111.38612497597933, "ttft_ms": 20.971833961084485, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 53}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1330659328, "backend_memory": {"mlx_active_bytes": 12749444744, "mlx_peak_bytes": 12829668752, "mlx_cache_bytes": 16155051597, "process_rss_bytes": 1330659328}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12829668752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d3fd2c090f6b91d33653cd29", "attempt_id": "337335a21955", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.749561Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 47, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 2.033083001151681, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.55524999741465, "ttft_ms": 20.55524999741465, "decode_ms": 145.57062496896833}, "total_wall_ms": 169.55824999604374, "ttft_ms": 20.55524999741465, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1330675712, "backend_memory": {"mlx_active_bytes": 12749360520, "mlx_peak_bytes": 12821142160, "mlx_cache_bytes": 16181677901, "process_rss_bytes": 1330675712}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12821142160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "34,324,114", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "bcf04bded10e2a1ebafb384781a93cf331425244500f9511cc8b87c9a1211cae"} | ||||
| 488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea2062f8abbe549979d193be", "attempt_id": "8d770dae840e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:46.935712Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 44, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 2.019000006839633, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.38770809303969, "ttft_ms": 20.38770809303969, "decode_ms": 72.8116660611704}, "total_wall_ms": 96.63170808926225, "ttft_ms": 20.38770809303969, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1330675712, "backend_memory": {"mlx_active_bytes": 12749318536, "mlx_peak_bytes": 12817541940, "mlx_cache_bytes": 16206492493, "process_rss_bytes": 1330675712}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12817541940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "2575eaf3b748efc209b676518766751eb038c88f74578951345818bfe7f7194b"} | ||||
| 489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d28d8d577730278da9a19c43", "attempt_id": "d0e0ad923830", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:47.048925Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 48, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 1.909750048071146, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.689290948212147, "ttft_ms": 20.689290948212147, "decode_ms": 14.434417011216283}, "total_wall_ms": 38.42954197898507, "ttft_ms": 20.689290948212147, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1330692096, "backend_memory": {"mlx_active_bytes": 12749433224, "mlx_peak_bytes": 12822175504, "mlx_cache_bytes": 16233509709, "process_rss_bytes": 1330692096}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12822175504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe06c6e93cfdc633d1691038", "attempt_id": "01f7308cf1ce", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:47.103246Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12710465672}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1866, "source_tokens_receiver": 1866, "query_tokens": 49, "message_tokens": 1905, "message_utf8_bytes": 7342, "cache_tensor_bytes": 37307520, "serialized_payload_bytes": 37341702, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 137.4225829495117, "doc_prefill_ms": 214.82875000219792, "compress_ms": 9.560583042912185, "serialize_ms": 127.51383404247463, "load_ms": 2.0946250297129154, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.635041990317404, "ttft_ms": 20.635041990317404, "decode_ms": 14.54645802732557}, "total_wall_ms": 38.66295807529241, "ttft_ms": 20.635041990317404, "input_usage": {"receiver_prefix_tokens": 1905, "dense_cache_bytes": 70225920, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1330692096, "backend_memory": {"mlx_active_bytes": 12749434376, "mlx_peak_bytes": 12824159120, "mlx_cache_bytes": 16261230285, "process_rss_bytes": 1330692096}, "peak_prefill_memory": 13432271544, "peak_decode_memory": 12824159120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4dfc3b91fab3c041bcae1d5c34775b35134e4b04a73949fb7b5b71be7ab3cc7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b03a8bf5e8c33029f542a44c", "attempt_id": "04b008ec3d10", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:47.239529Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1827, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 206.26991603057832, "ttft_ms": 14.3332090228796, "decode_ms": 98.22604199871421}, "total_wall_ms": 324.53645800706, "ttft_ms": 14.3332090228796, "input_usage": {"receiver_prompt_tokens": 1827}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 653524992, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13284061372, "mlx_cache_bytes": 812026464, "process_rss_bytes": 653524992}, "peak_prefill_memory": null, "peak_decode_memory": 13284061372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "526fab8926936c3c9d02cbe5", "attempt_id": "7c4987b0740e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:47.594832Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1820, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 196.31150003988296, "ttft_ms": 14.162458013743162, "decode_ms": 27.66912500374019}, "total_wall_ms": 240.64045795239508, "ttft_ms": 14.162458013743162, "input_usage": {"receiver_prompt_tokens": 1820}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 653541376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13282652348, "mlx_cache_bytes": 1237027424, "process_rss_bytes": 653541376}, "peak_prefill_memory": null, "peak_decode_memory": 13282652348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1cb01d125711ed2903c5178c", "attempt_id": "954ae48046b2", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:47.851537Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1818, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.38741710130125, "ttft_ms": 13.920291909016669, "decode_ms": 27.62075001373887}, "total_wall_ms": 239.36545790638775, "ttft_ms": 13.920291909016669, "input_usage": {"receiver_prompt_tokens": 1818}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 653541376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13315944636, "mlx_cache_bytes": 1471515232, "process_rss_bytes": 653541376}, "peak_prefill_memory": null, "peak_decode_memory": 13315944636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eaf2e79cfc490c018900256f", "attempt_id": "dcafabc94f3c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:48.107529Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1836, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.51270906999707, "ttft_ms": 13.898333068937063, "decode_ms": 42.51266608480364}, "total_wall_ms": 256.45604194141924, "ttft_ms": 13.898333068937063, "input_usage": {"receiver_prompt_tokens": 1836}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 653541376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13286535392, "mlx_cache_bytes": 1934173964, "process_rss_bytes": 653541376}, "peak_prefill_memory": null, "peak_decode_memory": 13286535392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f8822a25428fadac0d254cf7", "attempt_id": "f76759e31718", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:48.379474Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1829, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 196.71699998434633, "ttft_ms": 14.346000039950013, "decode_ms": 41.53083392884582}, "total_wall_ms": 255.16412500292063, "ttft_ms": 14.346000039950013, "input_usage": {"receiver_prompt_tokens": 1829}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 653557760, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13284618464, "mlx_cache_bytes": 2361141004, "process_rss_bytes": 653557760}, "peak_prefill_memory": null, "peak_decode_memory": 13284618464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "20a963d88178f6050e8d139a", "attempt_id": "c2bedd5e72e7", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:48.651906Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1836, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.04741705209017, "ttft_ms": 14.200166915543377, "decode_ms": 70.09233394637704}, "total_wall_ms": 283.9046249864623, "ttft_ms": 14.200166915543377, "input_usage": {"receiver_prompt_tokens": 1836}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 653606912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13286535392, "mlx_cache_bytes": 2361141004, "process_rss_bytes": 653606912}, "peak_prefill_memory": null, "peak_decode_memory": 13286535392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Brigam-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "cbeedb5efb33fd78c3c90ee9a3fd8829f55bdc158719dbd6bd04a8179d5b3aef"} | ||||
| 497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4873e3b3e7ea62385103f713", "attempt_id": "3052c69c2128", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:48.952305Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1830, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 196.47308404091746, "ttft_ms": 13.928959029726684, "decode_ms": 69.66695899609476}, "total_wall_ms": 282.58483298122883, "ttft_ms": 13.928959029726684, "input_usage": {"receiver_prompt_tokens": 1830}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 653606912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13284716768, "mlx_cache_bytes": 2540939020, "process_rss_bytes": 653606912}, "peak_prefill_memory": null, "peak_decode_memory": 13284716768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,911,900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "1123bee8fa8c77177320277d0d2af1a531e8417ac13db155eca932a493f23b9d"} | ||||
| 498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d72088e9285bcef632583681", "attempt_id": "0dfffbdea7fd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:49.250287Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1827, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.79508304782212, "ttft_ms": 13.887500041164458, "decode_ms": 41.641458054073155}, "total_wall_ms": 255.8641660725698, "ttft_ms": 13.887500041164458, "input_usage": {"receiver_prompt_tokens": 1827}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 653606912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13284061372, "mlx_cache_bytes": 2540939020, "process_rss_bytes": 653606912}, "peak_prefill_memory": null, "peak_decode_memory": 13284061372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17.43", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "1cd677e6c296f31fca744a7c4d96b5514fa6b036913240b8d689f1e277900d17"} | ||||
| 499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e90cd0b1b7318ef1d545559", "attempt_id": "7a83946fefbc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:49.521868Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1831, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.61633302550763, "ttft_ms": 13.987249927595258, "decode_ms": 13.913291040807962}, "total_wall_ms": 228.069041040726, "ttft_ms": 13.987249927595258, "input_usage": {"receiver_prompt_tokens": 1831}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 653623296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13285175520, "mlx_cache_bytes": 2968463116, "process_rss_bytes": 653623296}, "peak_prefill_memory": null, "peak_decode_memory": 13285175520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "95b5561bfbda423f08202223", "attempt_id": "a5fd48e51e5f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:49.765875Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 1832, "message_tokens": 1722, "message_utf8_bytes": 7342, "cache_tensor_bytes": null, "serialized_payload_bytes": 7342, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 196.29600003827363, "ttft_ms": 14.145415974780917, "decode_ms": 13.90204206109047}, "total_wall_ms": 226.8477090401575, "ttft_ms": 14.145415974780917, "input_usage": {"receiver_prompt_tokens": 1832}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 653623296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13285273824, "mlx_cache_bytes": 3148457740, "process_rss_bytes": 653623296}, "peak_prefill_memory": null, "peak_decode_memory": 13285273824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "619eabb259e7c561eae0fe0c", "attempt_id": "8c4503f371bd", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:57.402245Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.58204196579754, "ttft_ms": 13.624083017930388, "decode_ms": 96.00599994882941}, "total_wall_ms": 189.36366599518806, "ttft_ms": 13.624083017930388, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 654704640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 4638545340, "process_rss_bytes": 654704640}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0f2d20782d1975aab9a41853", "attempt_id": "adc3d2d54bea", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:57.608191Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.10204098839313, "ttft_ms": 13.811459066346288, "decode_ms": 13.685250072740018}, "total_wall_ms": 105.61320802662522, "ttft_ms": 13.811459066346288, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 654704640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046783500, "mlx_cache_bytes": 4959655356, "process_rss_bytes": 654704640}, "peak_prefill_memory": null, "peak_decode_memory": 13046783500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4f740b4b3843173a6c8acee1", "attempt_id": "023f6deace39", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:57.729483Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.72429201193154, "ttft_ms": 13.591457973234355, "decode_ms": 13.805874972604215}, "total_wall_ms": 105.15054094139487, "ttft_ms": 13.591457973234355, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 654704640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13068754444, "mlx_cache_bytes": 5102589372, "process_rss_bytes": 654704640}, "peak_prefill_memory": null, "peak_decode_memory": 13068754444, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "45e4b7493d72ed45f0ce0563", "attempt_id": "7f7795c9b9b6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:57.849806Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.55841698963195, "ttft_ms": 13.803916983306408, "decode_ms": 40.72970792185515}, "total_wall_ms": 133.17008409649134, "ttft_ms": 13.803916983306408, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 654704640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 5478653844, "process_rss_bytes": 654704640}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0efbc8ae545f25c2474d6749", "attempt_id": "ad4e07e82d67", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:57.998905Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.07308407407254, "ttft_ms": 13.598458026535809, "decode_ms": 40.986333042383194}, "total_wall_ms": 132.6816250802949, "ttft_ms": 13.598458026535809, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 654721024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801648, "mlx_cache_bytes": 5827338132, "process_rss_bytes": 654721024}, "peak_prefill_memory": null, "peak_decode_memory": 13043801648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2fda4fe52a43007713d92cf5", "attempt_id": "5cbfd7627d8e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:58.147555Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.19587499741465, "ttft_ms": 13.689124956727028, "decode_ms": 82.02383306343108}, "total_wall_ms": 173.96779207047075, "ttft_ms": 13.689124956727028, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 654737408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 5827338132, "process_rss_bytes": 654737408}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6acacc8548bb1bb9ffa3fc01", "attempt_id": "1467845b131e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:58.337149Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.82612491771579, "ttft_ms": 13.529333984479308, "decode_ms": 68.80041700787842}, "total_wall_ms": 160.1814579917118, "ttft_ms": 13.529333984479308, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 654737408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981872, "mlx_cache_bytes": 5950021524, "process_rss_bytes": 654737408}, "peak_prefill_memory": null, "peak_decode_memory": 13043981872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,911,475", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "45c50a7e117d14dfcfecb84b7133e001ac8d7ec9dd9b9f08edfdc6df74093763"} | ||||
| 508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e3f0237de47ca017f15fbcc5", "attempt_id": "9fa05c1feca8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:58.512974Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.84441597666591, "ttft_ms": 13.797333929687738, "decode_ms": 41.141833062283695}, "total_wall_ms": 132.8327920055017, "ttft_ms": 13.797333929687738, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 654753792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 5950021524, "process_rss_bytes": 654753792}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17.43", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "1cd677e6c296f31fca744a7c4d96b5514fa6b036913240b8d689f1e277900d17"} | ||||
| 509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a59e9be77c11edfa4d41a00b", "attempt_id": "6a350f50b9d2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:58.661252Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.71495799534023, "ttft_ms": 13.839124934747815, "decode_ms": 13.845124980434775}, "total_wall_ms": 106.44329199567437, "ttft_ms": 13.839124934747815, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 654753792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13045358128, "mlx_cache_bytes": 6300000148, "process_rss_bytes": 654753792}, "peak_prefill_memory": null, "peak_decode_memory": 13045358128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "74641d6140241c701603f569", "attempt_id": "256d76f111d8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:47:58.782820Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1552, "cache_tensor_bytes": null, "serialized_payload_bytes": 1552, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.9102499280125, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.29020901024342, "ttft_ms": 13.952083070762455, "decode_ms": 13.774167047813535}, "total_wall_ms": 106.07945907395333, "ttft_ms": 13.952083070762455, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 1856, "sender_output_tokens": 512, "sender_prefill_ms": 197.10674998350441, "sender_ttft_ms": 14.360708999447525, "sender_decode_ms": 7179.171208059415}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 654753792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13045538352, "mlx_cache_bytes": 6423076756, "process_rss_bytes": 654753792}, "peak_prefill_memory": null, "peak_decode_memory": 13045538352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c54ef25abcbe54dbe8cfe02c2e0c22cc8de307dc61d2e44cd1276caaf5a16f8f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0fa8ac02e05c03c9c98bb9aa", "attempt_id": "25c2dab82c03", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:06.312400Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 420, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.12379196099937, "ttft_ms": 13.630707981064916, "decode_ms": 13.529249932616949}, "total_wall_ms": 89.17720802128315, "ttft_ms": 13.630707981064916, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12897754200, "mlx_cache_bytes": 7113833736, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12897754200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "79d23d8ef239abca7bfc88cf", "attempt_id": "a1eef9841fd2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:06.418308Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 413, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.35987494233996, "ttft_ms": 13.467541080899537, "decode_ms": 28.251459007151425}, "total_wall_ms": 94.90879205986857, "ttft_ms": 13.467541080899537, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12893592664, "mlx_cache_bytes": 7344536840, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12893592664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "009f6fdb39ca0da03d714d90", "attempt_id": "b0f016dc2226", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:06.529123Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 411, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.36570804845542, "ttft_ms": 13.496582978405058, "decode_ms": 13.667042017914355}, "total_wall_ms": 80.33400005660951, "ttft_ms": 13.496582978405058, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913384536, "mlx_cache_bytes": 7450377480, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12913384536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0336c2d5e9fa2cf74274de36", "attempt_id": "a7eae0e3a181", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:06.625225Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 429, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.25974999181926, "ttft_ms": 13.626875006593764, "decode_ms": 40.354875032790005}, "total_wall_ms": 110.08387501351535, "ttft_ms": 13.626875006593764, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902571096, "mlx_cache_bytes": 7705951496, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12902571096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc24fcecbb9d57b3447c2c9e", "attempt_id": "6f6f7c2f3f64", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:06.751098Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 422, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.695416987873614, "ttft_ms": 13.410417013801634, "decode_ms": 41.069666971452534}, "total_wall_ms": 111.00341589190066, "ttft_ms": 13.410417013801634, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12898311256, "mlx_cache_bytes": 7830207752, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12898311256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e0b6f0a5af150f7436da21ba", "attempt_id": "941582fece4e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:06.878294Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 429, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.1026250468567, "ttft_ms": 13.524790992960334, "decode_ms": 81.15270896814764}, "total_wall_ms": 150.58737504296005, "ttft_ms": 13.524790992960334, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902571096, "mlx_cache_bytes": 7830207752, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12902571096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b72e9231afcfa670247d2bbe", "attempt_id": "b3ba3bc9cbce", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.044642Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 423, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.75241695623845, "ttft_ms": 13.413540902547538, "decode_ms": 67.36391596496105}, "total_wall_ms": 137.34354195185006, "ttft_ms": 13.413540902547538, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899195992, "mlx_cache_bytes": 8025193736, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12899195992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,724,765", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "0217331771fe881d05d783044e07ac96e580d95e5ce38c58cb07bfd06efb0a27"} | ||||
| 518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f24ead294f520a7890ef40ba", "attempt_id": "f69eec7fef64", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.198380Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 420, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.637417011894286, "ttft_ms": 13.68454098701477, "decode_ms": 40.80270801205188}, "total_wall_ms": 110.90770794544369, "ttft_ms": 13.68454098701477, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 655048704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12897754200, "mlx_cache_bytes": 8025193736, "process_rss_bytes": 655048704}, "peak_prefill_memory": null, "peak_decode_memory": 12897754200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17.43", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "1cd677e6c296f31fca744a7c4d96b5514fa6b036913240b8d689f1e277900d17"} | ||||
| 519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "66a5bb79f66b2cde93125dcc", "attempt_id": "7fe805777605", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.327949Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 424, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.005084024742246, "ttft_ms": 13.558833976276219, "decode_ms": 13.491207966580987}, "total_wall_ms": 82.86979200784117, "ttft_ms": 13.558833976276219, "input_usage": {"receiver_prompt_tokens": 424, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655065088, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899572824, "mlx_cache_bytes": 8150039816, "process_rss_bytes": 655065088}, "peak_prefill_memory": null, "peak_decode_memory": 12899572824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9535f2bfe20287e5ca52fb6c", "attempt_id": "10a8f18b6e72", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.426766Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 425, "message_tokens": 299, "message_utf8_bytes": 828, "cache_tensor_bytes": null, "serialized_payload_bytes": 828, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7408.413916011341, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.190457962453365, "ttft_ms": 13.563917018473148, "decode_ms": 13.645000057294965}, "total_wall_ms": 83.19258398842067, "ttft_ms": 13.563917018473148, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 1886, "sender_output_tokens": 512, "sender_prefill_ms": 200.62770904041827, "sender_ttft_ms": 14.156375080347061, "sender_decode_ms": 7192.0138749992475}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655065088, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899753048, "mlx_cache_bytes": 8233401608, "process_rss_bytes": 655065088}, "peak_prefill_memory": null, "peak_decode_memory": 12899753048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d97f12b64a4a0b8bcd25e180cef251d67a8404a933e35cac47b8de6a5d152258", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d41817c9c68c97b70e7248fd", "attempt_id": "55b2f4d72cc4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.527561Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 603, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.63895797263831, "ttft_ms": 14.254333102144301, "decode_ms": 13.984458055347204}, "total_wall_ms": 104.64870894793421, "ttft_ms": 14.254333102144301, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628300, "mlx_cache_bytes": 8592571656, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13031628300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "baa7d4bceaa4be57e67edd12", "attempt_id": "76a5b888beca", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.647771Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 596, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.16470900736749, "ttft_ms": 13.695291941985488, "decode_ms": 26.885250001214445}, "total_wall_ms": 116.78766610566527, "ttft_ms": 13.695291941985488, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13028367884, "mlx_cache_bytes": 8925953288, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13028367884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bcc9ec5af28e60afb8406ea5", "attempt_id": "2a2a45919641", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.780428Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.29204101208597, "ttft_ms": 13.709125109016895, "decode_ms": 27.078542043454945}, "total_wall_ms": 116.09591695014387, "ttft_ms": 13.709125109016895, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13057203724, "mlx_cache_bytes": 9079078152, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13057203724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c823c1329b233954ff3ed02e", "attempt_id": "669018b6f60f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:07.912493Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 612, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.34520798455924, "ttft_ms": 13.576459023170173, "decode_ms": 40.91533401515335}, "total_wall_ms": 131.873624981381, "ttft_ms": 13.576459023170173, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13072539148, "mlx_cache_bytes": 9079078152, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13072539148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "305f88bdd94d389743472da2", "attempt_id": "27fbbff6d728", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:08.060279Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 605, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.10766701307148, "ttft_ms": 13.61466699745506, "decode_ms": 40.926040965132415}, "total_wall_ms": 130.66241599153727, "ttft_ms": 13.61466699745506, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032889868, "mlx_cache_bytes": 9417129224, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13032889868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6e4b16f708f0f3ff5e0b5fb2", "attempt_id": "ef42db52fda1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:08.206967Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 612, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.53408299665898, "ttft_ms": 13.467499986290932, "decode_ms": 81.72020805068314}, "total_wall_ms": 172.71787498611957, "ttft_ms": 13.467499986290932, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13072539148, "mlx_cache_bytes": 9417129224, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13072539148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Gamtiszen-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "32e3af428886434823d82102e1c482765eafdf6077fe8d3fba5752ec5e29826c"} | ||||
| 527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "405ff7c859e7a5e59c740708", "attempt_id": "3c2f2d295cd2", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:08.395535Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 606, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.59491700865328, "ttft_ms": 13.505832990631461, "decode_ms": 67.58304091636091}, "total_wall_ms": 156.78983309771866, "ttft_ms": 13.505832990631461, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033266700, "mlx_cache_bytes": 9595649288, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13033266700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,924,780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "9e05b3e6c678128563b406c274b43d6982716a2f736f5999d31dfcebe1e19ebc"} | ||||
| 528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2078cfea2890d5bdeae2a188", "attempt_id": "708477c45990", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:08.568371Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 603, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.5376250706613, "ttft_ms": 13.630792032927275, "decode_ms": 14.281000010669231}, "total_wall_ms": 103.46325009595603, "ttft_ms": 13.630792032927275, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628300, "mlx_cache_bytes": 9595649288, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13031628300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "22601d226a776c5227c9ebcf", "attempt_id": "3de6b423653a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:08.688051Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 607, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.65041696559638, "ttft_ms": 13.7080829590559, "decode_ms": 13.691833009943366}, "total_wall_ms": 103.05904096458107, "ttft_ms": 13.7080829590559, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041753612, "mlx_cache_bytes": 9853009160, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13041753612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f9d38516d168de5b39645b31", "attempt_id": "d5e62cd867c4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:08.806292Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 608, "message_tokens": 497, "message_utf8_bytes": 1674, "cache_tensor_bytes": null, "serialized_payload_bytes": 1674, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6007499070838094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.57404106389731, "ttft_ms": 13.551541953347623, "decode_ms": 13.679167022928596}, "total_wall_ms": 102.83133306074888, "ttft_ms": 13.551541953347623, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 655179776, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13045882380, "mlx_cache_bytes": 10032119048, "process_rss_bytes": 655179776}, "peak_prefill_memory": null, "peak_decode_memory": 13045882380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ab2687226b311bc64a817e3681d90024f1d1773d8c8248e32d94793306d42d5a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "02a13073bdbcd1bb6be300cd", "attempt_id": "70f76add920c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.129999Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 45, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 0.6614170270040631, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.428125000558794, "ttft_ms": 19.428125000558794, "decode_ms": 287.773041985929}, "total_wall_ms": 309.5329999923706, "ttft_ms": 19.428125000558794, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 45}, "output_usage": {"output_tokens": 21}, "provider_cached_usage": null, "process_memory": 704053248, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12958389484, "mlx_cache_bytes": 10394353265, "process_rss_bytes": 704053248}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12958389484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "There is no mention of a project with a site of Lot 713-X in Témiscaming.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "4d0634a1ef1565845f130bf959a31e149070dc966e20feea8036410988eae780"} | ||||
| 532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7f1204540f73df6e367f45c", "attempt_id": "be232ac13110", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.455357Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 38, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 1.7146249301731586, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.969417036511004, "ttft_ms": 17.969417036511004, "decode_ms": 13.698291033506393}, "total_wall_ms": 34.7077080514282, "ttft_ms": 17.969417036511004, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 704053248, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12953277676, "mlx_cache_bytes": 10416946801, "process_rss_bytes": 704053248}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12953277676, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35fe67b737e4bf01d0ad8d28", "attempt_id": "ed459143581e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.505844Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 36, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 0.6417080294340849, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.55195891018957, "ttft_ms": 17.55195891018957, "decode_ms": 13.800874934531748}, "total_wall_ms": 33.30212493892759, "ttft_ms": 17.55195891018957, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 704053248, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12954555628, "mlx_cache_bytes": 10437426801, "process_rss_bytes": 704053248}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12954555628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f2edeb551fabcc40fd6b4c87", "attempt_id": "5f50a4fe6c54", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.555201Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 54, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 1.3303749728947878, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.16495892126113, "ttft_ms": 18.16495892126113, "decode_ms": 41.481415973976254}, "total_wall_ms": 62.2900000307709, "ttft_ms": 18.16495892126113, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 54}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 704053248, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12967843088, "mlx_cache_bytes": 10469067653, "process_rss_bytes": 704053248}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12967843088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "469147b9096ca76595ba03d6e8e849959829de7be9f36bbb9e437b35a34af4c5"} | ||||
| 535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a72f9ef7af4318b4beeb7598", "attempt_id": "558ee8cb5666", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.633375Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 47, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 1.5554999699816108, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.891500028781593, "ttft_ms": 17.891500028781593, "decode_ms": 96.10974998213351}, "total_wall_ms": 116.92241695709527, "ttft_ms": 17.891500028781593, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 704069632, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12960093456, "mlx_cache_bytes": 10506652549, "process_rss_bytes": 704069632}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12960093456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "I can't help with that.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "4434ac69dedd5ddb108e3c6cb8a51b9c28dc6d294b4c10ac695d25e3d33668ea"} | ||||
| 536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b7b723bb7f9011c0de1c894a", "attempt_id": "53cfc8f3e6cc", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.765989Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 54, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 1.1680000461637974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.66550005413592, "ttft_ms": 17.66550005413592, "decode_ms": 68.72316694352776}, "total_wall_ms": 88.88870803639293, "ttft_ms": 17.66550005413592, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 704069632, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12967843088, "mlx_cache_bytes": 10506652549, "process_rss_bytes": 704069632}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12967843088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Brigam-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "cbeedb5efb33fd78c3c90ee9a3fd8829f55bdc158719dbd6bd04a8179d5b3aef"} | ||||
| 537 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd1d65496454dbb317d5a4c7", "attempt_id": "3346f2ef607f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.871014Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 48, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 1.6195419011637568, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.815915984101593, "ttft_ms": 17.815915984101593, "decode_ms": 68.77437501680106}, "total_wall_ms": 89.5981250796467, "ttft_ms": 17.815915984101593, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 704069632, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12960584976, "mlx_cache_bytes": 10529983365, "process_rss_bytes": 704069632}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12960584976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,495,475", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "89d0fd7566ab8ff6be75f03cd4c099850fb0b4ec596800c22c5bd152e1b03c53"} | ||||
| 538 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "491bc08d1b8906b76e97598c", "attempt_id": "237f08b18002", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:09.976350Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 45, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 1.5985829522833228, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.644208972342312, "ttft_ms": 17.644208972342312, "decode_ms": 83.15804193262011}, "total_wall_ms": 103.74591697473079, "ttft_ms": 17.644208972342312, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 45}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 704086016, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12958389484, "mlx_cache_bytes": 10529983365, "process_rss_bytes": 704086016}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12958389484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not found in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "86e7436a01413ee73d67a2745fb3877854f17f9bc8161cb020694c1ba2143edf"} | ||||
| 539 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1f777c12c1f69504a54ddf63", "attempt_id": "0bf0f18e36b6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.096541Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 49, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 0.6358339451253414, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.94275001157075, "ttft_ms": 17.94275001157075, "decode_ms": 27.45175000745803}, "total_wall_ms": 47.390832914970815, "ttft_ms": 17.94275001157075, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 49}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 704086016, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12962108688, "mlx_cache_bytes": 10569370501, "process_rss_bytes": 704086016}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12962108688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 540 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e0b93b33a89a8dadc12fa074", "attempt_id": "d3d31ba38da0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.159825Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1782, "keep": 446, "compress_ms": 7.060833042487502}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 50, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163730, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 205.30624990351498, "doc_prefill_ms": 185.03087502904236, "compress_ms": 7.1009580278769135, "serialize_ms": 10.695208911783993, "load_ms": 1.2937920400872827, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.819333006627858, "ttft_ms": 17.819333006627858, "decode_ms": 13.80091707687825}, "total_wall_ms": 34.38037494197488, "ttft_ms": 17.819333006627858, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 704102400, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12962583824, "mlx_cache_bytes": 10593667973, "process_rss_bytes": 704102400}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12962583824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "440d3fceb5818aa9a777b707673b96d9688a512fa73b2f4138527b056fbc3d1c", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 541 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52cb850072f8a2f9bb2de920", "attempt_id": "544dedd92bf1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.216725Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 45, "compress_ms": 51.503999973647296}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 45, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163771, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.74462505057454, "doc_prefill_ms": 185.03087502904236, "compress_ms": 52.729457966051996, "serialize_ms": 7.836958975531161, "load_ms": 1.3577090576291084, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.626333029009402, "ttft_ms": 19.626333029009402, "decode_ms": 97.25162503309548}, "total_wall_ms": 180.41625001933426, "ttft_ms": 19.626333029009402, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 705019904, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12958389484, "mlx_cache_bytes": 10820537325, "process_rss_bytes": 705019904}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12958389484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3d3271e89cce80a1116f8293a426e50e45be763f009098b87ed29260a69d8526", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 542 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0907e24b51ea6f896c48fb4e", "attempt_id": "e47fe499189c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.413804Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 38, "compress_ms": 44.433124945499}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 38, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163768, "side_information_bytes": 12920, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.03837501257658, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.76558305416256, "serialize_ms": 10.077999904751778, "load_ms": 1.4106250600889325, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.675750031135976, "ttft_ms": 21.675750031135976, "decode_ms": 27.512667002156377}, "total_wall_ms": 108.06287499144673, "ttft_ms": 21.675750031135976, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 756432896, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12953261292, "mlx_cache_bytes": 10841410541, "process_rss_bytes": 756432896}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12953261292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9e5a8f2bebf19c4ca3b5fb4767b265d935f10c304041dfb462797ab2de68ce6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 543 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ad0f8f5b1f211404ff1e0018", "attempt_id": "91f1c91fff35", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.539475Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 36, "compress_ms": 44.11812510807067}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 36, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163770, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.47637494560331, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.35087489057332, "serialize_ms": 7.93249998241663, "load_ms": 1.5005830209702253, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.441582982428372, "ttft_ms": 17.441582982428372, "decode_ms": 27.792457956820726}, "total_wall_ms": 101.65312502067536, "ttft_ms": 17.441582982428372, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 756432896, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12954604780, "mlx_cache_bytes": 10848013293, "process_rss_bytes": 756432896}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12954604780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "61b6c963e8b4ea4e50a632e7160109b68ba927ae0f2b20d1cb51fb242a9c2745", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 544 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "190e3d041520a4b201ff120c", "attempt_id": "277e8c32b10d", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.657996Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 54, "compress_ms": 44.079374987632036}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 54, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163771, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.292749915272, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.34599999897182, "serialize_ms": 7.767625036649406, "load_ms": 1.5358750242739916, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.52237498294562, "ttft_ms": 17.52237498294562, "decode_ms": 41.54266696423292}, "total_wall_ms": 115.33933295868337, "ttft_ms": 17.52237498294562, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 54}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 756432896, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12967843088, "mlx_cache_bytes": 10864741357, "process_rss_bytes": 756432896}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12967843088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3d3271e89cce80a1116f8293a426e50e45be763f009098b87ed29260a69d8526", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 545 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4b3a1719a057131a7e7793f1", "attempt_id": "55dda38602ad", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.790903Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 47, "compress_ms": 44.350790907628834}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 47, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163771, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.84258402045816, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.650542015209794, "serialize_ms": 8.002334041520953, "load_ms": 1.4745830558240414, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.564291949383914, "ttft_ms": 17.564291949383914, "decode_ms": 41.199250030331314}, "total_wall_ms": 115.55216694250703, "ttft_ms": 17.564291949383914, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 47}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 756449280, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12960093456, "mlx_cache_bytes": 10876095469, "process_rss_bytes": 756449280}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12960093456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3d3271e89cce80a1116f8293a426e50e45be763f009098b87ed29260a69d8526", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6da68b0245203c5c6dccfbb3", "attempt_id": "f27b55790627", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:10.928057Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 54, "compress_ms": 44.77412498090416}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 54, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163770, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.905833046883345, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.999458990991116, "serialize_ms": 7.729750010184944, "load_ms": 1.5041669830679893, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.585999914444983, "ttft_ms": 17.585999914444983, "decode_ms": 69.50250000227243}, "total_wall_ms": 143.92791700083762, "ttft_ms": 17.585999914444983, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 756482048, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12967843088, "mlx_cache_bytes": 10874260461, "process_rss_bytes": 756482048}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12967843088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Brigam-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "61b6c963e8b4ea4e50a632e7160109b68ba927ae0f2b20d1cb51fb242a9c2745", "output_hash": "cbeedb5efb33fd78c3c90ee9a3fd8829f55bdc158719dbd6bd04a8179d5b3aef"} | ||||
| 547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "83e35682c62eaffec3802444", "attempt_id": "44025fbf738f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:11.088894Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 48, "compress_ms": 44.02304091490805}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 48, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163770, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.44066699035466, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.27412494644523, "serialize_ms": 7.98691704403609, "load_ms": 0.9676250629127026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.41108309943229, "ttft_ms": 17.41108309943229, "decode_ms": 70.01091598067433}, "total_wall_ms": 143.23420904111117, "ttft_ms": 17.41108309943229, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 756482048, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12960584976, "mlx_cache_bytes": 10882485229, "process_rss_bytes": 756482048}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12960584976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,434,620", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "61b6c963e8b4ea4e50a632e7160109b68ba927ae0f2b20d1cb51fb242a9c2745", "output_hash": "e370e13529e2a7409a94e020c063839ca3190c4869f4ae48645196f15e739bfc"} | ||||
| 548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1766fccb7d6b85fdb9bfd258", "attempt_id": "cad2cdecee5a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:11.248706Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 45, "compress_ms": 44.706250075250864}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 45, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163771, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.647124954499304, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.945500023663044, "serialize_ms": 8.509667008183897, "load_ms": 1.4749170513823628, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.837583044543862, "ttft_ms": 21.837583044543862, "decode_ms": 41.55337507836521}, "total_wall_ms": 120.94950000755489, "ttft_ms": 21.837583044543862, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 756514816, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12958389484, "mlx_cache_bytes": 10884320237, "process_rss_bytes": 756514816}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12958389484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17.43", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3d3271e89cce80a1116f8293a426e50e45be763f009098b87ed29260a69d8526", "output_hash": "1cd677e6c296f31fca744a7c4d96b5514fa6b036913240b8d689f1e277900d17"} | ||||
| 549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "05a9414e820ffda8d489f7ad", "attempt_id": "b15e5d85b83e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:11.386286Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 49, "compress_ms": 44.574958039447665}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 49, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163771, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.86841599829495, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.86525005288422, "serialize_ms": 7.812916999682784, "load_ms": 1.540958066470921, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.549250042065978, "ttft_ms": 17.549250042065978, "decode_ms": 13.797291088849306}, "total_wall_ms": 88.16775004379451, "ttft_ms": 17.549250042065978, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 756531200, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12962108688, "mlx_cache_bytes": 10908896237, "process_rss_bytes": 756531200}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12962108688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3d3271e89cce80a1116f8293a426e50e45be763f009098b87ed29260a69d8526", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "940251e211f1e1daac73ed9c", "attempt_id": "3fa6e3086164", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:11.491070Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1782, "keep": 446, "window_tokens": 50, "compress_ms": 44.699500082060695}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 50, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 51150848, "serialized_payload_bytes": 51163771, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.85179095901549, "doc_prefill_ms": 185.03087502904236, "compress_ms": 45.941042015329, "serialize_ms": 7.734292070381343, "load_ms": 1.441541942767799, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.243290975689888, "ttft_ms": 21.243290975689888, "decode_ms": 13.645292026922107}, "total_wall_ms": 91.65004198439419, "ttft_ms": 21.243290975689888, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 756547584, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12962583824, "mlx_cache_bytes": 10915630061, "process_rss_bytes": 756547584}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 12962583824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3d3271e89cce80a1116f8293a426e50e45be763f009098b87ed29260a69d8526", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5c83c7bf89f3e64b56ad456d", "attempt_id": "ac1e9443bfa6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:11.975459Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 45, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.998415962792933, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.81799996085465, "ttft_ms": 20.81799996085465, "decode_ms": 104.3139579705894}, "total_wall_ms": 129.4680000282824, "ttft_ms": 20.81799996085465, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13112474168, "mlx_cache_bytes": 11189019501, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13112474168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NK-95Z-2165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "bd8f809b02304c6b9dc7c1e116ecccc2328c976a5c071e89a94d661b48e73aa7"} | ||||
| 552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "15a54cc01d1e20ce35611d85", "attempt_id": "c3a5e49ec76a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.122833Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 38, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.192666055634618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.88375000655651, "ttft_ms": 19.88375000655651, "decode_ms": 29.702166095376015}, "total_wall_ms": 53.08604193851352, "ttft_ms": 19.88375000655651, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13103348612, "mlx_cache_bytes": 11213040877, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13103348612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc30740127d728639d8559e2", "attempt_id": "318e0ae487a9", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.192264Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 36, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.1095420233905315, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.923915970139205, "ttft_ms": 19.923915970139205, "decode_ms": 29.600874986499548}, "total_wall_ms": 52.90433298796415, "ttft_ms": 19.923915970139205, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13105134916, "mlx_cache_bytes": 11235060973, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13105134916, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1663be47f9341a0897670d49", "attempt_id": "dad440878c73", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.260663Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 54, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.0342919742688537, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.587250008247793, "ttft_ms": 20.587250008247793, "decode_ms": 44.50729093514383}, "total_wall_ms": 68.43674997799098, "ttft_ms": 20.587250008247793, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 54}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13111800272, "mlx_cache_bytes": 11264138285, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13111800272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "34abbdf3e258df53bb17ed13", "attempt_id": "51222defc898", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.344989Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 47, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.281875000335276, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.50462504848838, "ttft_ms": 20.50462504848838, "decode_ms": 44.363750028423965}, "total_wall_ms": 68.48270806949586, "ttft_ms": 20.50462504848838, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 47}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13115362420, "mlx_cache_bytes": 11293045677, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13115362420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "911,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "86be78720fc4b79f93e603e7d9e4861fcd25102612f73209fffc17d787056007"} | ||||
| 556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6f715215555b1f6c4ab5bba2", "attempt_id": "2c85b42100d3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.429684Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 54, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 1.1898329248651862, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.376750035211444, "ttft_ms": 20.376750035211444, "decode_ms": 74.6657089330256}, "total_wall_ms": 97.46966708917171, "ttft_ms": 20.376750035211444, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13026776072, "mlx_peak_bytes": 13111799784, "mlx_cache_bytes": 11398558637, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13111799784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Brigam-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "cbeedb5efb33fd78c3c90ee9a3fd8829f55bdc158719dbd6bd04a8179d5b3aef"} | ||||
| 557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "95d657cac679d01f2e110d22", "attempt_id": "6bf5f1c71107", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.543003Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 48, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.3078330559656024, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.318583003245294, "ttft_ms": 20.318583003245294, "decode_ms": 74.11474990658462}, "total_wall_ms": 98.0807919986546, "ttft_ms": 20.318583003245294, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13116443892, "mlx_cache_bytes": 11429071789, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13116443892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,911,900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "1123bee8fa8c77177320277d0d2af1a531e8417ac13db155eca932a493f23b9d"} | ||||
| 558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "438a09b2aa7595bbc29e90d1", "attempt_id": "c23871db85aa", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.656745Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 45, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.083042054437101, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.977208925411105, "ttft_ms": 19.977208925411105, "decode_ms": 44.6396250044927}, "total_wall_ms": 68.01054195966572, "ttft_ms": 19.977208925411105, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13112469700, "mlx_cache_bytes": 11429071789, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13112469700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17.43", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "1cd677e6c296f31fca744a7c4d96b5514fa6b036913240b8d689f1e277900d17"} | ||||
| 559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a84fb3bc21b1f351d74fcdf", "attempt_id": "d7b30ff4d7c8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.740928Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 49, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 2.156415954232216, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.358541049063206, "ttft_ms": 20.358541049063206, "decode_ms": 14.922207919880748}, "total_wall_ms": 38.73212495818734, "ttft_ms": 20.358541049063206, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13118836084, "mlx_cache_bytes": 11459650605, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13118836084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "542d2afba91ee090b79865f2", "attempt_id": "92a7f08eaf62", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.795768Z", "task_family": "synthetic", "document_id": "syn_03003_2000", "document_hash": "dddca1a38e3224870fcfae927c701c400fd885c19123ea840ee06a76a140f407", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03003_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913005576}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1722, "source_tokens_receiver": 1722, "query_tokens": 50, "message_tokens": 1782, "message_utf8_bytes": 7342, "cache_tensor_bytes": 108573696, "serialized_payload_bytes": 108600812, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 375.94645796343684, "doc_prefill_ms": 185.03087502904236, "compress_ms": 10.194625006988645, "serialize_ms": 365.42220797855407, "load_ms": 1.1939159594476223, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.30195901170373, "ttft_ms": 20.30195901170373, "decode_ms": 14.905582997016609}, "total_wall_ms": 37.758665974251926, "ttft_ms": 20.30195901170373, "input_usage": {"receiver_prefix_tokens": 1782, "dense_cache_bytes": 204374016, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 975241216, "backend_memory": {"mlx_active_bytes": 13025858568, "mlx_peak_bytes": 13119901172, "mlx_cache_bytes": 11490508077, "process_rss_bytes": 975241216}, "peak_prefill_memory": 13244772540, "peak_decode_memory": 13119901172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03003_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d4a31f2a2dad6f4a5cb468f57cb438eb79c7f18db6acd25d3e10f060ee4f165", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd74353f810ae99a442e9e54", "attempt_id": "708f02c5e787", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:12.917813Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5961, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 689.2814169405028, "ttft_ms": 14.180499943904579, "decode_ms": 137.6603749813512}, "total_wall_ms": 849.9234159244224, "ttft_ms": 14.180499943904579, "input_usage": {"receiver_prompt_tokens": 5961}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 837402624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13591565376, "mlx_cache_bytes": 2345776568, "process_rss_bytes": 837402624}, "peak_prefill_memory": null, "peak_decode_memory": 13591565376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3cc4ab06c883b3df6d513ccb", "attempt_id": "6420b03f2be4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:13.793117Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5953, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.3604169934988, "ttft_ms": 13.866874971427023, "decode_ms": 13.747624936513603}, "total_wall_ms": 711.5235000383109, "ttft_ms": 13.866874971427023, "input_usage": {"receiver_prompt_tokens": 5953}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 837435392, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13588386880, "mlx_cache_bytes": 3075585464, "process_rss_bytes": 837435392}, "peak_prefill_memory": null, "peak_decode_memory": 13588386880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "29df3186b96350179318db0a", "attempt_id": "334945af5611", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:14.526687Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5951, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 677.2437910549343, "ttft_ms": 13.896499993279576, "decode_ms": 14.045834075659513}, "total_wall_ms": 713.7573339277878, "ttft_ms": 13.896499993279576, "input_usage": {"receiver_prompt_tokens": 5951}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 837468160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13587928128, "mlx_cache_bytes": 3584472504, "process_rss_bytes": 837468160}, "peak_prefill_memory": null, "peak_decode_memory": 13587928128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "746584958a8de82277a7f1f5", "attempt_id": "ebcc7869fe70", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:15.262626Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5969, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.6765420511365, "ttft_ms": 14.180540922097862, "decode_ms": 96.09929204452783}, "total_wall_ms": 815.8456250093877, "ttft_ms": 14.180540922097862, "input_usage": {"receiver_prompt_tokens": 5969}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 837500928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13594743872, "mlx_cache_bytes": 4320638392, "process_rss_bytes": 837500928}, "peak_prefill_memory": null, "peak_decode_memory": 13594743872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4646500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "22c7e5c0df41a8fcf90ee1e6ad966a7b73b0da3ca2ded8274a61b1221ad03f00"} | ||||
| 565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e245233d6c0f029f579de567", "attempt_id": "2b7fa5cae760", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:16.100560Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5961, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 695.5593749880791, "ttft_ms": 14.182624989189208, "decode_ms": 97.81104198191315}, "total_wall_ms": 816.321040969342, "ttft_ms": 14.182624989189208, "input_usage": {"receiver_prompt_tokens": 5961}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 837533696, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13591565376, "mlx_cache_bytes": 4320638392, "process_rss_bytes": 837533696}, "peak_prefill_memory": null, "peak_decode_memory": 13591565376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1642260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "08505337332e43191f2e55bf7664c5072c21fe3054a4238b7a4ab81901c3be71"} | ||||
| 566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d47e37dce53e0add4ad1617d", "attempt_id": "2a332cdd3e77", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:16.939774Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5970, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 718.0001250235364, "ttft_ms": 14.13129095453769, "decode_ms": 69.65029204729944}, "total_wall_ms": 810.3533750399947, "ttft_ms": 14.13129095453769, "input_usage": {"receiver_prompt_tokens": 5970}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 837582848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13595481152, "mlx_cache_bytes": 5057541560, "process_rss_bytes": 837582848}, "peak_prefill_memory": null, "peak_decode_memory": 13595481152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b675267329100633e97de628", "attempt_id": "b2b0d65af1a0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:17.774587Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5962, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 743.3446670183912, "ttft_ms": 14.06437496189028, "decode_ms": 427.78266698587686}, "total_wall_ms": 1193.849749979563, "ttft_ms": 14.06437496189028, "input_usage": {"receiver_prompt_tokens": 5962}, "output_usage": {"output_tokens": 31}, "provider_cached_usage": null, "process_memory": 837615616, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13631132736, "mlx_cache_bytes": 5664142776, "process_rss_bytes": 837615616}, "peak_prefill_memory": null, "peak_decode_memory": 13631132736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1449850+4896700+3060221=8866771", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "339e4dcfeaddc407f861157d4cce3f6eb27e0fa6494433d3a22351afb8595106"} | ||||
| 568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf4f25f33015ff6038fe55b4", "attempt_id": "69d7b8a0e0c4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:18.990462Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5960, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 718.9322089543566, "ttft_ms": 14.32966603897512, "decode_ms": 69.63529204949737}, "total_wall_ms": 811.690374976024, "ttft_ms": 14.32966603897512, "input_usage": {"receiver_prompt_tokens": 5960}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 837648384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13591565376, "mlx_cache_bytes": 5664142776, "process_rss_bytes": 837648384}, "peak_prefill_memory": null, "peak_decode_memory": 13591565376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21510", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "99baee832a9b728bf88c3cd01afd6db133f37389faf2ffb420813dcf83f7adc9"} | ||||
| 569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6a7df31a2b0d9be46f56695d", "attempt_id": "f1e5e083514e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:19.824589Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5962, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 757.4222080875188, "ttft_ms": 14.200333040207624, "decode_ms": 13.800624990835786}, "total_wall_ms": 793.9494999591261, "ttft_ms": 14.200333040207624, "input_usage": {"receiver_prompt_tokens": 5962}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 837681152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13638800448, "mlx_cache_bytes": 5664142776, "process_rss_bytes": 837681152}, "peak_prefill_memory": null, "peak_decode_memory": 13638800448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a4b495696b461b32551b1363", "attempt_id": "2251dfd6fbac", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:20.640144Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 5964, "message_tokens": 5876, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016625039279460907, "decode_payload_ms": 0.0, "receiver_prefill_ms": 762.0043330825865, "ttft_ms": 14.029666897840798, "decode_ms": 14.028165955096483}, "total_wall_ms": 798.9121669670567, "ttft_ms": 14.029666897840798, "input_usage": {"receiver_prompt_tokens": 5964}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 837713920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13639259200, "mlx_cache_bytes": 6217676216, "process_rss_bytes": 837713920}, "peak_prefill_memory": null, "peak_decode_memory": 13639259200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cedeb43ba1eea6841f07ee2", "attempt_id": "676edbf9fd86", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.180179Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 447, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.235707968473434, "ttft_ms": 13.448916957713664, "decode_ms": 13.26708309352398}, "total_wall_ms": 83.24437506962568, "ttft_ms": 13.448916957713664, "input_usage": {"receiver_prompt_tokens": 447, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971432808, "mlx_cache_bytes": 7498747056, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12971432808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2be2caf45b14318ef171a3c4", "attempt_id": "6107c2f6038c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.286444Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 439, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.67400008253753, "ttft_ms": 13.147832942195237, "decode_ms": 13.274375000037253}, "total_wall_ms": 81.11008396372199, "ttft_ms": 13.147832942195237, "input_usage": {"receiver_prompt_tokens": 439, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12965305192, "mlx_cache_bytes": 7841991856, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12965305192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8fbc4f0400cf1a35e6c37b25", "attempt_id": "4234cfc3b7b4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.389456Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 437, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.53954201564193, "ttft_ms": 13.351415982469916, "decode_ms": 13.392125023528934}, "total_wall_ms": 81.34462498128414, "ttft_ms": 13.351415982469916, "input_usage": {"receiver_prompt_tokens": 437, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12964125544, "mlx_cache_bytes": 8081329328, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12964125544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8ce7f8a45edc752522858f91", "attempt_id": "dd844ff6ef7e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.492920Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 455, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.30741694383323, "ttft_ms": 13.31166597083211, "decode_ms": 13.047165935859084}, "total_wall_ms": 82.74433307815343, "ttft_ms": 13.31166597083211, "input_usage": {"receiver_prompt_tokens": 455, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978314120, "mlx_cache_bytes": 8458261448, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12978314120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "15b21ea59e621312f60fbef0", "attempt_id": "5ab9568e7c92", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.598606Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 447, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.6960840690881, "ttft_ms": 13.349499902687967, "decode_ms": 13.05825007148087}, "total_wall_ms": 81.1155840056017, "ttft_ms": 13.349499902687967, "input_usage": {"receiver_prompt_tokens": 447, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971432808, "mlx_cache_bytes": 8458261448, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12971432808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6f98a32359ead60ff6f2ac07", "attempt_id": "2920195b1b26", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.701612Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 456, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.16283307224512, "ttft_ms": 13.346459018066525, "decode_ms": 92.18220796901733}, "total_wall_ms": 161.77150001749396, "ttft_ms": 13.346459018066525, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978854796, "mlx_cache_bytes": 8708217572, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12978854796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obysellith-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "66b39064cfe9c103d8574722e2dac0e9a19ced28c716ed2067d84dd8796e7762"} | ||||
| 577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0eb375093e88f703aef2e7c4", "attempt_id": "6c9c82e219f1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.886202Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 448, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.83404204621911, "ttft_ms": 13.094790978357196, "decode_ms": 13.738624984398484}, "total_wall_ms": 81.70762506779283, "ttft_ms": 13.094790978357196, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971957128, "mlx_cache_bytes": 8953715428, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12971957128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "19bc3d02ac682c20e3a9e8ad", "attempt_id": "66f2cc78211d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:27.990147Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 446, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.66774997673929, "ttft_ms": 13.216666993685067, "decode_ms": 13.177999993786216}, "total_wall_ms": 81.065041013062, "ttft_ms": 13.216666993685067, "input_usage": {"receiver_prompt_tokens": 446, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12970908520, "mlx_cache_bytes": 9110477540, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12970908520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "941c8888da70b78fb76b7e3b", "attempt_id": "f45870b66eed", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:28.093510Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 448, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.82079107221216, "ttft_ms": 13.32679099868983, "decode_ms": 13.369041960686445}, "total_wall_ms": 81.53266704175621, "ttft_ms": 13.32679099868983, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971957128, "mlx_cache_bytes": 9110477540, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12971957128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4f1a2756f6eb482c169c4940", "attempt_id": "046c09600fd8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:28.197062Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 450, "message_tokens": 358, "message_utf8_bytes": 1813, "cache_tensor_bytes": null, "serialized_payload_bytes": 1813, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5718.184833996929, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.78879192378372, "ttft_ms": 13.236833969131112, "decode_ms": 13.46358295995742}, "total_wall_ms": 82.50308292917907, "ttft_ms": 13.236833969131112, "input_usage": {"receiver_prompt_tokens": 450, "sender_input_tokens": 5992, "sender_output_tokens": 358, "sender_prefill_ms": 783.8098329957575, "sender_ttft_ms": 14.421542058698833, "sender_decode_ms": 4912.73233294487}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838057984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12917332848, "mlx_cache_bytes": 9295485668, "process_rss_bytes": 838057984}, "peak_prefill_memory": null, "peak_decode_memory": 12917332848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21051c79078ffa1261b12f9528aa381a81e4ecabac605abefefb2ae56bbad320", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f79be5e1077f2e5566be66cb", "attempt_id": "3744a682cb47", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.039081Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 436, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.44733304809779, "ttft_ms": 13.112583081237972, "decode_ms": 13.01375008188188}, "total_wall_ms": 80.44979197438806, "ttft_ms": 13.112583081237972, "input_usage": {"receiver_prompt_tokens": 436, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838107136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909501264, "mlx_cache_bytes": 10309278436, "process_rss_bytes": 838107136}, "peak_prefill_memory": null, "peak_decode_memory": 12909501264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ba30186093e756916d0ba712", "attempt_id": "0272ebc3ee4a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.142361Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 428, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.867582930251956, "ttft_ms": 13.218582957051694, "decode_ms": 13.102749944664538}, "total_wall_ms": 81.02070807944983, "ttft_ms": 13.218582957051694, "input_usage": {"receiver_prompt_tokens": 428, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838107136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12956310376, "mlx_cache_bytes": 10657848036, "process_rss_bytes": 838107136}, "peak_prefill_memory": null, "peak_decode_memory": 12956310376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b45e265210588c20bfa4dce6", "attempt_id": "7d196883bf95", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.245505Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 426, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.60929202288389, "ttft_ms": 13.323749997653067, "decode_ms": 13.437208021059632}, "total_wall_ms": 81.22154197189957, "ttft_ms": 13.323749997653067, "input_usage": {"receiver_prompt_tokens": 426, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838107136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12955392872, "mlx_cache_bytes": 10891418340, "process_rss_bytes": 838107136}, "peak_prefill_memory": null, "peak_decode_memory": 12955392872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ad038d3ba40636bece4ec858", "attempt_id": "c2f9f23943c8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.350113Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 444, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.65166696719825, "ttft_ms": 13.622791040688753, "decode_ms": 13.349374989047647}, "total_wall_ms": 81.45929197780788, "ttft_ms": 13.622791040688753, "input_usage": {"receiver_prompt_tokens": 444, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838107136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12912515920, "mlx_cache_bytes": 11073968868, "process_rss_bytes": 838107136}, "peak_prefill_memory": null, "peak_decode_memory": 12912515920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d6caee20c33cbc07c0ba46a5", "attempt_id": "038d2a80878b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.453828Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 436, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.507291013374925, "ttft_ms": 13.169375015422702, "decode_ms": 13.191916979849339}, "total_wall_ms": 80.73633292224258, "ttft_ms": 13.169375015422702, "input_usage": {"receiver_prompt_tokens": 436, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838107136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909501264, "mlx_cache_bytes": 11073968868, "process_rss_bytes": 838107136}, "peak_prefill_memory": null, "peak_decode_memory": 12909501264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b2c033e157260f0d9b540665", "attempt_id": "cd79c065bded", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.557120Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 445, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.58362500555813, "ttft_ms": 13.343541999347508, "decode_ms": 13.369499938562512}, "total_wall_ms": 81.18912507779896, "ttft_ms": 13.343541999347508, "input_usage": {"receiver_prompt_tokens": 445, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838123520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12970515304, "mlx_cache_bytes": 11161262820, "process_rss_bytes": 838123520}, "peak_prefill_memory": null, "peak_decode_memory": 12970515304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f04bd1390b189148d87ca80", "attempt_id": "a7ac8e9cc1d0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.660470Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 437, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.48162504378706, "ttft_ms": 13.586833025328815, "decode_ms": 92.38145803101361}, "total_wall_ms": 160.31433292664587, "ttft_ms": 13.586833025328815, "input_usage": {"receiver_prompt_tokens": 437, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 838123520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12964125544, "mlx_cache_bytes": 11161262820, "process_rss_bytes": 838123520}, "peak_prefill_memory": null, "peak_decode_memory": 12964125544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9660295", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "91988b1215586dd6899ef1d2a4168b0a54c0112d95ddff92bc07d79f5ac5ee86"} | ||||
| 588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c165d64009d7663f2ec52631", "attempt_id": "f51843078748", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.843074Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 435, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.65566594991833, "ttft_ms": 13.310583075508475, "decode_ms": 53.46962495241314}, "total_wall_ms": 121.3242500089109, "ttft_ms": 13.310583075508475, "input_usage": {"receiver_prompt_tokens": 435, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 838123520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12908813136, "mlx_cache_bytes": 11340077796, "process_rss_bytes": 838123520}, "peak_prefill_memory": null, "peak_decode_memory": 12908813136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "31.1", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "6d9048ff14e6a4dacca73fc885b29e419b0163e079bf28b358dbcd393e45b187"} | ||||
| 589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a81df945ad8d9c1f8ed2f98", "attempt_id": "df20520d40e0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:36.986813Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 437, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.146167007274926, "ttft_ms": 13.340125093236566, "decode_ms": 13.279541046358645}, "total_wall_ms": 81.666958052665, "ttft_ms": 13.340125093236566, "input_usage": {"receiver_prompt_tokens": 437, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838123520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12964125544, "mlx_cache_bytes": 11340077796, "process_rss_bytes": 838123520}, "peak_prefill_memory": null, "peak_decode_memory": 12964125544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "08a631051adcec27b97e2e85", "attempt_id": "39cf9b5aa3ba", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:37.090810Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 439, "message_tokens": 335, "message_utf8_bytes": 831, "cache_tensor_bytes": null, "serialized_payload_bytes": 831, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7737.649125047028, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.41950000729412, "ttft_ms": 13.477166998200119, "decode_ms": 13.504583039321005}, "total_wall_ms": 81.2057500006631, "ttft_ms": 13.477166998200119, "input_usage": {"receiver_prompt_tokens": 439, "sender_input_tokens": 6020, "sender_output_tokens": 512, "sender_prefill_ms": 693.8189590582624, "sender_ttft_ms": 13.969041989184916, "sender_decode_ms": 7020.216833916493}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838123520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12965305192, "mlx_cache_bytes": 11340077796, "process_rss_bytes": 838123520}, "peak_prefill_memory": null, "peak_decode_memory": 12965305192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "05915668ccbb8f6fd2ac322b53a751b73175c99ba92c714196541000624d8103", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e14d50785046dde348d572e7", "attempt_id": "b8beee93da44", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:37.198461Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.42991707567126, "ttft_ms": 13.258000020869076, "decode_ms": 13.439874979667366}, "total_wall_ms": 98.09008403681219, "ttft_ms": 13.258000020869076, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994438232, "mlx_cache_bytes": 11737291492, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12994438232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6f308ec7668273c1ccf9118d", "attempt_id": "2deaa3ef7ed6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:37.318668Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 590, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.81437501963228, "ttft_ms": 13.377583003602922, "decode_ms": 13.177750050090253}, "total_wall_ms": 97.33391599729657, "ttft_ms": 13.377583003602922, "input_usage": {"receiver_prompt_tokens": 590}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989719640, "mlx_cache_bytes": 12081748708, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12989719640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4a69b2fbcb813428756a87ce", "attempt_id": "0db43d1597e1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:37.438125Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 588, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.65266598854214, "ttft_ms": 13.13237496651709, "decode_ms": 13.167458004318178}, "total_wall_ms": 96.89620800781995, "ttft_ms": 13.13237496651709, "input_usage": {"receiver_prompt_tokens": 588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008086104, "mlx_cache_bytes": 12345154276, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 13008086104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd833318a5fefb4fc544c094", "attempt_id": "78cfa1fb80f2", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:37.556956Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.47229201998562, "ttft_ms": 13.479790999554098, "decode_ms": 93.2840829482302}, "total_wall_ms": 178.2307910034433, "ttft_ms": 13.479790999554098, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996666456, "mlx_cache_bytes": 12713794276, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12996666456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4646500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "22c7e5c0df41a8fcf90ee1e6ad966a7b73b0da3ca2ded8274a61b1221ad03f00"} | ||||
| 595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6cd6f28ed919b1d3c0c6e4c5", "attempt_id": "9a9284d1db74", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:37.756737Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.7605840396136, "ttft_ms": 13.21070792619139, "decode_ms": 120.60504197143018}, "total_wall_ms": 204.59199999459088, "ttft_ms": 13.21070792619139, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994438232, "mlx_cache_bytes": 12713794276, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12994438232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,642,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "2bc4cbca0c91d790508324ed0e180fbe979a27c5991cdf8d1df4a0d6c6478128"} | ||||
| 596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9991b1fb8ebe1fcb8ab30569", "attempt_id": "77467f0a96ff", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:37.983351Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.25545800570399, "ttft_ms": 13.359250035136938, "decode_ms": 67.06191704142839}, "total_wall_ms": 151.71166695654392, "ttft_ms": 13.359250035136938, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997157976, "mlx_cache_bytes": 12963388132, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12997157976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4900ae1bf347a8fdbcfeb647", "attempt_id": "56ddf850f337", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:38.157487Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.81895805802196, "ttft_ms": 13.63562501501292, "decode_ms": 93.79912505391985}, "total_wall_ms": 178.24195907451212, "ttft_ms": 13.63562501501292, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994733144, "mlx_cache_bytes": 13209639652, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12994733144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1449850", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "339fae4d977c61a8a560c65b899a7f35284ccd6aa94a03d77367952dbf00d354"} | ||||
| 598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9643c56606e5dffe83c1f467", "attempt_id": "fd3aa1a20722", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:38.357895Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.44075005594641, "ttft_ms": 13.42591701541096, "decode_ms": 13.288291986100376}, "total_wall_ms": 97.13604103308171, "ttft_ms": 13.42591701541096, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993848408, "mlx_cache_bytes": 13455006436, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12993848408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "544cb229b62a74ae8919d339", "attempt_id": "9ddf9de15849", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:38.478325Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.92508296389133, "ttft_ms": 13.587291934527457, "decode_ms": 13.645209022797644}, "total_wall_ms": 98.14279095735401, "ttft_ms": 13.587291934527457, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994733144, "mlx_cache_bytes": 13455006436, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12994733144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ec8654b3e31532c327d4d3e7", "attempt_id": "eb50cb26f987", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:38.598270Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1243, "cache_tensor_bytes": null, "serialized_payload_bytes": 1243, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.5077919494360685, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.383167010732, "ttft_ms": 13.328125001862645, "decode_ms": 14.219457982107997}, "total_wall_ms": 98.9454590016976, "ttft_ms": 13.328125001862645, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 838156288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 13702142692, "process_rss_bytes": 838156288}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "22704f300a44289cc0d7a057e438c72ddc6a0393eaec100135063adb6fb2a309", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 601 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "619d897a369817ae93631340", "attempt_id": "582cbe01ab24", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:39.505420Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.7734579741954803, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.291957918554544, "ttft_ms": 28.291957918554544, "decode_ms": 151.64433291647583}, "total_wall_ms": 185.82416593562812, "ttft_ms": 28.291957918554544, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 46}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12987962616, "mlx_cache_bytes": 14305680469, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12987962616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YB-32U-7534", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "e3a2de907022ed8d4ed287203b3a3be7802fc02cc3eb10ad5252617584b172bf"} | ||||
| 602 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4b49debf2cfbc3cdfda5508c", "attempt_id": "69761029170a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:39.713895Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.6875839792191982, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.525165907107294, "ttft_ms": 24.525165907107294, "decode_ms": 13.609542045742273}, "total_wall_ms": 44.0399160142988, "ttft_ms": 24.525165907107294, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12981179640, "mlx_cache_bytes": 14342888533, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981179640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 603 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7b593f7d2fb7203038608c27", "attempt_id": "9c259913a350", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:39.780297Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 36, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.6561249503865838, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.799250018782914, "ttft_ms": 23.799250018782914, "decode_ms": 13.617874938063323}, "total_wall_ms": 43.51429198868573, "ttft_ms": 23.799250018782914, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12979803384, "mlx_cache_bytes": 14357339221, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979803384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 604 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c70dc8f9c093f0ff3f22e4ba", "attempt_id": "f7de586b1213", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:39.846184Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 54, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.7449170118197799, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.007415981031954, "ttft_ms": 24.007415981031954, "decode_ms": 97.50837506726384}, "total_wall_ms": 127.72512505762279, "ttft_ms": 24.007415981031954, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12937122824, "mlx_peak_bytes": 12995630360, "mlx_cache_bytes": 14458658309, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12995630360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5999354", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "4c487582d453eafa30ffb8433de1d50486f3e6f9df56b50c337120ea097b3495"} | ||||
| 605 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38c289b609fd54d39a8a3683", "attempt_id": "86f1a44ecb16", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:39.996437Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.4737918972969055, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.797958972863853, "ttft_ms": 23.797958972863853, "decode_ms": 96.80599998682737}, "total_wall_ms": 126.62945804186165, "ttft_ms": 23.797958972863853, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12987962616, "mlx_cache_bytes": 14459837957, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12987962616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3999354", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "23b69ad4477e70ea4b541753662d4ce6061d75a637f08cba5c33b8f0d0ef4317"} | ||||
| 606 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f0074835f70a6ebefafb87e2", "attempt_id": "145db848e4c6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:40.145564Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 55, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.486875000409782, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.399833007715642, "ttft_ms": 23.399833007715642, "decode_ms": 96.30125004332513}, "total_wall_ms": 125.4635420627892, "ttft_ms": 23.399833007715642, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 55}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12937122824, "mlx_peak_bytes": 12996072732, "mlx_cache_bytes": 14482661309, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12996072732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obysellith-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "66b39064cfe9c103d8574722e2dac0e9a19ced28c716ed2067d84dd8796e7762"} | ||||
| 607 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "512c1dfbdfbea2e673204dae", "attempt_id": "95199db25b04", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:40.293620Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 47, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.487000030465424, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.744750069454312, "ttft_ms": 23.744750069454312, "decode_ms": 95.54141690023243}, "total_wall_ms": 125.06424996536225, "ttft_ms": 23.744750069454312, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12988781848, "mlx_cache_bytes": 14498127805, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12988781848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4097917", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "371a3f993ce88da3acd47edf118f34b5c1784277a2686e67f4b9bda19022baa5"} | ||||
| 608 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c814f18ea36e9dade1ef972", "attempt_id": "92d2c57e67c5", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:40.441168Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 45, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.7847499111667275, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.285457980819046, "ttft_ms": 23.285457980819046, "decode_ms": 54.623166914097965}, "total_wall_ms": 84.1439999639988, "ttft_ms": 23.285457980819046, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 45}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12987487480, "mlx_cache_bytes": 14511810470, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12987487480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "cc4b3eb82f5eb96cbf5b959d19ff477508b32c4b6bc1e21432b48caa20d0270b"} | ||||
| 609 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9f584dfd95aacf1f29c15cfd", "attempt_id": "0fb9a1cefa51", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:40.547817Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 47, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 1.6462919302284718, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.403458995744586, "ttft_ms": 23.403458995744586, "decode_ms": 13.844459084793925}, "total_wall_ms": 43.07837493252009, "ttft_ms": 23.403458995744586, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12988781848, "mlx_cache_bytes": 14511810470, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12988781848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 610 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "89bd8ef543a63e46959900e4", "attempt_id": "ea8eb637af19", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:40.613044Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12879320072}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5915, "keep": 1479, "compress_ms": 10.070582968182862}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 49, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538045, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 786.1789169255644, "doc_prefill_ms": 745.5980000086129, "compress_ms": 10.107458103448153, "serialize_ms": 21.1690419819206, "load_ms": 0.71237504016608, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.385791922919452, "ttft_ms": 23.385791922919452, "decode_ms": 13.715541921555996}, "total_wall_ms": 42.20262495800853, "ttft_ms": 23.385791922919452, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 890011648, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12992894232, "mlx_cache_bytes": 14535534502, "process_rss_bytes": 890011648}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12992894232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "62c33a905196eeb5e5206fc7ab974eb988faeade93f2510810deaeb874ec455a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 611 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b300c58de7bc96aefcd0a614", "attempt_id": "e4e63aaf2fd3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:40.677063Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 46, "compress_ms": 68.43483308330178}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538084, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 86.48133289534599, "doc_prefill_ms": 745.5980000086129, "compress_ms": 72.82116706483066, "serialize_ms": 13.406625017523766, "load_ms": 1.569082960486412, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.796833003871143, "ttft_ms": 23.796833003871143, "decode_ms": 150.7937079295516}, "total_wall_ms": 267.0877920463681, "ttft_ms": 23.796833003871143, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 46}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 890945536, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12987962616, "mlx_cache_bytes": 15014708382, "process_rss_bytes": 890945536}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12987962616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BH-220T-0987", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7f48b86fa3d97c5f7fa047ab85ae0d52956c5317c96622cbc29592ee6cd8dbf1", "output_hash": "004260800e8e4a0b0f9d96ea52783221bac8b8d89c0570b58870743b354dfef7"} | ||||
| 612 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26991a3b5a643e9aad1a991b", "attempt_id": "819cdfc6802e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:40.967459Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 38, "compress_ms": 62.350999913178384}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538085, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 79.65445797890425, "doc_prefill_ms": 745.5980000086129, "compress_ms": 66.69766595587134, "serialize_ms": 12.740625068545341, "load_ms": 1.4334169682115316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.47604196984321, "ttft_ms": 23.47604196984321, "decode_ms": 13.599999947473407}, "total_wall_ms": 122.52833298407495, "ttft_ms": 23.47604196984321, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946388992, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12981179640, "mlx_cache_bytes": 15041397918, "process_rss_bytes": 946388992}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981179640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1843ca8bf1961787a2ae2901fe7f6c3c81b63e705f312def16f5ca3267889adf", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 613 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1b2ee842a8c385492a818255", "attempt_id": "55ebef168330", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:41.112952Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 36, "compress_ms": 61.78891600575298}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 36, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538084, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.68775000981987, "doc_prefill_ms": 745.5980000086129, "compress_ms": 66.21299998369068, "serialize_ms": 9.245957946404815, "load_ms": 1.2875000247731805, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.293792037293315, "ttft_ms": 23.293792037293315, "decode_ms": 13.751417049206793}, "total_wall_ms": 118.51704202126712, "ttft_ms": 23.293792037293315, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946388992, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12979803384, "mlx_cache_bytes": 15055029406, "process_rss_bytes": 946388992}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979803384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7f48b86fa3d97c5f7fa047ab85ae0d52956c5317c96622cbc29592ee6cd8dbf1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 614 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "683a1db081dd778d6886dff0", "attempt_id": "f9e9159f116b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:41.253932Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 54, "compress_ms": 62.590540968813}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 54, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538082, "side_information_bytes": 16226, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.78608300536871, "doc_prefill_ms": 745.5980000086129, "compress_ms": 66.78737502079457, "serialize_ms": 8.779708063229918, "load_ms": 1.460416940972209, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.264666087925434, "ttft_ms": 23.264666087925434, "decode_ms": 96.0485830437392}, "total_wall_ms": 201.0069170501083, "ttft_ms": 23.264666087925434, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 946388992, "backend_memory": {"mlx_active_bytes": 12937122824, "mlx_peak_bytes": 12994991384, "mlx_cache_bytes": 15091942558, "process_rss_bytes": 946388992}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12994991384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4646500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9d6f2e3a6ec3744f4ba328d62d6380f6912fe2f948f0fd38122cd8d57786058f", "output_hash": "22c7e5c0df41a8fcf90ee1e6ad966a7b73b0da3ca2ded8274a61b1221ad03f00"} | ||||
| 615 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8d2981c05acc56e808ac29e8", "attempt_id": "3384e82f5667", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:41.478204Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 46, "compress_ms": 61.803124961443245}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538085, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.16758400015533, "doc_prefill_ms": 745.5980000086129, "compress_ms": 65.91229094192386, "serialize_ms": 9.024665923789144, "load_ms": 0.6103329360485077, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.600792046636343, "ttft_ms": 23.600792046636343, "decode_ms": 96.53974999673665}, "total_wall_ms": 200.4127079853788, "ttft_ms": 23.600792046636343, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 946388992, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12987962616, "mlx_cache_bytes": 15093122206, "process_rss_bytes": 946388992}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12987962616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1642310", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1843ca8bf1961787a2ae2901fe7f6c3c81b63e705f312def16f5ca3267889adf", "output_hash": "005e8b354f7c6ac6e74dbc900f6a375ca5fd18492510e219c80b7ad3bd6e8e0f"} | ||||
| 616 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "91fa67c9efa907afdc98b444", "attempt_id": "f5a46cff6d7e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:41.701405Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 55, "compress_ms": 64.65950002893806}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 55, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538084, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 78.66683299653232, "doc_prefill_ms": 745.5980000086129, "compress_ms": 69.55354195088148, "serialize_ms": 8.85995791759342, "load_ms": 1.5422089491039515, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.96883298549801, "ttft_ms": 22.96883298549801, "decode_ms": 68.52229207288474}, "total_wall_ms": 176.1655000736937, "ttft_ms": 22.96883298549801, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 55}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 946388992, "backend_memory": {"mlx_active_bytes": 12937122824, "mlx_peak_bytes": 12995761436, "mlx_cache_bytes": 15113225374, "process_rss_bytes": 946388992}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12995761436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7f48b86fa3d97c5f7fa047ab85ae0d52956c5317c96622cbc29592ee6cd8dbf1", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 617 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "de39b191cc6869e1bd45d4ff", "attempt_id": "61769d0fce0f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:41.904367Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 47, "compress_ms": 62.77700001373887}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 47, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538084, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.31854200735688, "doc_prefill_ms": 745.5980000086129, "compress_ms": 66.93804101087153, "serialize_ms": 9.151707985438406, "load_ms": 1.2653330340981483, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.21474999189377, "ttft_ms": 23.21474999189377, "decode_ms": 95.98508302588016}, "total_wall_ms": 201.36058400385082, "ttft_ms": 23.21474999189377, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 946405376, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12988781848, "mlx_cache_bytes": 15132198046, "process_rss_bytes": 946405376}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12988781848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1244646", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7f48b86fa3d97c5f7fa047ab85ae0d52956c5317c96622cbc29592ee6cd8dbf1", "output_hash": "76809b4b0a65faf5b3f7caabbd0261721d3a64e3335985b6425912ea2aebcd62"} | ||||
| 618 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "725e88d6fdfe21b2d19638bd", "attempt_id": "4c6c550a66ad", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:42.129822Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 45, "compress_ms": 63.13600006978959}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 45, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538084, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.82687498163432, "doc_prefill_ms": 745.5980000086129, "compress_ms": 67.47825001366436, "serialize_ms": 9.1194580309093, "load_ms": 1.4307090314105153, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.86475000437349, "ttft_ms": 22.86475000437349, "decode_ms": 68.11220897361636}, "total_wall_ms": 173.7229999853298, "ttft_ms": 22.86475000437349, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 946405376, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12987487480, "mlx_cache_bytes": 15149237406, "process_rss_bytes": 946405376}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12987487480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21510", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7f48b86fa3d97c5f7fa047ab85ae0d52956c5317c96622cbc29592ee6cd8dbf1", "output_hash": "99baee832a9b728bf88c3cd01afd6db133f37389faf2ffb420813dcf83f7adc9"} | ||||
| 619 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26a90ff41fa4f69f86c1b617", "attempt_id": "3201a30f4148", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:42.326679Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 47, "compress_ms": 63.82183311507106}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 47, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538084, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.11270800791681, "doc_prefill_ms": 745.5980000086129, "compress_ms": 68.04354197811335, "serialize_ms": 8.8326659752056, "load_ms": 1.522375037893653, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.465291946195066, "ttft_ms": 23.465291946195066, "decode_ms": 13.75187502708286}, "total_wall_ms": 120.3812500461936, "ttft_ms": 23.465291946195066, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946421760, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12988781848, "mlx_cache_bytes": 15149237406, "process_rss_bytes": 946421760}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12988781848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7f48b86fa3d97c5f7fa047ab85ae0d52956c5317c96622cbc29592ee6cd8dbf1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 620 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6789e28c8e72b7b8029852fb", "attempt_id": "958485a199cc", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:42.470832Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12823876616}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5915, "keep": 1479, "window_tokens": 49, "compress_ms": 63.35087493062019}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 49, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 54521856, "serialized_payload_bytes": 54538084, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.57170807942748, "doc_prefill_ms": 745.5980000086129, "compress_ms": 67.5697079859674, "serialize_ms": 8.77866696100682, "load_ms": 1.3071669964119792, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.82704201247543, "ttft_ms": 24.82704201247543, "decode_ms": 14.369874959811568}, "total_wall_ms": 121.57670804299414, "ttft_ms": 24.82704201247543, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946454528, "backend_memory": {"mlx_active_bytes": 12935943176, "mlx_peak_bytes": 12993713432, "mlx_cache_bytes": 15168210078, "process_rss_bytes": 946454528}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12993713432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7f48b86fa3d97c5f7fa047ab85ae0d52956c5317c96622cbc29592ee6cd8dbf1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 621 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b20afaa35a30936fde6e8088", "attempt_id": "6180da8cf2a3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:43.016357Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 3.0789589509367943, "receiver_prefill_ms": 0.0, "query_prefill_ms": 33.163542044349015, "ttft_ms": 33.163542044349015, "decode_ms": 152.19958301167935}, "total_wall_ms": 192.69674993120134, "ttft_ms": 33.163542044349015, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1179123712, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13187664292, "mlx_cache_bytes": 15481758174, "process_rss_bytes": 1179123712}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13187664292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 622 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8684d6dc30a81218c7c2d24", "attempt_id": "bcb1c2b98598", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:43.231424Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 38, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 2.316499943844974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.72016602102667, "ttft_ms": 27.72016602102667, "decode_ms": 15.227333991788328}, "total_wall_ms": 49.47220906615257, "ttft_ms": 27.72016602102667, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1179123712, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13169871268, "mlx_cache_bytes": 15539691998, "process_rss_bytes": 1179123712}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13169871268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 623 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a80d6dc334d7623567e7721", "attempt_id": "257822526586", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:43.303393Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 36, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 1.4448750298470259, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.294334024190903, "ttft_ms": 27.294334024190903, "decode_ms": 15.173666994087398}, "total_wall_ms": 48.10779099352658, "ttft_ms": 27.294334024190903, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1179123712, "backend_memory": {"mlx_active_bytes": 13059576840, "mlx_peak_bytes": 13164939684, "mlx_cache_bytes": 15595495902, "process_rss_bytes": 1179123712}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13164939684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 624 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cb70f85747345826c530401", "attempt_id": "00129cc1e110", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:43.373836Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 54, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 2.519874949939549, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.939250041730702, "ttft_ms": 28.939250041730702, "decode_ms": 107.29329101741314}, "total_wall_ms": 142.91108294855803, "ttft_ms": 28.939250041730702, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1179123712, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13205732564, "mlx_cache_bytes": 15678069118, "process_rss_bytes": 1179123712}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13205732564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4646500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "22c7e5c0df41a8fcf90ee1e6ad966a7b73b0da3ca2ded8274a61b1221ad03f00"} | ||||
| 625 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "76e8c427170d304138c831ef", "attempt_id": "3f60274a86b9", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:43.539579Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 46, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 2.3935410426929593, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.827874990180135, "ttft_ms": 27.827874990180135, "decode_ms": 106.32445802912116}, "total_wall_ms": 140.73987503070384, "ttft_ms": 27.827874990180135, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1179123712, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13187663492, "mlx_cache_bytes": 15678069118, "process_rss_bytes": 1179123712}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13187663492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1642260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "08505337332e43191f2e55bf7664c5072c21fe3054a4238b7a4ab81901c3be71"} | ||||
| 626 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "024411db62076b803155512c", "attempt_id": "bb15a992ac91", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:43.707632Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 55, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 2.2962080547586083, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.974167071282864, "ttft_ms": 28.974167071282864, "decode_ms": 75.9441249538213}, "total_wall_ms": 111.6967499256134, "ttft_ms": 28.974167071282864, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 55}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1179140096, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13207866184, "mlx_cache_bytes": 15762792846, "process_rss_bytes": 1179140096}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13207866184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 627 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3369cf540d82aa0afbe52be2", "attempt_id": "e4ee565201a3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:43.843023Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 47, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 1.8810420297086239, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.45987502951175, "ttft_ms": 28.45987502951175, "decode_ms": 470.1098329387605}, "total_wall_ms": 504.7823750646785, "ttft_ms": 28.45987502951175, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 47}, "output_usage": {"output_tokens": 31}, "provider_cached_usage": null, "process_memory": 1179140096, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13189921284, "mlx_cache_bytes": 15834620302, "process_rss_bytes": 1179140096}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13189921284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1449850+4896700+3060221=8866771", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "339e4dcfeaddc407f861157d4cce3f6eb27e0fa6494433d3a22351afb8595106"} | ||||
| 628 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6cc14df73ed9b95c92f16e0d", "attempt_id": "e8c2871c966f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:44.370806Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 45, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 2.3955829674378037, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.787665952928364, "ttft_ms": 27.787665952928364, "decode_ms": 76.34704106021672}, "total_wall_ms": 110.7333330437541, "ttft_ms": 27.787665952928364, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1179140096, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13185779044, "mlx_cache_bytes": 15903302030, "process_rss_bytes": 1179140096}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13185779044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21510", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "99baee832a9b728bf88c3cd01afd6db133f37389faf2ffb420813dcf83f7adc9"} | ||||
| 629 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f1e397244db10bc819e6c552", "attempt_id": "3ac430062959", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:44.504108Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 47, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 1.9345419714227319, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.198207961395383, "ttft_ms": 28.198207961395383, "decode_ms": 15.202042064629495}, "total_wall_ms": 49.82195806223899, "ttft_ms": 28.198207961395383, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1179140096, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13189921284, "mlx_cache_bytes": 15903302030, "process_rss_bytes": 1179140096}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13189921284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 630 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e8319061a385738a52f7e36b", "attempt_id": "7883580dce47", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:44.576542Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12942496776}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5876, "source_tokens_receiver": 5876, "query_tokens": 49, "message_tokens": 5915, "message_utf8_bytes": 29477, "cache_tensor_bytes": 115839360, "serialized_payload_bytes": 115873689, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 401.04262495879084, "doc_prefill_ms": 745.5980000086129, "compress_ms": 11.511749937199056, "serialize_ms": 389.179875026457, "load_ms": 2.2968340199440718, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.806708054617047, "ttft_ms": 28.806708054617047, "decode_ms": 15.399042051285505}, "total_wall_ms": 50.737167010083795, "ttft_ms": 28.806708054617047, "input_usage": {"receiver_prefix_tokens": 5915, "dense_cache_bytes": 218050560, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1179140096, "backend_memory": {"mlx_active_bytes": 13060461576, "mlx_peak_bytes": 13271596825, "mlx_cache_bytes": 15903302030, "process_rss_bytes": 1179140096}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13271596825, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "92913d7fe0952fc065c3d436d31d48b913e0c6ccd5e07c5190bd9ff6a41a92cf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 631 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f97573cd17cb1d518dff579", "attempt_id": "0dad28d735e3", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:44.728953Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5754, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.914749968797, "ttft_ms": 15.072584035806358, "decode_ms": 103.18512504454702}, "total_wall_ms": 802.2332079708576, "ttft_ms": 15.072584035806358, "input_usage": {"receiver_prompt_tokens": 5754}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 960430080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13755487284, "mlx_cache_bytes": 2709283160, "process_rss_bytes": 960430080}, "peak_prefill_memory": null, "peak_decode_memory": 13755487284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 632 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f96c5643c5e92f5a91667320", "attempt_id": "ea32aa0763a5", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:45.558553Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5747, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 665.1716670021415, "ttft_ms": 14.962999965064228, "decode_ms": 29.578624991700053}, "total_wall_ms": 717.5330830505118, "ttft_ms": 14.962999965064228, "input_usage": {"receiver_prompt_tokens": 5747}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 960430080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13753717812, "mlx_cache_bytes": 3094602072, "process_rss_bytes": 960430080}, "peak_prefill_memory": null, "peak_decode_memory": 13753717812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 633 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "311c316ecf5eb174e2c9860f", "attempt_id": "986ad55ebdfc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:46.297884Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5746, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 669.6503750281408, "ttft_ms": 14.869707985781133, "decode_ms": 29.346375027671456}, "total_wall_ms": 721.6559590306133, "ttft_ms": 14.869707985781133, "input_usage": {"receiver_prompt_tokens": 5746}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 960430080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13753717812, "mlx_cache_bytes": 3094602072, "process_rss_bytes": 960430080}, "peak_prefill_memory": null, "peak_decode_memory": 13753717812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 634 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5ab81033234e3c8638815836", "attempt_id": "53eef1eccaaa", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:47.040740Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5763, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 682.7251249924302, "ttft_ms": 14.848500024527311, "decode_ms": 73.9058330655098}, "total_wall_ms": 779.1357500245795, "ttft_ms": 14.848500024527311, "input_usage": {"receiver_prompt_tokens": 5763}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960561152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13757600820, "mlx_cache_bytes": 3514474840, "process_rss_bytes": 960561152}, "peak_prefill_memory": null, "peak_decode_memory": 13757600820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,646,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "4aa581d3b677990c609f5158f2224f44705d6dff2d586686d82bbd76b90bf775"} | ||||
| 635 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ccc63ad98d954494c162f4d9", "attempt_id": "35e73735f571", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:47.841225Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5755, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 679.2915420373902, "ttft_ms": 14.946416951715946, "decode_ms": 74.2634580237791}, "total_wall_ms": 776.2349169934168, "ttft_ms": 14.946416951715946, "input_usage": {"receiver_prompt_tokens": 5755}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960577536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13755585588, "mlx_cache_bytes": 3677462872, "process_rss_bytes": 960577536}, "peak_prefill_memory": null, "peak_decode_memory": 13755585588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,642,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "2bc4cbca0c91d790508324ed0e180fbe979a27c5991cdf8d1df4a0d6c6478128"} | ||||
| 636 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4dcaa1a9078c8261690496cd", "attempt_id": "9396e0841ec7", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:48.638868Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5763, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.2679160013795, "ttft_ms": 14.913874911144376, "decode_ms": 59.16108307428658}, "total_wall_ms": 773.1782499467954, "ttft_ms": 14.913874911144376, "input_usage": {"receiver_prompt_tokens": 5763}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 960577536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13757600820, "mlx_cache_bytes": 3677462872, "process_rss_bytes": 960577536}, "peak_prefill_memory": null, "peak_decode_memory": 13757600820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 637 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "132819ab321c4f347b292462", "attempt_id": "169a871e9712", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:49.433340Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5757, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 685.910917003639, "ttft_ms": 14.891917002387345, "decode_ms": 73.90683400444686}, "total_wall_ms": 782.3675000108778, "ttft_ms": 14.891917002387345, "input_usage": {"receiver_prompt_tokens": 5757}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960593920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13756142644, "mlx_cache_bytes": 4065206616, "process_rss_bytes": 960593920}, "peak_prefill_memory": null, "peak_decode_memory": 13756142644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,325,120", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "06858de527d0eebc0e3e512a3edd70d5e03bd5ef7b3f48e113c7c98ec4d4d44a"} | ||||
| 638 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f253dd0aa585177cbd1afaf1", "attempt_id": "cb6e5fc91f53", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:50.236672Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5754, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.8973749270663, "ttft_ms": 15.107625047676265, "decode_ms": 45.284833991900086}, "total_wall_ms": 760.1380830164999, "ttft_ms": 15.107625047676265, "input_usage": {"receiver_prompt_tokens": 5754}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 960593920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13755487284, "mlx_cache_bytes": 4065206616, "process_rss_bytes": 960593920}, "peak_prefill_memory": null, "peak_decode_memory": 13755487284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.51", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "8b163c410713c0ff57f91f3d77cb2542c3dac7d038413566e00f807f89fd23a8"} | ||||
| 639 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d9a63e04788417502ab1033", "attempt_id": "c260dba9bee1", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:51.017654Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5757, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 701.7100830562413, "ttft_ms": 14.908957993611693, "decode_ms": 14.701624982990324}, "total_wall_ms": 739.2371250316501, "ttft_ms": 14.908957993611693, "input_usage": {"receiver_prompt_tokens": 5757}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960593920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13756142644, "mlx_cache_bytes": 4065206616, "process_rss_bytes": 960593920}, "peak_prefill_memory": null, "peak_decode_memory": 13756142644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 640 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "61f1fce7143c4302f500d1d0", "attempt_id": "3c013b146782", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:48:51.778601Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 5759, "message_tokens": 5649, "message_utf8_bytes": 29477, "cache_tensor_bytes": null, "serialized_payload_bytes": 29477, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009499955922365189, "decode_payload_ms": 0.0, "receiver_prefill_ms": 703.8166670827195, "ttft_ms": 15.135291032493114, "decode_ms": 14.92549991235137}, "total_wall_ms": 741.8509579729289, "ttft_ms": 15.135291032493114, "input_usage": {"receiver_prompt_tokens": 5759}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960593920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13797921844, "mlx_cache_bytes": 4289929560, "process_rss_bytes": 960593920}, "peak_prefill_memory": null, "peak_decode_memory": 13797921844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 641 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "761772260e48a1a392d5a38b", "attempt_id": "f5b7811ef2b7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:00.858800Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.4203339824453, "ttft_ms": 13.587250025011599, "decode_ms": 54.06579200644046}, "total_wall_ms": 146.23704098630697, "ttft_ms": 13.587250025011599, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 960741376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 6341214984, "process_rss_bytes": 960741376}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "d1d1703b3b076a28dbc172d76030e03fd6a593b6a8ab08295aa02b3bb2982395"} | ||||
| 642 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a88f0971f329a611707491c", "attempt_id": "a031ba060b3a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:01.026903Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.74616598524153, "ttft_ms": 14.126959023997188, "decode_ms": 28.40775006916374}, "total_wall_ms": 120.28612499125302, "ttft_ms": 14.126959023997188, "input_usage": {"receiver_prompt_tokens": 614, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 960741376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198280, "mlx_cache_bytes": 6684132104, "process_rss_bytes": 960741376}, "peak_prefill_memory": null, "peak_decode_memory": 13038198280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 643 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "41b5420caea35a4b667f6fda", "attempt_id": "8a01b671ea33", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:01.168870Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.76950003951788, "ttft_ms": 13.644790975376964, "decode_ms": 27.184875099919736}, "total_wall_ms": 118.61387500539422, "ttft_ms": 13.644790975376964, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 960741376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198280, "mlx_cache_bytes": 6684132104, "process_rss_bytes": 960741376}, "peak_prefill_memory": null, "peak_decode_memory": 13038198280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 644 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c2386f4b2b0297c5ab72552e", "attempt_id": "b1fc88980e18", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:01.308834Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 630, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.30637502390891, "ttft_ms": 13.67649994790554, "decode_ms": 67.49529205262661}, "total_wall_ms": 159.54675001557916, "ttft_ms": 13.67649994790554, "input_usage": {"receiver_prompt_tokens": 630, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960741376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047176748, "mlx_cache_bytes": 7059295452, "process_rss_bytes": 960741376}, "peak_prefill_memory": null, "peak_decode_memory": 13047176748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,896,700", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "8763af91680f869ac754831158f39e531f170e2b3da0124f83ed20194c046b2f"} | ||||
| 645 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "92091b944f5a46f4500c23cc", "attempt_id": "185b94f127c8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:01.490355Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.52683299966156, "ttft_ms": 13.699125032871962, "decode_ms": 68.48008302040398}, "total_wall_ms": 159.79100007098168, "ttft_ms": 13.699125032871962, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960741376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042720300, "mlx_cache_bytes": 7120440540, "process_rss_bytes": 960741376}, "peak_prefill_memory": null, "peak_decode_memory": 13042720300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,449,850", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "ebc73cc2db51bb11b57ba154709857a98a2e20df8b51e7ff500d8c7268c7a05e"} | ||||
| 646 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "44642af969a90fb35eeffe15", "attempt_id": "37f53f7524e8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:01.671302Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 630, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.16204097960144, "ttft_ms": 13.799999956972897, "decode_ms": 13.56104202568531}, "total_wall_ms": 105.59379099868238, "ttft_ms": 13.799999956972897, "input_usage": {"receiver_prompt_tokens": 630, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960741376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047176748, "mlx_cache_bytes": 7120440540, "process_rss_bytes": 960741376}, "peak_prefill_memory": null, "peak_decode_memory": 13047176748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 647 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ebd7f034278d60a0d13bad40", "attempt_id": "24180e389ec8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:01.798113Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.86862500850111, "ttft_ms": 13.60095792915672, "decode_ms": 257.52212502993643}, "total_wall_ms": 349.0498330211267, "ttft_ms": 13.60095792915672, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": 960757760, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801644, "mlx_cache_bytes": 7346638044, "process_rss_bytes": 960757760}, "peak_prefill_memory": null, "peak_decode_memory": 13043801644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,449,850 + 3,060,221 = 4,509,071", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "250c55ce67eebb771bb0c58d80f4746a9734d4eb5797440ad2f525d4af9e1008"} | ||||
| 648 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd3c53ade882bc6f80621bc4", "attempt_id": "fb7d44e6f617", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:02.168366Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.60170900635421, "ttft_ms": 13.564000022597611, "decode_ms": 13.448583893477917}, "total_wall_ms": 104.67491706367582, "ttft_ms": 13.564000022597611, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960757760, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 7346638044, "process_rss_bytes": 960757760}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 649 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cb2408b9979c54eae8650a7e", "attempt_id": "a4e705388fe8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:02.294420Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.15379190631211, "ttft_ms": 13.503041001968086, "decode_ms": 13.538209022954106}, "total_wall_ms": 105.14624998904765, "ttft_ms": 13.503041001968086, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960757760, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801644, "mlx_cache_bytes": 7346638044, "process_rss_bytes": 960757760}, "peak_prefill_memory": null, "peak_decode_memory": 13043801644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 650 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f41aea60dc43da3bf44b9ae7", "attempt_id": "a69b50061ff6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:02.420577Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 1651, "cache_tensor_bytes": null, "serialized_payload_bytes": 1651, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8316.229125019163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.93600007425994, "ttft_ms": 13.552916003391147, "decode_ms": 13.560750056058168}, "total_wall_ms": 106.12625000067055, "ttft_ms": 13.552916003391147, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 5783, "sender_output_tokens": 512, "sender_prefill_ms": 716.2940830457956, "sender_ttft_ms": 15.165416989475489, "sender_decode_ms": 7580.513666034676}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960757760, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13076831788, "mlx_cache_bytes": 7446678748, "process_rss_bytes": 960757760}, "peak_prefill_memory": null, "peak_decode_memory": 13076831788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a8eb81adb332c15e4110ad8ed3f4ce82fc2e5239e0aa1a7d53b2ca409df626c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 651 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "21a0ffed8197e9f1252843a0", "attempt_id": "c85ffac486d9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:10.913378Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 447, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.05033303052187, "ttft_ms": 13.512750039808452, "decode_ms": 13.511165976524353}, "total_wall_ms": 83.00225005950779, "ttft_ms": 13.512750039808452, "input_usage": {"receiver_prompt_tokens": 447, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913204312, "mlx_cache_bytes": 8182402268, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12913204312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 652 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fa5a097065f08732fa4be173", "attempt_id": "af39cc4815a2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.018643Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 440, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.54404198098928, "ttft_ms": 13.468833058141172, "decode_ms": 13.77449999563396}, "total_wall_ms": 82.6103329891339, "ttft_ms": 13.468833058141172, "input_usage": {"receiver_prompt_tokens": 440, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909141080, "mlx_cache_bytes": 8428211420, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12909141080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 653 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c0a6d9782ebd8f6ed3382c3", "attempt_id": "46a9008cccf1", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.122871Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 439, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.94862503837794, "ttft_ms": 13.431083061732352, "decode_ms": 13.546333066187799}, "total_wall_ms": 82.84054207615554, "ttft_ms": 13.431083061732352, "input_usage": {"receiver_prompt_tokens": 439, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909141080, "mlx_cache_bytes": 8428211420, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12909141080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 654 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7254681335b139017aa6024a", "attempt_id": "4474fe19a4fa", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.226522Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 456, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.95525000151247, "ttft_ms": 13.620458077639341, "decode_ms": 13.35412496700883}, "total_wall_ms": 82.78725005220622, "ttft_ms": 13.620458077639341, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12918119512, "mlx_cache_bytes": 8699776220, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12918119512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 655 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1fd4bd838c42cd63908aa30d", "attempt_id": "61a87d3bc2ba", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.330553Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 448, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.909707978367805, "ttft_ms": 13.675791909918189, "decode_ms": 13.764124945737422}, "total_wall_ms": 83.32837501075119, "ttft_ms": 13.675791909918189, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913482840, "mlx_cache_bytes": 8809680092, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12913482840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 656 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28c5a985df7453f5fb5d801f", "attempt_id": "b8fa2986a004", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.436048Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 456, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.38708292786032, "ttft_ms": 13.559625018388033, "decode_ms": 13.624625047668815}, "total_wall_ms": 82.41358306258917, "ttft_ms": 13.559625018388033, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12918119512, "mlx_cache_bytes": 8809680092, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12918119512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 657 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5790f0715f333a748f0cfe22", "attempt_id": "316046a93b53", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.540062Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 450, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.36091695446521, "ttft_ms": 13.53516592644155, "decode_ms": 13.51245807018131}, "total_wall_ms": 82.30558293871582, "ttft_ms": 13.53516592644155, "input_usage": {"receiver_prompt_tokens": 450, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12915039320, "mlx_cache_bytes": 9061256412, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12915039320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 658 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e871ef0273579f7aa7352ea0", "attempt_id": "87ff108c3b03", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.643941Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 447, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.76337508298457, "ttft_ms": 13.659541960805655, "decode_ms": 13.65470897872001}, "total_wall_ms": 82.92683307081461, "ttft_ms": 13.659541960805655, "input_usage": {"receiver_prompt_tokens": 447, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913204312, "mlx_cache_bytes": 9061256412, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12913204312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 659 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "06f8ccaa26aa0a899d8a0391", "attempt_id": "ced1b064d3a4", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.748586Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 450, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.111208068206906, "ttft_ms": 13.491875026375055, "decode_ms": 13.446124969050288}, "total_wall_ms": 81.91562490537763, "ttft_ms": 13.491875026375055, "input_usage": {"receiver_prompt_tokens": 450, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12915039320, "mlx_cache_bytes": 9061256412, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12915039320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 660 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7fda027c31a3f30939ef8467", "attempt_id": "29e145fc5a38", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.851426Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 452, "message_tokens": 326, "message_utf8_bytes": 938, "cache_tensor_bytes": null, "serialized_payload_bytes": 938, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8365.846290951595, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.68204105272889, "ttft_ms": 13.652167050167918, "decode_ms": 13.616084004752338}, "total_wall_ms": 82.82262494321913, "ttft_ms": 13.652167050167918, "input_usage": {"receiver_prompt_tokens": 452, "sender_input_tokens": 5813, "sender_output_tokens": 512, "sender_prefill_ms": 753.1871249666438, "sender_ttft_ms": 15.901332953944802, "sender_decode_ms": 7592.425707960501}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960937984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12939254872, "mlx_cache_bytes": 9222212828, "process_rss_bytes": 960937984}, "peak_prefill_memory": null, "peak_decode_memory": 12939254872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1eeb2ed42b70f2e4981fc0bfff224716cba0799337c306ac0a2c14ab59945afc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 661 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b2c3172f8097761374ac9c6", "attempt_id": "9e56ffecf18d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:11.961358Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 617, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.66712498757988, "ttft_ms": 13.5978750186041, "decode_ms": 13.589333044365048}, "total_wall_ms": 104.89208297803998, "ttft_ms": 13.5978750186041, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640072, "mlx_cache_bytes": 9566620892, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13039640072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 662 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f02105e8f20f99c0036ee809", "attempt_id": "2a8fb484e55f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:12.087352Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 610, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.4960419619456, "ttft_ms": 13.583207968622446, "decode_ms": 27.907749987207353}, "total_wall_ms": 118.9943749923259, "ttft_ms": 13.583207968622446, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067066888, "mlx_cache_bytes": 9783839964, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13067066888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 663 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "80e7021f775208af28e24acb", "attempt_id": "15020b4e2411", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:12.227305Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 609, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.41558304708451, "ttft_ms": 13.733458006754518, "decode_ms": 27.072833967395127}, "total_wall_ms": 116.2112500751391, "ttft_ms": 13.733458006754518, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13035249160, "mlx_cache_bytes": 9884699868, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13035249160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 664 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5acb20ee4fc3fd152f0f1eb", "attempt_id": "06fb58e0701b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:12.364597Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 626, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.4364999961108, "ttft_ms": 13.543750043027103, "decode_ms": 67.79658293817192}, "total_wall_ms": 159.82433292083442, "ttft_ms": 13.543750043027103, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13084565036, "mlx_cache_bytes": 9884699868, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13084565036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,646,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "4aa581d3b677990c609f5158f2224f44705d6dff2d586686d82bbd76b90bf775"} | ||||
| 665 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c6085a3dc6d9c155384bd15b", "attempt_id": "58e024ee15bf", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:12.546094Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 618, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.8906669691205, "ttft_ms": 13.83354200515896, "decode_ms": 67.4779589753598}, "total_wall_ms": 159.2140420107171, "ttft_ms": 13.83354200515896, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071998472, "mlx_cache_bytes": 10044017884, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13071998472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,642,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "2bc4cbca0c91d790508324ed0e180fbe979a27c5991cdf8d1df4a0d6c6478128"} | ||||
| 666 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b67bc9e3c114f5d9f32d22ae", "attempt_id": "c1cd2a051616", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:12.726630Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 626, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.53299991600215, "ttft_ms": 13.619249919429421, "decode_ms": 53.98779094684869}, "total_wall_ms": 146.20362501591444, "ttft_ms": 13.619249919429421, "input_usage": {"receiver_prompt_tokens": 626}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13084565036, "mlx_cache_bytes": 10044017884, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13084565036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 667 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1719eeecd5f136ee6aa9a2a", "attempt_id": "1f58b9a1b0ad", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:12.893903Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 620, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.9867500057444, "ttft_ms": 13.57670791912824, "decode_ms": 67.88791704457253}, "total_wall_ms": 159.47487496305257, "ttft_ms": 13.57670791912824, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041982984, "mlx_cache_bytes": 10044017884, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13041982984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,449,850", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "ea2bce232d432751b088e369772ebdcf3ed420864c69d728b4d31c2fcaf1f8aa"} | ||||
| 668 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1e5f5438052c3286176b0408", "attempt_id": "65fc9c672d92", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:13.074576Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 617, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.53241604566574, "ttft_ms": 13.769707991741598, "decode_ms": 13.754499959759414}, "total_wall_ms": 105.09641596581787, "ttft_ms": 13.769707991741598, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640072, "mlx_cache_bytes": 10044017884, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13039640072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 669 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8b4289d2c88a5529b91b6c61", "attempt_id": "f93a0ec1ba90", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:13.200885Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 620, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.12558307684958, "ttft_ms": 13.743082992732525, "decode_ms": 13.467667042277753}, "total_wall_ms": 105.40258302353323, "ttft_ms": 13.743082992732525, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041982984, "mlx_cache_bytes": 10044017884, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13041982984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 670 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8a6d3af4979505fe67b7a60d", "attempt_id": "dd985c2be3b8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:13.328493Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 622, "message_tokens": 511, "message_utf8_bytes": 1530, "cache_tensor_bytes": null, "serialized_payload_bytes": 1530, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.96725004632026, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.19729195721447, "ttft_ms": 13.607584056444466, "decode_ms": 13.572500087320805}, "total_wall_ms": 104.38549995888025, "ttft_ms": 13.607584056444466, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 960954368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042720300, "mlx_cache_bytes": 10044017884, "process_rss_bytes": 960954368}, "peak_prefill_memory": null, "peak_decode_memory": 13042720300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "746255342d7bca9beb746cd27ac11a76038f8ab52e6aa8117dce0ddcf595042d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 671 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff1d04cb357c0b069c50eb2f", "attempt_id": "d51418f72f86", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:14.731931Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 45, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.6282090218737721, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.82433303259313, "ttft_ms": 29.82433303259313, "decode_ms": 44.80366699863225}, "total_wall_ms": 80.4392920108512, "ttft_ms": 29.82433303259313, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13667587300, "mlx_cache_bytes": 10185041477, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13667587300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not found.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "0802559db1375af3ff5caabba71acea1d6299f1a7fc64b6a5024f19cbd33b72f"} | ||||
| 672 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fc7d51de9139e303c99751e0", "attempt_id": "ff195a590086", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:14.834896Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 38, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.035874942317605, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.614624933339655, "ttft_ms": 22.614624933339655, "decode_ms": 14.523459016345441}, "total_wall_ms": 42.144250008277595, "ttft_ms": 22.614624933339655, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13605950472, "mlx_peak_bytes": 13663147236, "mlx_cache_bytes": 10213025349, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13663147236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 673 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b278bb5cb305e675ddfd6d5c", "attempt_id": "86c932e9f0e2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:14.898911Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 37, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.4920829562470317, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.072667023167014, "ttft_ms": 22.072667023167014, "decode_ms": 14.360124943777919}, "total_wall_ms": 41.820416925475, "ttft_ms": 22.072667023167014, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13605950472, "mlx_peak_bytes": 13664720100, "mlx_cache_bytes": 10225051205, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13664720100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 674 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f5c7f934971db91f6b28c810", "attempt_id": "863e1451690f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:14.962142Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 54, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.478208927437663, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.421750054694712, "ttft_ms": 23.421750054694712, "decode_ms": 29.441416962072253}, "total_wall_ms": 58.30554210115224, "ttft_ms": 23.421750054694712, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 54}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13607556104, "mlx_peak_bytes": 13676254472, "mlx_cache_bytes": 10471666521, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13676254472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 675 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "325c61b73c53a7a8c6c66db0", "attempt_id": "fdbf3111ba26", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.041596Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 46, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.553207985125482, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.048416944220662, "ttft_ms": 23.048416944220662, "decode_ms": 29.051124933175743}, "total_wall_ms": 57.81016708351672, "ttft_ms": 23.048416944220662, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 46}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13669618952, "mlx_cache_bytes": 10505827161, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13669618952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 676 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6daaab0affaeb41a21746dac", "attempt_id": "5a9159ac73e0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.121091Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 54, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.5722080133855343, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.72695896681398, "ttft_ms": 22.72695896681398, "decode_ms": 57.96212493441999}, "total_wall_ms": 86.405333946459, "ttft_ms": 22.72695896681398, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 54}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13607556104, "mlx_peak_bytes": 13676254472, "mlx_cache_bytes": 10504909657, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13676254472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 677 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ec83a95bd127f56300988b72", "attempt_id": "9076f976e7c8", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.228501Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 48, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.7184580210596323, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.36895903479308, "ttft_ms": 22.36895903479308, "decode_ms": 73.06270801927894}, "total_wall_ms": 101.24999994877726, "ttft_ms": 22.36895903479308, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13670520072, "mlx_cache_bytes": 10527585113, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13670520072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12,995,120", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "9026384b63e587476a9d4690d1434fb909195a0fc4e178296d7c83a42c8e79fe"} | ||||
| 678 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a39ad271755a688694d6070f", "attempt_id": "c7bddbcf67d4", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.356047Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 45, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.0944160167127848, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.73070900607854, "ttft_ms": 21.73070900607854, "decode_ms": 28.636250062845647}, "total_wall_ms": 55.3259999724105, "ttft_ms": 21.73070900607854, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13667587300, "mlx_cache_bytes": 10527585113, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13667587300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 679 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa7ebc4d366a42fa413a2eaa", "attempt_id": "f8bf79b9a051", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.433227Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 48, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.9713749643415213, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.363250027410686, "ttft_ms": 22.363250027410686, "decode_ms": 14.21449996996671}, "total_wall_ms": 42.38108405843377, "ttft_ms": 22.363250027410686, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13670520072, "mlx_cache_bytes": 10527585113, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13670520072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 680 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dca87ab2516ac5ce0a826e81", "attempt_id": "15f13efcf66a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.496865Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13436900360}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5709, "keep": 1427, "compress_ms": 9.515292011201382}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 50, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672886, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1277.743292041123, "doc_prefill_ms": 669.9334169970825, "compress_ms": 9.548999951221049, "serialize_ms": 589.9178750114515, "load_ms": 1.9837920553982258, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.50033395830542, "ttft_ms": 22.50033395830542, "decode_ms": 14.410000061616302}, "total_wall_ms": 42.868749937042594, "ttft_ms": 22.50033395830542, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1288765440, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13672273160, "mlx_cache_bytes": 10563318617, "process_rss_bytes": 1288765440}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13672273160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "75cd8b620e50d18008b47dea434f45d60f0c987e927fdc6f0e43971a357556ca", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 681 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c6193d759ae08ee26479b73", "attempt_id": "f5d5fbc38242", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.561343Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 45, "compress_ms": 95.97979194950312}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 45, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 128.1783749582246, "doc_prefill_ms": 669.9334169970825, "compress_ms": 100.07870907429606, "serialize_ms": 27.91404095478356, "load_ms": 0.9356250520795584, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.824541993439198, "ttft_ms": 24.824541993439198, "decode_ms": 101.77991702221334}, "total_wall_ms": 259.7132920054719, "ttft_ms": 24.824541993439198, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1290682368, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13667587300, "mlx_cache_bytes": 11945325505, "process_rss_bytes": 1290682368}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13667587300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 682 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fa03f8bff48725ab98e588ac", "attempt_id": "aba9f6320793", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:15.843155Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 38, "compress_ms": 77.07583310548216}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 38, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.7099999897182, "doc_prefill_ms": 669.9334169970825, "compress_ms": 81.16591698490083, "serialize_ms": 28.364834026433527, "load_ms": 1.8622919451445341, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.919584018178284, "ttft_ms": 21.919584018178284, "decode_ms": 28.70737505145371}, "total_wall_ms": 166.2143749417737, "ttft_ms": 21.919584018178284, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1454915584, "backend_memory": {"mlx_active_bytes": 13605950472, "mlx_peak_bytes": 13663130852, "mlx_cache_bytes": 11982074817, "process_rss_bytes": 1454915584}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13663130852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 683 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "897ddad9a2c796267e84b9a5", "attempt_id": "87a67aeb7b59", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:16.032455Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 37, "compress_ms": 77.02454191166908}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 37, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.36137504782528, "doc_prefill_ms": 669.9334169970825, "compress_ms": 81.12729201093316, "serialize_ms": 22.050917032174766, "load_ms": 1.8315829802304506, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.431041997857392, "ttft_ms": 21.431041997857392, "decode_ms": 28.93595804926008}, "total_wall_ms": 159.62012496311218, "ttft_ms": 21.431041997857392, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1454915584, "backend_memory": {"mlx_active_bytes": 13605950472, "mlx_peak_bytes": 13664670948, "mlx_cache_bytes": 12002358209, "process_rss_bytes": 1454915584}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13664670948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 684 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f3579fc3422798f5c55a08f", "attempt_id": "0e9c4fe927d6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:16.214652Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 54, "compress_ms": 79.48716694954783}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 54, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 106.66050005238503, "doc_prefill_ms": 669.9334169970825, "compress_ms": 83.5330419940874, "serialize_ms": 22.95150002464652, "load_ms": 0.9629169944673777, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.21658395137638, "ttft_ms": 22.21658395137638, "decode_ms": 72.86745798774064}, "total_wall_ms": 206.78174996282905, "ttft_ms": 22.21658395137638, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1454931968, "backend_memory": {"mlx_active_bytes": 13607556104, "mlx_peak_bytes": 13676254472, "mlx_cache_bytes": 12051674049, "process_rss_bytes": 1454931968}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13676254472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,646,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "4aa581d3b677990c609f5158f2224f44705d6dff2d586686d82bbd76b90bf775"} | ||||
| 685 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c64ae1c2a5c7aa1dc31ec4a0", "attempt_id": "4b3f1f874ad5", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:16.444117Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 46, "compress_ms": 77.23754202015698}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 46, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.14820799976587, "doc_prefill_ms": 669.9334169970825, "compress_ms": 81.10674994532019, "serialize_ms": 21.86008298303932, "load_ms": 1.8286670092493296, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.926917019300163, "ttft_ms": 21.926917019300163, "decode_ms": 72.07066693808883}, "total_wall_ms": 203.0188749777153, "ttft_ms": 21.926917019300163, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1454931968, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13669618952, "mlx_cache_bytes": 12084573121, "process_rss_bytes": 1454931968}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13669618952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,642,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "2bc4cbca0c91d790508324ed0e180fbe979a27c5991cdf8d1df4a0d6c6478128"} | ||||
| 686 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9784184c954116d73add5c57", "attempt_id": "5369bed0d784", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:16.670201Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 54, "compress_ms": 79.10504098981619}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 54, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.1462918985635, "doc_prefill_ms": 669.9334169970825, "compress_ms": 83.20337499026209, "serialize_ms": 21.758540999144316, "load_ms": 1.7290000105276704, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.138832951895893, "ttft_ms": 22.138832951895893, "decode_ms": 57.78416700195521}, "total_wall_ms": 190.81766705494374, "ttft_ms": 22.138832951895893, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 54}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1454931968, "backend_memory": {"mlx_active_bytes": 13607556104, "mlx_peak_bytes": 13676254472, "mlx_cache_bytes": 12083655617, "process_rss_bytes": 1454931968}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13676254472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 687 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47d9ef3a18048d2700508ed9", "attempt_id": "b000c575faec", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:16.884093Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 48, "compress_ms": 78.90054199378937}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 48, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 106.04795895051211, "doc_prefill_ms": 669.9334169970825, "compress_ms": 82.96970801893622, "serialize_ms": 22.89349993225187, "load_ms": 1.714959042146802, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.722416044212878, "ttft_ms": 21.722416044212878, "decode_ms": 275.1231669681147}, "total_wall_ms": 408.73391600325704, "ttft_ms": 21.722416044212878, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 48}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": 1454948352, "backend_memory": {"mlx_active_bytes": 13608473608, "mlx_peak_bytes": 13670520072, "mlx_cache_bytes": 12317979585, "process_rss_bytes": 1454948352}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13670520072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,896,700 + 4,325,120 + 3,999,354", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "f9e51420d3243802bbdb4651a18375139bbb468ace0b81ac1ff0dd6acd3453cb"} | ||||
| 688 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c559950d3399e4b9d6f3cb70", "attempt_id": "0de803c0874d", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:17.315757Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 45, "compress_ms": 77.8674999019131}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 45, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672925, "side_information_bytes": 13149, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.7270410452038, "doc_prefill_ms": 669.9334169970825, "compress_ms": 81.89083402976394, "serialize_ms": 21.654250100255013, "load_ms": 1.8179579637944698, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.65891702659428, "ttft_ms": 20.65891702659428, "decode_ms": 43.29829092603177}, "total_wall_ms": 173.57366695068777, "ttft_ms": 20.65891702659428, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1454964736, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13667587300, "mlx_cache_bytes": 12319814593, "process_rss_bytes": 1454964736}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13667587300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.51", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8ae8da1afdd8b03c91b9b2c8c042e2f715e6b137d1828caddc140cb8bf74ec19", "output_hash": "8b163c410713c0ff57f91f3d77cb2542c3dac7d038413566e00f807f89fd23a8"} | ||||
| 689 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4edc1e1f696857b0c18a1c45", "attempt_id": "73fe64608429", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:17.512454Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 48, "compress_ms": 78.52395798545331}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 48, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.79583300184458, "doc_prefill_ms": 669.9334169970825, "compress_ms": 82.27920904755592, "serialize_ms": 22.34420902095735, "load_ms": 1.8552080728113651, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.788250072859228, "ttft_ms": 21.788250072859228, "decode_ms": 28.8848748896271}, "total_wall_ms": 161.3975000800565, "ttft_ms": 21.788250072859228, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 48}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1454981120, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13670520072, "mlx_cache_bytes": 12319814593, "process_rss_bytes": 1454981120}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13670520072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "4dd633b1f2ee444666fd70af2b36443331fc00e69f3e569847cf278ca625c041"} | ||||
| 690 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "adfa50a50086b8486b005de2", "attempt_id": "ee8e4ba379c7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:17.696960Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5709, "keep": 1427, "window_tokens": 50, "compress_ms": 78.27395910862833}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 50, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 163659776, "serialized_payload_bytes": 163672926, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.32483290787786, "doc_prefill_ms": 669.9334169970825, "compress_ms": 82.12404092773795, "serialize_ms": 22.021166048943996, "load_ms": 1.54487497638911, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.868249983526766, "ttft_ms": 21.868249983526766, "decode_ms": 14.339832938276231}, "total_wall_ms": 146.161749958992, "ttft_ms": 21.868249983526766, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1454997504, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13672273160, "mlx_cache_bytes": 12365902785, "process_rss_bytes": 1454997504}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 13672273160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4cbd909565f2300c551c22b17ea92f32f3088be6922861d012e61bd6b0b93afb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 691 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1ec5e037d091b998e52a27bd", "attempt_id": "dc97871b5dd3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:17.968064Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 45, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 6.485749967396259, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.641249984502792, "ttft_ms": 28.641249984502792, "decode_ms": 116.90487491432577}, "total_wall_ms": 156.21200005989522, "ttft_ms": 28.641249984502792, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13975475208, "mlx_peak_bytes": 14148912052, "mlx_cache_bytes": 13507654593, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14148912052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NJ-38Y-8204", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "ed38af85bd1c6dc6543c96eeae3d88aab9f40fd903082d29addfcf3dc185df3f"} | ||||
| 692 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "62a5fa2dd6cdc03483156095", "attempt_id": "5477ab81d871", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.147453Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 38, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 3.1224159756675363, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.42441708687693, "ttft_ms": 27.42441708687693, "decode_ms": 32.97795809339732}, "total_wall_ms": 67.3179579898715, "ttft_ms": 27.42441708687693, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13974557704, "mlx_peak_bytes": 14134147972, "mlx_cache_bytes": 13571898689, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14134147972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 693 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5e893ce46618e8eee0602eba", "attempt_id": "6ae77f978e52", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.236669Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 37, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 3.08908405713737, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.1065830020234, "ttft_ms": 27.1065830020234, "decode_ms": 32.9419580521062}, "total_wall_ms": 66.98608410079032, "ttft_ms": 27.1065830020234, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13974557704, "mlx_peak_bytes": 14135507844, "mlx_cache_bytes": 13571898689, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14135507844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 694 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9525231932d4d795c57ccd01", "attempt_id": "bd90fcbfec64", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.325347Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 54, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 2.4963750038295984, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.873082948848605, "ttft_ms": 28.873082948848605, "decode_ms": 82.7874590177089}, "total_wall_ms": 118.0978340562433, "ttft_ms": 28.873082948848605, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13975475208, "mlx_peak_bytes": 14170181612, "mlx_cache_bytes": 13732310145, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14170181612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,646,500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "4aa581d3b677990c609f5158f2224f44705d6dff2d586686d82bbd76b90bf775"} | ||||
| 695 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "869a9cf855dbf46398bebc61", "attempt_id": "7d404f17d924", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.464960Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 46, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 3.1340409768745303, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.136583045125008, "ttft_ms": 28.136583045125008, "decode_ms": 82.19929202459753}, "total_wall_ms": 117.3821670236066, "ttft_ms": 28.136583045125008, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13974557704, "mlx_peak_bytes": 14151569388, "mlx_cache_bytes": 13809511553, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14151569388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,642,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "2bc4cbca0c91d790508324ed0e180fbe979a27c5991cdf8d1df4a0d6c6478128"} | ||||
| 696 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a380cc6d47ef75481913c70", "attempt_id": "8d06069325e6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.604118Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 54, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 3.1031249091029167, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.848542016930878, "ttft_ms": 28.848542016930878, "decode_ms": 66.18287495803088}, "total_wall_ms": 101.96966701187193, "ttft_ms": 28.848542016930878, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 54}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13975475208, "mlx_peak_bytes": 14170181612, "mlx_cache_bytes": 13808594049, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14170181612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Varard-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "5b121a68ee6d66f04f20cbc0076c052393b985c2fa5041f6aadd2feb2925e691"} | ||||
| 697 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d83a217bdf22952601d19262", "attempt_id": "cfaf3f50143f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.727617Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 48, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 3.0177499866113067, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.220000094734132, "ttft_ms": 28.220000094734132, "decode_ms": 82.72845798637718}, "total_wall_ms": 118.045459035784, "ttft_ms": 28.220000094734132, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13975475208, "mlx_peak_bytes": 14155272172, "mlx_cache_bytes": 13888220289, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14155272172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,449,850", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "ea2bce232d432751b088e369772ebdcf3ed420864c69d728b4d31c2fcaf1f8aa"} | ||||
| 698 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bcc1a4c620031825d9ea976a", "attempt_id": "96fdb813529a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.867549Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 45, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 2.9664169996976852, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.69716701004654, "ttft_ms": 27.69716701004654, "decode_ms": 49.34462497476488}, "total_wall_ms": 84.01341701392084, "ttft_ms": 27.69716701004654, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13974557704, "mlx_peak_bytes": 14148909380, "mlx_cache_bytes": 13889137793, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14148909380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21.51", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "8b163c410713c0ff57f91f3d77cb2542c3dac7d038413566e00f807f89fd23a8"} | ||||
| 699 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "982a6ead155cfaa22170dd0d", "attempt_id": "c3d47ba275b2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:18.973177Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 48, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 2.79166700784117, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.833124971948564, "ttft_ms": 27.833124971948564, "decode_ms": 16.34804194327444}, "total_wall_ms": 50.8792920736596, "ttft_ms": 27.833124971948564, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13974557704, "mlx_peak_bytes": 14155272172, "mlx_cache_bytes": 13889137793, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14155272172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 700 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "805062ae7dd32fad851f5315", "attempt_id": "ba84907e336e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:19.045731Z", "task_family": "synthetic", "document_id": "syn_03004_8000", "document_hash": "9f5712249838ec2b73ad1d3dc0f47c148daf5210f80f5a314286aa23e84ab35d", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03004_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13622236168}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5649, "source_tokens_receiver": 5649, "query_tokens": 50, "message_tokens": 5709, "message_utf8_bytes": 29477, "cache_tensor_bytes": 347837952, "serialized_payload_bytes": 347865290, "side_information_bytes": 27338, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.28200000710785, "doc_prefill_ms": 669.9334169970825, "compress_ms": 17.884167027659714, "serialize_ms": 84.11533304024488, "load_ms": 3.1267909798771143, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.59420794993639, "ttft_ms": 28.59420794993639, "decode_ms": 16.63841598201543}, "total_wall_ms": 52.22491698805243, "ttft_ms": 28.59420794993639, "input_usage": {"receiver_prefix_tokens": 5709, "dense_cache_bytes": 654753792, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2151530496, "backend_memory": {"mlx_active_bytes": 13974557704, "mlx_peak_bytes": 14160269292, "mlx_cache_bytes": 13972106369, "process_rss_bytes": 2151530496}, "peak_prefill_memory": 13744149556, "peak_decode_memory": 14160269292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03004_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1ed2ab147e2d2c7179dc49cbf10a931c4bdb5c8cf7b837307d9bc007f75f2c4a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 701 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dace13b6e8b44276f4f7b8ed", "attempt_id": "6f0776e39931", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:19.195139Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11097, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1592.316583963111, "ttft_ms": 15.46429202426225, "decode_ms": 146.58962504472584}, "total_wall_ms": 1770.7308750832453, "ttft_ms": 15.46429202426225, "input_usage": {"receiver_prompt_tokens": 11097}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1704787968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 3939033528, "process_rss_bytes": 1704787968}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-56F-6105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "ce19f1de10dcab0eee002d716faa220946d8af410293bc2f7e9d058712b49180"} | ||||
| 702 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e5248c131348cc3113efe806", "attempt_id": "c21128f3a8ca", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:20.996171Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11090, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1580.553749925457, "ttft_ms": 14.760249992832541, "decode_ms": 14.734375057742}, "total_wall_ms": 1626.2187079992145, "ttft_ms": 14.760249992832541, "input_usage": {"receiver_prompt_tokens": 11090}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1704787968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4323500472, "process_rss_bytes": 1704787968}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 703 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "98f739e3ad2adf577c9ffb88", "attempt_id": "1930c3765503", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:22.652546Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11088, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1581.8522500339895, "ttft_ms": 14.670540927909315, "decode_ms": 14.461584039963782}, "total_wall_ms": 1627.1064999746159, "ttft_ms": 14.670540927909315, "input_usage": {"receiver_prompt_tokens": 11088}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1704787968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4797424056, "process_rss_bytes": 1704787968}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 704 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cbb6205d6fc1d38aedbc9465", "attempt_id": "7faacc2593fc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:24.309748Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11103, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1619.7001660475507, "ttft_ms": 15.358750009909272, "decode_ms": 101.65120894089341}, "total_wall_ms": 1753.160750027746, "ttft_ms": 15.358750009909272, "input_usage": {"receiver_prompt_tokens": 11103}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1704787968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5325808056, "process_rss_bytes": 1704787968}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8508495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "1631a1c1b7ddd3a971272192b1311a17ebdc73a0a91e344eff710c7dc80d7fae"} | ||||
| 705 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e842792599c950f7d36b3968", "attempt_id": "5604040e485d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:26.092925Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11098, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1571.00450003054, "ttft_ms": 14.847708982415497, "decode_ms": 101.32891696412116}, "total_wall_ms": 1703.7634159205481, "ttft_ms": 14.847708982415497, "input_usage": {"receiver_prompt_tokens": 11098}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1704787968, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5713945016, "process_rss_bytes": 1704787968}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "399,010", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "2faf9e33010eea3c1ce04111c66169764f8106b978560e4e04b529b48b10820f"} | ||||
| 706 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5d1c8e8509ec69d89a997e4", "attempt_id": "c1dd6997398f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:27.826778Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11106, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1570.6239169230685, "ttft_ms": 14.956999919377267, "decode_ms": 101.23258305247873}, "total_wall_ms": 1703.2429159153253, "ttft_ms": 14.956999919377267, "input_usage": {"receiver_prompt_tokens": 11106}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1704804352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6252765624, "process_rss_bytes": 1704804352}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Dradrawen-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "076ae4e439223f035d7ae5d706e7b20f026fb4720184ee4f24b43aed0556c07e"} | ||||
| 707 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a70991eea5f188c19c2a1bd5", "attempt_id": "9099aceac1ae", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:29.560277Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11099, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1613.2558750687167, "ttft_ms": 15.006458037532866, "decode_ms": 114.80962496716529}, "total_wall_ms": 1759.1607079375535, "ttft_ms": 15.006458037532866, "input_usage": {"receiver_prompt_tokens": 11099}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1704804352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6605971896, "process_rss_bytes": 1704804352}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "24444482", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "3a582541908648d657cb6b86a110c155c97c25172c3a3b375e346231604af64c"} | ||||
| 708 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "30ffffdecd3f90e5cfa5b8b3", "attempt_id": "f85aaff4f671", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:31.350259Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11094, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1565.320875030011, "ttft_ms": 14.56308295018971, "decode_ms": 101.00437491200864}, "total_wall_ms": 1697.2133750095963, "ttft_ms": 14.56308295018971, "input_usage": {"receiver_prompt_tokens": 11094}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1704804352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6957310392, "process_rss_bytes": 1704804352}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1054600", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "c6146fc5270901cd1e938df8ff97e50e216d91bb92dc20da9e5065c409c043ec"} | ||||
| 709 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7d72a3ee3976a4ad43a9d5d3", "attempt_id": "3d272775994e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:33.077854Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11099, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1569.97508299537, "ttft_ms": 14.67733399476856, "decode_ms": 14.81449999846518}, "total_wall_ms": 1615.8748749876395, "ttft_ms": 14.67733399476856, "input_usage": {"receiver_prompt_tokens": 11099}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1704804352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6957310392, "process_rss_bytes": 1704804352}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 710 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "34077a5bef484d5a4b6b8b2c", "attempt_id": "127da427693e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:34.724508Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 11101, "message_tokens": 11013, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.02716702874749899, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1619.6306669153273, "ttft_ms": 14.779041986912489, "decode_ms": 14.445125008933246}, "total_wall_ms": 1665.171290980652, "ttft_ms": 14.779041986912489, "input_usage": {"receiver_prompt_tokens": 11101}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1704804352, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 7311401400, "process_rss_bytes": 1704804352}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 711 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38cc0105c4cf10a21f1c9e0c", "attempt_id": "36842ebb065d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:44.102487Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 513, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.9385830052197, "ttft_ms": 13.575167045928538, "decode_ms": 65.75366703327745}, "total_wall_ms": 139.87570896279067, "ttft_ms": 13.575167045928538, "input_usage": {"receiver_prompt_tokens": 513, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12928736316, "mlx_cache_bytes": 8976076216, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12928736316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "MAT230M", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "a255443d98251e7ddd97eff5c1493f74bdb388cea4684ad56d2c763af323ca00"} | ||||
| 712 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "88e67c5aacd284feb9aed071", "attempt_id": "0d8d3e079bc2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:44.273993Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 506, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.055375025607646, "ttft_ms": 13.151707942597568, "decode_ms": 13.347500003874302}, "total_wall_ms": 83.68699997663498, "ttft_ms": 13.151707942597568, "input_usage": {"receiver_prompt_tokens": 506, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12952198232, "mlx_cache_bytes": 9187233208, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12952198232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 713 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea872b26fea5bc968e8da2a6", "attempt_id": "b42dbfbed95c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:44.387950Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 504, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.15858291275799, "ttft_ms": 13.193459017202258, "decode_ms": 13.078166986815631}, "total_wall_ms": 83.54183402843773, "ttft_ms": 13.193459017202258, "input_usage": {"receiver_prompt_tokens": 504, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12926868568, "mlx_cache_bytes": 9481063864, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12926868568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 714 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e8c963d8217118b2b363e454", "attempt_id": "df186b7d3b99", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:44.501424Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 519, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.35108301229775, "ttft_ms": 13.304457999765873, "decode_ms": 13.338375021703541}, "total_wall_ms": 92.11895905900747, "ttft_ms": 13.304457999765873, "input_usage": {"receiver_prompt_tokens": 519, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12945581144, "mlx_cache_bytes": 9801731512, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12945581144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 715 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5d2a192bdd6a57c7a72ddb58", "attempt_id": "3c346219fbb4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:44.623534Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 514, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.23433299642056, "ttft_ms": 13.129540951922536, "decode_ms": 13.194457977078855}, "total_wall_ms": 91.71770804096013, "ttft_ms": 13.129540951922536, "input_usage": {"receiver_prompt_tokens": 514, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12960965744, "mlx_cache_bytes": 10032106936, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12960965744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 716 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e778bb59d9c9e3ddb5445e8a", "attempt_id": "6ecb928a7ce4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:44.744842Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 522, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.49308397714049, "ttft_ms": 13.429584098048508, "decode_ms": 92.220832942985}, "total_wall_ms": 171.30116699263453, "ttft_ms": 13.429584098048508, "input_usage": {"receiver_prompt_tokens": 522, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12947743832, "mlx_cache_bytes": 10349923768, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12947743832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Dradrawen-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "076ae4e439223f035d7ae5d706e7b20f026fb4720184ee4f24b43aed0556c07e"} | ||||
| 717 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85faa4eeff4ee140e37e2704", "attempt_id": "3f3c9c9b202a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:44.946194Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 515, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.21845802105963, "ttft_ms": 13.272666954435408, "decode_ms": 13.239750056527555}, "total_wall_ms": 91.85704204719514, "ttft_ms": 13.272666954435408, "input_usage": {"receiver_prompt_tokens": 515, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12960703576, "mlx_cache_bytes": 10561572280, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12960703576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 718 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f86960798b12d4b892c4591a", "attempt_id": "4989a026aba4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:45.067945Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 510, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.38825008645654, "ttft_ms": 13.183917035348713, "decode_ms": 13.152999919839203}, "total_wall_ms": 83.92516593448818, "ttft_ms": 13.183917035348713, "input_usage": {"receiver_prompt_tokens": 510, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12930702424, "mlx_cache_bytes": 10771156408, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12930702424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 719 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cb2b6374d66cdab8faa7a64b", "attempt_id": "7e03f2b81caa", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:45.181466Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 515, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.34375001117587, "ttft_ms": 13.283042004331946, "decode_ms": 13.184292009100318}, "total_wall_ms": 91.9350830372423, "ttft_ms": 13.283042004331946, "input_usage": {"receiver_prompt_tokens": 515, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12960703576, "mlx_cache_bytes": 10771156408, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12960703576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 720 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f5d432171b11b20e89fe140", "attempt_id": "bfbb1a56fc47", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:45.303229Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 517, "message_tokens": 425, "message_utf8_bytes": 2083, "cache_tensor_bytes": null, "serialized_payload_bytes": 2083, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7682.322500040755, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.27683401852846, "ttft_ms": 13.09537491761148, "decode_ms": 13.213166035711765}, "total_wall_ms": 91.71325003262609, "ttft_ms": 13.09537491761148, "input_usage": {"receiver_prompt_tokens": 517, "sender_input_tokens": 11129, "sender_output_tokens": 425, "sender_prefill_ms": 1584.7469998989254, "sender_ttft_ms": 14.903791947290301, "sender_decode_ms": 6074.609957984649}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705181184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12944548952, "mlx_cache_bytes": 10983689656, "process_rss_bytes": 1705181184}, "peak_prefill_memory": null, "peak_decode_memory": 12944548952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ddd9e86a8f5b3117741f83b87d14d4bb4c41f49549c52e841db584171e9d010a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 721 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49a72794af3248f3b00bbbc2", "attempt_id": "c5071d854f7b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:54.229430Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 420, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.96179098170251, "ttft_ms": 13.233750010840595, "decode_ms": 13.254999998025596}, "total_wall_ms": 81.38600003439933, "ttft_ms": 13.233750010840595, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950215792, "mlx_cache_bytes": 11901029816, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12950215792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 722 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "898b18df37fb9a7f38913106", "attempt_id": "d2e75b1dc224", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:54.341533Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 413, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.407082985155284, "ttft_ms": 13.004333944991231, "decode_ms": 13.224832946434617}, "total_wall_ms": 79.46666609495878, "ttft_ms": 13.004333944991231, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12944481392, "mlx_cache_bytes": 12223450552, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12944481392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 723 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d8f0346d527860910bbc0ee8", "attempt_id": "4fd4cf64eeb9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:54.451647Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 411, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.89808295108378, "ttft_ms": 12.966874986886978, "decode_ms": 12.997834011912346}, "total_wall_ms": 78.68349994532764, "ttft_ms": 12.966874986886978, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12943301744, "mlx_cache_bytes": 12448501176, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12943301744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 724 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f16f5903564db5c4f676b94a", "attempt_id": "703e9d8046b6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:54.560197Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 426, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.59491694252938, "ttft_ms": 13.472917024046183, "decode_ms": 13.449707999825478}, "total_wall_ms": 81.4277499448508, "ttft_ms": 13.472917024046183, "input_usage": {"receiver_prompt_tokens": 426, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12959063152, "mlx_cache_bytes": 12761091512, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12959063152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 725 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c3b0be4f29d7d6b19409faf", "attempt_id": "2545353e4990", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:54.671704Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 421, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.42812498565763, "ttft_ms": 13.009417103603482, "decode_ms": 92.69441699143499}, "total_wall_ms": 159.98729201965034, "ttft_ms": 13.009417103603482, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950609008, "mlx_cache_bytes": 12991778232, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12950609008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "715,410", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "5ec7bc520bb2fe3c1db7665fa8edfb5b893c76c81c567855debed25fbeff215e"} | ||||
| 726 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3495d53e54faf0c9b0a8ed79", "attempt_id": "6407ec3c8f77", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:54.861391Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 429, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.52600000333041, "ttft_ms": 13.165000011213124, "decode_ms": 13.172624981962144}, "total_wall_ms": 80.75412502512336, "ttft_ms": 13.165000011213124, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12957080688, "mlx_cache_bytes": 13226921400, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12957080688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 727 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f14232ae00c882fb8ec87bd9", "attempt_id": "b48da05817a8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:54.971925Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 422, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.514375002123415, "ttft_ms": 13.169208075851202, "decode_ms": 79.88654100336134}, "total_wall_ms": 147.4299170076847, "ttft_ms": 13.169208075851202, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12960291940, "mlx_cache_bytes": 13470354872, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12960291940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "617950", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "8df15246b1726bee653db5e0fae9e01a83132693d7dab9eaa309749116e2c3c4"} | ||||
| 728 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ea5de4d5f951b1f722cfa48", "attempt_id": "4c75a3d52177", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:55.149746Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 417, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.46820796653628, "ttft_ms": 13.46524991095066, "decode_ms": 14.051957987248898}, "total_wall_ms": 79.80349997524172, "ttft_ms": 13.46524991095066, "input_usage": {"receiver_prompt_tokens": 417, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12948249712, "mlx_cache_bytes": 13698682296, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12948249712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 729 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bfd683bd781aa115caf96b2a", "attempt_id": "f2a625581d3f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:55.259627Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 422, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.48716699518263, "ttft_ms": 13.662375044077635, "decode_ms": 13.324707979336381}, "total_wall_ms": 81.33433409966528, "ttft_ms": 13.662375044077635, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12939467888, "mlx_cache_bytes": 13698682296, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12939467888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 730 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a745dec6671a1db5bb1d0b79", "attempt_id": "b43e18aad03e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:55.370386Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 424, "message_tokens": 320, "message_utf8_bytes": 751, "cache_tensor_bytes": null, "serialized_payload_bytes": 751, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8804.13608404342, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.61812503542751, "ttft_ms": 13.525084010325372, "decode_ms": 13.561666943132877}, "total_wall_ms": 81.53416600544006, "ttft_ms": 13.525084010325372, "input_usage": {"receiver_prompt_tokens": 424, "sender_input_tokens": 11157, "sender_output_tokens": 512, "sender_prefill_ms": 1486.1722079804167, "sender_ttft_ms": 14.581625000573695, "sender_decode_ms": 7294.00554089807}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705213952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12940500080, "mlx_cache_bytes": 13902024120, "process_rss_bytes": 1705213952}, "peak_prefill_memory": null, "peak_decode_memory": 12940500080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "370970580dd3db64fa2c622ef7d7219a3395ee350b45221317d305e359522c39", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 731 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "90df132565cda33349f2c34e", "attempt_id": "6c2abe3421ab", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:55.489908Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 597, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.18620800226927, "ttft_ms": 13.355165952816606, "decode_ms": 13.213291997089982}, "total_wall_ms": 97.72229206282645, "ttft_ms": 13.355165952816606, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705230336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 14269648312, "process_rss_bytes": 1705230336}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 732 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c60aecb1bf2c19af8fd370f6", "attempt_id": "60231ccb5546", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:55.617556Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 590, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.85687499400228, "ttft_ms": 13.586292043328285, "decode_ms": 13.202500063925982}, "total_wall_ms": 97.65925002284348, "ttft_ms": 13.586292043328285, "input_usage": {"receiver_prompt_tokens": 590}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705230336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009790040, "mlx_cache_bytes": 14534086072, "process_rss_bytes": 1705230336}, "peak_prefill_memory": null, "peak_decode_memory": 13009790040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 733 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d601f9032d12377181664653", "attempt_id": "8507eddbf527", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:55.745718Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 588, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.84850007575005, "ttft_ms": 13.44483403954655, "decode_ms": 13.398499926552176}, "total_wall_ms": 97.75129100307822, "ttft_ms": 13.44483403954655, "input_usage": {"receiver_prompt_tokens": 588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705230336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13000336472, "mlx_cache_bytes": 14867336632, "process_rss_bytes": 1705230336}, "peak_prefill_memory": null, "peak_decode_memory": 13000336472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 734 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f3bfc62d2b797858071a289", "attempt_id": "d434f91052e1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:55.873831Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.41391602251679, "ttft_ms": 14.001583098433912, "decode_ms": 92.6282920408994}, "total_wall_ms": 178.1343329930678, "ttft_ms": 14.001583098433912, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1705230336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 15234010552, "process_rss_bytes": 1705230336}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8563210", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "c029262bb599cffb50a549551889b25e9aef1163924335cbd6216067c8e4a042"} | ||||
| 735 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f0b3a208fd82295996d165a1", "attempt_id": "dbca421dfc47", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:56.082308Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.15312509611249, "ttft_ms": 13.259166036732495, "decode_ms": 79.9466249300167}, "total_wall_ms": 164.39091600477695, "ttft_ms": 13.259166036732495, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1705230336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13014770776, "mlx_cache_bytes": 15502085560, "process_rss_bytes": 1705230336}, "peak_prefill_memory": null, "peak_decode_memory": 13014770776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "398260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "6be162d8892e08b594e0dd5cc1c20c3589b454ac38d3997540eac44ad72dc998"} | ||||
| 736 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd9a759ee590963874d78eb1", "attempt_id": "e595193f3da7", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:56.281497Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 606, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.54912496823817, "ttft_ms": 13.273749966174364, "decode_ms": 93.0211249506101}, "total_wall_ms": 177.89329099468887, "ttft_ms": 13.273749966174364, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1705246720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996666456, "mlx_cache_bytes": 15855783352, "process_rss_bytes": 1705246720}, "peak_prefill_memory": null, "peak_decode_memory": 12996666456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Dradrawen-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "076ae4e439223f035d7ae5d706e7b20f026fb4720184ee4f24b43aed0556c07e"} | ||||
| 737 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e7764a0a241174a499efbc19", "attempt_id": "a8cab1fe6ccc", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:56.489863Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.11808303650469, "ttft_ms": 13.468833058141172, "decode_ms": 132.3889580089599}, "total_wall_ms": 217.03449997585267, "ttft_ms": 13.468833058141172, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1705246720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012591704, "mlx_cache_bytes": 16102034872, "process_rss_bytes": 1705246720}, "peak_prefill_memory": null, "peak_decode_memory": 13012591704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,000,000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "1476fd07ef61145d484f5a2e0b4e8e7db4ac3620541c0b406782a4673ce4405f"} | ||||
| 738 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85c40b0601a353e53624f9d3", "attempt_id": "9d890e27a1a7", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:56.737694Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 594, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.77233302313834, "ttft_ms": 13.353749993257225, "decode_ms": 13.311500078998506}, "total_wall_ms": 97.47808403335512, "ttft_ms": 13.353749993257225, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705246720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12991980632, "mlx_cache_bytes": 16346222008, "process_rss_bytes": 1705246720}, "peak_prefill_memory": null, "peak_decode_memory": 12991980632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 739 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c9f35ab40d7d1650cecfbccc", "attempt_id": "6af310d14739", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:56.865238Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.07541693747044, "ttft_ms": 13.5451250243932, "decode_ms": 14.420959050767124}, "total_wall_ms": 99.0285410080105, "ttft_ms": 13.5451250243932, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705246720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012591704, "mlx_cache_bytes": 16346222008, "process_rss_bytes": 1705246720}, "peak_prefill_memory": null, "peak_decode_memory": 13012591704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 740 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "153141ac1af93c23af8e5ee7", "attempt_id": "c6f60d4c96db", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:56.994133Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1262, "cache_tensor_bytes": null, "serialized_payload_bytes": 1262, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.7870829263702035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.12004207354039, "ttft_ms": 13.510167016647756, "decode_ms": 13.45075003337115}, "total_wall_ms": 98.15708303358406, "ttft_ms": 13.510167016647756, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1705246720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993684568, "mlx_cache_bytes": 16593358264, "process_rss_bytes": 1705246720}, "peak_prefill_memory": null, "peak_decode_memory": 12993684568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81cc3520a853176f6de20751c144712107e4e20bb8781ec41079730ae45a7f0a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 741 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "68a20f37d03d432f9e6ce5fd", "attempt_id": "ad330324f060", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:58.853821Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 45, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.7982089193537831, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.532291021198034, "ttft_ms": 32.532291021198034, "decode_ms": 42.88791702128947}, "total_wall_ms": 85.2066669613123, "ttft_ms": 32.532291021198034, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1764671488, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13279745268, "mlx_cache_bytes": 16816262945, "process_rss_bytes": 1764671488}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13279745268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NotProvided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "a8da256cab6983d83636f7a669ac93f2dde30127260d7d17103e68ec8141c0e4"} | ||||
| 742 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa6f312d15650149854e1e05", "attempt_id": "3805fbad8f96", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:58.970133Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 38, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.930291997268796, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.417540973052382, "ttft_ms": 31.417540973052382, "decode_ms": 14.203375088982284}, "total_wall_ms": 56.08887504786253, "ttft_ms": 31.417540973052382, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1761017856, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13273781492, "mlx_cache_bytes": 16839675681, "process_rss_bytes": 1761017856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273781492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 743 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ca40c9834624ef9a37258715", "attempt_id": "01ffe693d640", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:59.056703Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 36, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.8997500883415341, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.51241603679955, "ttft_ms": 30.51241603679955, "decode_ms": 13.955708011053503}, "total_wall_ms": 54.414041922427714, "ttft_ms": 30.51241603679955, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1760395264, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13272159476, "mlx_cache_bytes": 16865070881, "process_rss_bytes": 1760395264}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272159476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 744 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f87344e93a6965a2a32693ba", "attempt_id": "77e7ca9abd03", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:59.141579Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 51, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.9608750008046627, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.096667003817856, "ttft_ms": 30.096667003817856, "decode_ms": 113.63445897586644}, "total_wall_ms": 153.6014579469338, "ttft_ms": 30.096667003817856, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 51}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1642102784, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13285381388, "mlx_cache_bytes": 17040134329, "process_rss_bytes": 1642102784}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13285381388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10000000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "fa95b43be4cf8bb030d85e663324ecc5247c2af6272672bfd4bbc1020b40582b"} | ||||
| 745 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eb1d0df1085e515d39866d80", "attempt_id": "017c6e36c846", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:59.324825Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 46, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.906166085973382, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.714749988168478, "ttft_ms": 31.714749988168478, "decode_ms": 97.67804201692343}, "total_wall_ms": 139.8443749640137, "ttft_ms": 31.714749988168478, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1641873408, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13280318732, "mlx_cache_bytes": 17073590457, "process_rss_bytes": 1641873408}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280318732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9390225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "a910b8d3c85f78da1e7b7378ffe22c97777e42beb221ab142ddd2add0e3fa1bc"} | ||||
| 746 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb45eeea1626b97add4f8fad", "attempt_id": "eb3bb24e933d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:59.494573Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 54, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 2.022417029365897, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.979292049072683, "ttft_ms": 31.979292049072683, "decode_ms": 74.73041594494134}, "total_wall_ms": 117.14024993125349, "ttft_ms": 31.979292049072683, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1296334848, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13288543512, "mlx_cache_bytes": 17119072873, "process_rss_bytes": 1296334848}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13288543512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "841949370899ae54bd62052c2e4322335615fa29894321478d7c9ae44c157ecd"} | ||||
| 747 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "70a8a22fff5338471b4605ad", "attempt_id": "c5c43fa41f7b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:59.643053Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 47, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.9642079714685678, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.48516605142504, "ttft_ms": 31.48516605142504, "decode_ms": 120.49237499013543}, "total_wall_ms": 162.5130419852212, "ttft_ms": 31.48516605142504, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1218101248, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13281170700, "mlx_cache_bytes": 17133359721, "process_rss_bytes": 1218101248}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13281170700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10084510", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "9e00b4e250e07d350339961261b105504d4034f815b647a2f9dd554849a7556f"} | ||||
| 748 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5bbe59da795acbfa67a87df3", "attempt_id": "0c22581204dc", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:59.839063Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 42, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.5884590102359653, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.107583014294505, "ttft_ms": 32.107583014294505, "decode_ms": 71.41645799856633}, "total_wall_ms": 114.50208304449916, "ttft_ms": 32.107583014294505, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 42}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1218101248, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13280728308, "mlx_cache_bytes": 17164112489, "process_rss_bytes": 1218101248}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280728308, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "5994471abb01112afcc18159f6cc74b4f511b99806da59b3caf5a9c173cacfc5"} | ||||
| 749 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "419872aab4ba7e16aac234ad", "attempt_id": "caa012a7bd6a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:49:59.988417Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 47, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 1.539084012620151, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.00541704427451, "ttft_ms": 32.00541704427451, "decode_ms": 14.814833062700927}, "total_wall_ms": 56.95066601037979, "ttft_ms": 32.00541704427451, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1218101248, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13281170700, "mlx_cache_bytes": 17164112489, "process_rss_bytes": 1218101248}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13281170700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 750 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e5b66497b570e976288261b6", "attempt_id": "7e1bb3c110bb", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:00.076617Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11052, "keep": 2763, "compress_ms": 11.569624999538064}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 49, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871512, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1731.4847499364987, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 11.605957988649607, "serialize_ms": 51.17379198782146, "load_ms": 5.154250073246658, "receiver_prefill_ms": 0.0, "query_prefill_ms": 337.8404169343412, "ttft_ms": 337.8404169343412, "decode_ms": 19.45058291312307}, "total_wall_ms": 373.1514160754159, "ttft_ms": 337.8404169343412, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119961088, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13284332812, "mlx_cache_bytes": 17185493609, "process_rss_bytes": 1119961088}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13284332812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "697ac4d4e784a02cfde024a1b68253c642dc639dbcbde02413508a2529e9b829", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 751 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0ef4f8863a0697d03a3a2e7f", "attempt_id": "7a6c1a330678", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:01.291663Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 45, "compress_ms": 304.7600000863895}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 45, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 338.3401669561863, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 313.75154096167535, "serialize_ms": 24.29758303333074, "load_ms": 1.1885829735547304, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.14233394525945, "ttft_ms": 35.14233394525945, "decode_ms": 154.12166598252952}, "total_wall_ms": 537.629917031154, "ttft_ms": 35.14233394525945, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1220444160, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13279745268, "mlx_cache_bytes": 18039034609, "process_rss_bytes": 1220444160}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13279745268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-56F-6105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "ce19f1de10dcab0eee002d716faa220946d8af410293bc2f7e9d058712b49180"} | ||||
| 752 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "886ec57e56e51359aadbb902", "attempt_id": "88b59972b6ef", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:01.876000Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 38, "compress_ms": 88.8231669086963}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 38, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871550, "side_information_bytes": 16318, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 123.27691598329693, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 97.34612505417317, "serialize_ms": 25.671125040389597, "load_ms": 1.2863329611718655, "receiver_prefill_ms": 0.0, "query_prefill_ms": 33.104792004451156, "ttft_ms": 33.104792004451156, "decode_ms": 14.728124951943755}, "total_wall_ms": 180.83349999506027, "ttft_ms": 33.104792004451156, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1323106304, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13273814260, "mlx_cache_bytes": 18079552241, "process_rss_bytes": 1323106304}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273814260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3d53cc5dcee0422235603253e63bad89cc70e3c6b37fa986761b7702097b0913", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 753 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "55f5eae7e98893358a3e06e9", "attempt_id": "c6166fa6fd59", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:02.095896Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 36, "compress_ms": 88.60662509687245}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 36, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 118.23770799674094, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 98.69883302599192, "serialize_ms": 19.299124949611723, "load_ms": 1.243041013367474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.664624995552003, "ttft_ms": 30.664624995552003, "decode_ms": 14.608082943595946}, "total_wall_ms": 173.27804199885577, "ttft_ms": 30.664624995552003, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1323139072, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13272159476, "mlx_cache_bytes": 18105029361, "process_rss_bytes": 1323139072}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272159476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 754 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f2ac7febaced6ef65a40f9ee", "attempt_id": "0c78db176a48", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:02.301629Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 51, "compress_ms": 93.13987498171628}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 51, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 119.33091701939702, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 101.6016670037061, "serialize_ms": 17.4950830405578, "load_ms": 1.4202080201357603, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.298916924744844, "ttft_ms": 29.298916924744844, "decode_ms": 97.84800000488758}, "total_wall_ms": 256.1242920346558, "ttft_ms": 29.298916924744844, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 51}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1323171840, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13284545804, "mlx_cache_bytes": 18145039089, "process_rss_bytes": 1323171840}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13284545804, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8508495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "1631a1c1b7ddd3a971272192b1311a17ebdc73a0a91e344eff710c7dc80d7fae"} | ||||
| 755 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "284ddd9589511559379de1ac", "attempt_id": "da1c31f472b7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:02.589504Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 46, "compress_ms": 93.95762498024851}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 46, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 120.81533297896385, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 102.55433304701, "serialize_ms": 18.034667009487748, "load_ms": 0.7780420128256083, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.929542030207813, "ttft_ms": 30.929542030207813, "decode_ms": 97.88462496362627}, "total_wall_ms": 258.73474997933954, "ttft_ms": 30.929542030207813, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1323204608, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13280318732, "mlx_cache_bytes": 18178757361, "process_rss_bytes": 1323204608}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280318732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "399,010", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "2faf9e33010eea3c1ce04111c66169764f8106b978560e4e04b529b48b10820f"} | ||||
| 756 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f6f27e9891fc6b34fdb1e178", "attempt_id": "b72887f9cd60", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:02.879455Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 54, "compress_ms": 93.06629095226526}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 54, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 118.86549997143447, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 101.01866698823869, "serialize_ms": 17.62341591529548, "load_ms": 1.7277919687330723, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.43016605079174, "ttft_ms": 30.43016605079174, "decode_ms": 98.4681670088321}, "total_wall_ms": 261.4622919354588, "ttft_ms": 30.43016605079174, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1323253760, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13288543512, "mlx_cache_bytes": 18233217777, "process_rss_bytes": 1323253760}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13288543512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Dradrawen-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "076ae4e439223f035d7ae5d706e7b20f026fb4720184ee4f24b43aed0556c07e"} | ||||
| 757 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "46f5ef3240b609edbe0f3941", "attempt_id": "a7cd1ea50d76", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:03.172886Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 47, "compress_ms": 92.48179104179144}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 47, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 119.4504159502685, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 100.9121669922024, "serialize_ms": 18.313375068828464, "load_ms": 1.7389589920639992, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.83741699811071, "ttft_ms": 30.83741699811071, "decode_ms": 97.89904206991196}, "total_wall_ms": 258.11179098673165, "ttft_ms": 30.83741699811071, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1323270144, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13281170700, "mlx_cache_bytes": 18266477297, "process_rss_bytes": 1323270144}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13281170700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2434448", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "9ecda3d5613446b6ab18720ac3b3c9ef74826589e68119ee0df3f531c15cff5f"} | ||||
| 758 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a614b3b59032c7a3ef8c21f7", "attempt_id": "0b1b61a91451", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:03.463022Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 42, "compress_ms": 89.66337493620813}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 42, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.5420410213992, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 97.6271249819547, "serialize_ms": 17.688249936327338, "load_ms": 1.5804159920662642, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.47045797575265, "ttft_ms": 30.47045797575265, "decode_ms": 111.95437505375594}, "total_wall_ms": 267.7261249627918, "ttft_ms": 30.47045797575265, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 42}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1323270144, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13278287092, "mlx_cache_bytes": 18304209649, "process_rss_bytes": 1323270144}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13278287092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11250000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "d1157524b0cdc9573ebda6b0dd5738576be4d7f135648e11d53b7608d2aa2f14"} | ||||
| 759 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "34d5d0723896e6dc24bbfa39", "attempt_id": "68a68f9aca7a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:03.762487Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 47, "compress_ms": 89.72358296159655}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 47, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.87537499144673, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 98.18662505131215, "serialize_ms": 17.450292012654245, "load_ms": 1.5763749834150076, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.87183295469731, "ttft_ms": 32.87183295469731, "decode_ms": 13.92245793249458}, "total_wall_ms": 172.44887491688132, "ttft_ms": 32.87183295469731, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1323302912, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13281170700, "mlx_cache_bytes": 18304209649, "process_rss_bytes": 1323302912}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13281170700, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 760 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e53b8c35862b46f80d1fde7", "attempt_id": "2c89baed680f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:03.966033Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11052, "keep": 2763, "window_tokens": 49, "compress_ms": 92.80395798850805}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 49, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 101855232, "serialized_payload_bytes": 101871551, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 121.4136250782758, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 100.78154096845537, "serialize_ms": 20.40870802011341, "load_ms": 1.5211669960990548, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.816083980724216, "ttft_ms": 27.816083980724216, "decode_ms": 14.065542025491595}, "total_wall_ms": 172.9667909676209, "ttft_ms": 27.816083980724216, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1323335680, "backend_memory": {"mlx_active_bytes": 13219058696, "mlx_peak_bytes": 13283153164, "mlx_cache_bytes": 18339287793, "process_rss_bytes": 1323335680}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13283153164, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64f5a020f53371452002775af04ebf69bd3a9713db6de2045a28581ea24fa5bd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 761 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f23d944b75d66c7320487030", "attempt_id": "3013efbe0c25", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:04.930721Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 45, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 5.478500039316714, "receiver_prefill_ms": 0.0, "query_prefill_ms": 45.8664579782635, "ttft_ms": 45.8664579782635, "decode_ms": 162.80029097106308}, "total_wall_ms": 222.71387500222772, "ttft_ms": 45.8664579782635, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1758248960, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13655742161, "mlx_cache_bytes": 18933066689, "process_rss_bytes": 1758248960}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13655742161, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-56F-6105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "ce19f1de10dcab0eee002d716faa220946d8af410293bc2f7e9d058712b49180"} | ||||
| 762 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "37a700bc31d9b0745e6316f3", "attempt_id": "874a5c82339f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:05.185661Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 38, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.325542038306594, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.03100008331239, "ttft_ms": 36.03100008331239, "decode_ms": 16.161166946403682}, "total_wall_ms": 62.5647910637781, "ttft_ms": 36.03100008331239, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1758248960, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13631559377, "mlx_cache_bytes": 19041070017, "process_rss_bytes": 1758248960}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13631559377, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 763 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d6da20ef8e6a4f5909d01830", "attempt_id": "f4c979d4110f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:05.279255Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 36, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.7372499462217093, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.85383396036923, "ttft_ms": 34.85383396036923, "decode_ms": 16.274207970127463}, "total_wall_ms": 61.90550001338124, "ttft_ms": 34.85383396036923, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1758248960, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13624776401, "mlx_cache_bytes": 19143715777, "process_rss_bytes": 1758248960}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13624776401, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 764 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "de6437afaf8327531346b49a", "attempt_id": "ec539b700782", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:05.372029Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 51, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 1.7522500129416585, "receiver_prefill_ms": 0.0, "query_prefill_ms": 40.37612501997501, "ttft_ms": 40.37612501997501, "decode_ms": 113.39595797471702}, "total_wall_ms": 164.14962499402463, "ttft_ms": 40.37612501997501, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 51}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1758265344, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13675897249, "mlx_cache_bytes": 19289834001, "process_rss_bytes": 1758265344}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13675897249, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8508495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "1631a1c1b7ddd3a971272192b1311a17ebdc73a0a91e344eff710c7dc80d7fae"} | ||||
| 765 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f84aad2cffaa005dd23dfc66", "attempt_id": "e293ddbb681a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:05.566923Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 46, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.8418749570846558, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.785292089916766, "ttft_ms": 36.785292089916766, "decode_ms": 114.51083410065621}, "total_wall_ms": 162.21845790278167, "ttft_ms": 36.785292089916766, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1758265344, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13658874273, "mlx_cache_bytes": 19420643857, "process_rss_bytes": 1758265344}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13658874273, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "399,010", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "2faf9e33010eea3c1ce04111c66169764f8106b978560e4e04b529b48b10820f"} | ||||
| 766 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3d8487dba5d38dcd2041032e", "attempt_id": "c0345ac6d05a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:05.759329Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 54, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.336791018024087, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.91083302348852, "ttft_ms": 37.91083302348852, "decode_ms": 113.65316598676145}, "total_wall_ms": 162.60750009678304, "ttft_ms": 37.91083302348852, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1758265344, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13686645513, "mlx_cache_bytes": 19575478705, "process_rss_bytes": 1758265344}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13686645513, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Dradrawen-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "076ae4e439223f035d7ae5d706e7b20f026fb4720184ee4f24b43aed0556c07e"} | ||||
| 767 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ef0ff9a26f0f01c417687916", "attempt_id": "bd54cacd0c9b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:05.953020Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 47, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.2083340445533395, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.27670793887228, "ttft_ms": 37.27670793887228, "decode_ms": 129.83737501781434}, "total_wall_ms": 178.10100002679974, "ttft_ms": 37.27670793887228, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1758265344, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13662117185, "mlx_cache_bytes": 19709041073, "process_rss_bytes": 1758265344}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13662117185, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "24444482", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "3a582541908648d657cb6b86a110c155c97c25172c3a3b375e346231604af64c"} | ||||
| 768 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c3a4f303a905fcefe7327ca5", "attempt_id": "94f6c6e64a5a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:06.161335Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 42, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.48970789834857, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.333999945782125, "ttft_ms": 36.333999945782125, "decode_ms": 129.51941706705838}, "total_wall_ms": 176.86362494714558, "ttft_ms": 36.333999945782125, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 42}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1758265344, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13647515617, "mlx_cache_bytes": 19828447665, "process_rss_bytes": 1758265344}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13647515617, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11231600", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "6ae9a281b303c3fbdb58a4de118ada2469378ea6cdc3e88958f8e5ec67354599"} | ||||
| 769 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85cb4a31e8275fdd5e5a230b", "attempt_id": "067713975928", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:06.369539Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 47, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.758875023573637, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.668832995928824, "ttft_ms": 36.668832995928824, "decode_ms": 16.52375003322959}, "total_wall_ms": 64.496791921556, "ttft_ms": 36.668832995928824, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1758265344, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13662117185, "mlx_cache_bytes": 19828447665, "process_rss_bytes": 1758265344}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13662117185, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 770 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "154bf23fb6f2496e4f849eb2", "attempt_id": "35c173527c3e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:06.464115Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13230855176}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11013, "source_tokens_receiver": 11013, "query_tokens": 49, "message_tokens": 11052, "message_utf8_bytes": 58870, "cache_tensor_bytes": 216442368, "serialized_payload_bytes": 216477444, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 760.1001251023263, "doc_prefill_ms": 1650.9872080059722, "compress_ms": 17.605542088858783, "serialize_ms": 742.0565419597551, "load_ms": 2.6880829827859998, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.36216702964157, "ttft_ms": 37.36216702964157, "decode_ms": 16.31779200397432}, "total_wall_ms": 64.97220799792558, "ttft_ms": 37.36216702964157, "input_usage": {"receiver_prefix_tokens": 11052, "dense_cache_bytes": 407420928, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1758265344, "backend_memory": {"mlx_active_bytes": 13450269704, "mlx_peak_bytes": 13669522753, "mlx_cache_bytes": 19967777201, "process_rss_bytes": 1758265344}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13669522753, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fb02abef5442920902eb113e95dc2706ff8994d8cb72fa453994a2441e4e6411", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 771 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b25d41ea4dee72229a736836", "attempt_id": "429f8525ffc8", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:07.251884Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10886, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2822.7836668957025, "ttft_ms": 16.83304097969085, "decode_ms": 115.21499999798834}, "total_wall_ms": 2975.000499980524, "ttft_ms": 16.83304097969085, "input_usage": {"receiver_prompt_tokens": 10886}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1203830784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14284346432, "mlx_cache_bytes": 6183723352, "process_rss_bytes": 1203830784}, "peak_prefill_memory": null, "peak_decode_memory": 14284346432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-56F-6105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "ce19f1de10dcab0eee002d716faa220946d8af410293bc2f7e9d058712b49180"} | ||||
| 772 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9b4669b9b61f2d6a8faf48dd", "attempt_id": "a80f14bd3d61", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:10.265240Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10880, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1653.574249939993, "ttft_ms": 16.969250049442053, "decode_ms": 32.99741598311812}, "total_wall_ms": 1718.4853330254555, "ttft_ms": 16.969250049442053, "input_usage": {"receiver_prompt_tokens": 10880}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1203830784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14282314816, "mlx_cache_bytes": 6423454040, "process_rss_bytes": 1203830784}, "peak_prefill_memory": null, "peak_decode_memory": 14282314816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 773 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "90202799ce7eca4a33ca8b59", "attempt_id": "31fd367af50a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:12.013133Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10878, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1628.031332977116, "ttft_ms": 16.686416929587722, "decode_ms": 33.25808304361999}, "total_wall_ms": 1692.63712503016, "ttft_ms": 16.686416929587722, "input_usage": {"receiver_prompt_tokens": 10878}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1203830784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14305547328, "mlx_cache_bytes": 6538273112, "process_rss_bytes": 1203830784}, "peak_prefill_memory": null, "peak_decode_memory": 14305547328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 774 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b2e9c777b4175b9b8eb21b00", "attempt_id": "7324eb2682ec", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:13.734507Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10894, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1638.3665000321344, "ttft_ms": 16.84587507043034, "decode_ms": 82.64195802621543}, "total_wall_ms": 1752.4455840466544, "ttft_ms": 16.84587507043034, "input_usage": {"receiver_prompt_tokens": 10894}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1203830784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14287410240, "mlx_cache_bytes": 6799253848, "process_rss_bytes": 1203830784}, "peak_prefill_memory": null, "peak_decode_memory": 14287410240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,508,495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "ea2d0d4ea7c5a27f529371c174ffa18ae918bd063c4b6f163c1ee00a702c9a47"} | ||||
| 775 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "445d460594b6c361ebb960f4", "attempt_id": "7957867922d0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:15.515521Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10888, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1644.1413749707863, "ttft_ms": 16.71862497460097, "decode_ms": 49.383875099010766}, "total_wall_ms": 1725.5762909771875, "ttft_ms": 16.71862497460097, "input_usage": {"receiver_prompt_tokens": 10888}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1203863552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14285182016, "mlx_cache_bytes": 7041982808, "process_rss_bytes": 1203863552}, "peak_prefill_memory": null, "peak_decode_memory": 14285182016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "399,010", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "2faf9e33010eea3c1ce04111c66169764f8106b978560e4e04b529b48b10820f"} | ||||
| 776 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7d64fbc1320e6786038ab1d0", "attempt_id": "c8ccf708a3df", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:17.269987Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10896, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1636.386499973014, "ttft_ms": 16.665542032569647, "decode_ms": 99.16245797649026}, "total_wall_ms": 1767.2661249525845, "ttft_ms": 16.665542032569647, "input_usage": {"receiver_prompt_tokens": 10896}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1203879936, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14288245824, "mlx_cache_bytes": 7287710040, "process_rss_bytes": 1203879936}, "peak_prefill_memory": null, "peak_decode_memory": 14288245824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Dradrawen-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "076ae4e439223f035d7ae5d706e7b20f026fb4720184ee4f24b43aed0556c07e"} | ||||
| 777 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d669dad9cbde36a46979eaab", "attempt_id": "78abc98be9e4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:19.066027Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10890, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1640.5062079429626, "ttft_ms": 17.012416967190802, "decode_ms": 82.85333309322596}, "total_wall_ms": 1755.1609580405056, "ttft_ms": 17.012416967190802, "input_usage": {"receiver_prompt_tokens": 10890}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1203896320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14310642752, "mlx_cache_bytes": 7447355736, "process_rss_bytes": 1203896320}, "peak_prefill_memory": null, "peak_decode_memory": 14310642752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,071,395", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "87a0b5f2d250c04a1e932117305779a9047e3a295d68822841993e5e634102d8"} | ||||
| 778 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b593268a20f629dcee49fff6", "attempt_id": "1c4c7f963494", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:20.850554Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10885, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1660.3591670282185, "ttft_ms": 16.646499978378415, "decode_ms": 49.79195795021951}, "total_wall_ms": 1741.851625032723, "ttft_ms": 16.646499978378415, "input_usage": {"receiver_prompt_tokens": 10885}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1203912704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14284346432, "mlx_cache_bytes": 7447355736, "process_rss_bytes": 1203912704}, "peak_prefill_memory": null, "peak_decode_memory": 14284346432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "35.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "72e72b41e40336eeef6045c40e3ac2988411fbadc42958caf30e7dbf1b729e00"} | ||||
| 779 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c728ba4e7860179bb1c1d98", "attempt_id": "898e21621b81", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:22.620648Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10889, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1652.6522500207648, "ttft_ms": 16.497291973792017, "decode_ms": 16.631833044812083}, "total_wall_ms": 1700.580499949865, "ttft_ms": 16.497291973792017, "input_usage": {"receiver_prompt_tokens": 10889}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1203912704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14285411392, "mlx_cache_bytes": 7447355736, "process_rss_bytes": 1203912704}, "peak_prefill_memory": null, "peak_decode_memory": 14285411392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 780 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff4b9327328aa266f6a2df8d", "attempt_id": "91636e99bf38", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:24.349736Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 10892, "message_tokens": 10782, "message_utf8_bytes": 58870, "cache_tensor_bytes": null, "serialized_payload_bytes": 58870, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.00925001222640276, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1697.4848329555243, "ttft_ms": 16.77374995779246, "decode_ms": 16.41287503298372}, "total_wall_ms": 1745.676291990094, "ttft_ms": 16.77374995779246, "input_usage": {"receiver_prompt_tokens": 10892}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1203912704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14287180864, "mlx_cache_bytes": 7532683608, "process_rss_bytes": 1203912704}, "peak_prefill_memory": null, "peak_decode_memory": 14287180864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 781 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ba7748e723ac033d1955e43", "attempt_id": "cbf0ddb08e90", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:35.909455Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.97333400230855, "ttft_ms": 13.573125004768372, "decode_ms": 94.89308297634125}, "total_wall_ms": 187.58616596460342, "ttft_ms": 13.573125004768372, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1204076544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 10865672968, "process_rss_bytes": 1204076544}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-56F-6105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "ce19f1de10dcab0eee002d716faa220946d8af410293bc2f7e9d058712b49180"} | ||||
| 782 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "579551166a2a96273916ba78", "attempt_id": "c3b33ad8cd69", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:36.126757Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.59670803695917, "ttft_ms": 13.4907920146361, "decode_ms": 26.994832907803357}, "total_wall_ms": 118.09970799367875, "ttft_ms": 13.4907920146361, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1204076544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083016, "mlx_cache_bytes": 11209491208, "process_rss_bytes": 1204076544}, "peak_prefill_memory": null, "peak_decode_memory": 13039083016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 783 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f074b5e61d539e3d536657ee", "attempt_id": "9624be99957d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:36.273882Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.55683299526572, "ttft_ms": 13.829041039571166, "decode_ms": 13.55412497650832}, "total_wall_ms": 104.98562501743436, "ttft_ms": 13.829041039571166, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204076544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13068836360, "mlx_cache_bytes": 11367498504, "process_rss_bytes": 1204076544}, "peak_prefill_memory": null, "peak_decode_memory": 13068836360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 784 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8870baf658624ca6482a7d3b", "attempt_id": "2efcde244c02", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:36.406880Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 629, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.57250010035932, "ttft_ms": 13.564791996032, "decode_ms": 67.19704088754952}, "total_wall_ms": 159.43733300082386, "ttft_ms": 13.564791996032, "input_usage": {"receiver_prompt_tokens": 629, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1204076544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046799912, "mlx_cache_bytes": 11742268632, "process_rss_bytes": 1204076544}, "peak_prefill_memory": null, "peak_decode_memory": 13046799912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,502,349", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "cf89548da53f34e1947419dd2b3e8469f99b23f9e8cab655e41c3a51bb5a20b7"} | ||||
| 785 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7029dafe919e1ee3730650d6", "attempt_id": "47392ebb7563", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:36.595093Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 623, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.1123330341652, "ttft_ms": 13.685625046491623, "decode_ms": 41.4138330379501}, "total_wall_ms": 133.2927909679711, "ttft_ms": 13.685625046491623, "input_usage": {"receiver_prompt_tokens": 623, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1204076544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043424808, "mlx_cache_bytes": 12090559704, "process_rss_bytes": 1204076544}, "peak_prefill_memory": null, "peak_decode_memory": 13043424808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "607,190", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "9c46b774f0972bc627ad0e11bbf3f283dbf04b8345e263f0f3ea90a6b15f41c0"} | ||||
| 786 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cd35b17af5e1b5b50d28a65", "attempt_id": "3413decbe7a7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:36.756812Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.67025008797646, "ttft_ms": 13.51862505543977, "decode_ms": 67.91233306284994}, "total_wall_ms": 160.20004102028906, "ttft_ms": 13.51862505543977, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1204076544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 12443326128, "process_rss_bytes": 1204076544}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21 October 2029", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "02f847cc310b5f309a82b6c4ab81917ddbbafc3708e3a1525ba06727e74f3d8c"} | ||||
| 787 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5d91f15011d993d54b9518ee", "attempt_id": "e51cd547a664", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:36.946257Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.18933303840458, "ttft_ms": 13.947458006441593, "decode_ms": 67.41033296566457}, "total_wall_ms": 164.5478339632973, "ttft_ms": 13.947458006441593, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1204092928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981864, "mlx_cache_bytes": 12627351216, "process_rss_bytes": 1204092928}, "peak_prefill_memory": null, "peak_decode_memory": 13043981864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,102,190", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "2b219d7ebfd2ba80418c7cb2f0935889de5598620a2c3f6d9b4cdbc9368f7164"} | ||||
| 788 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9730ffad146ea37f35c510b8", "attempt_id": "235ae106c09e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:37.139156Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.83525001630187, "ttft_ms": 13.686625054106116, "decode_ms": 13.563874992541969}, "total_wall_ms": 105.14808399602771, "ttft_ms": 13.686625054106116, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204092928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 12627351216, "process_rss_bytes": 1204092928}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 789 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3e24d094690d775bc1d5f7c0", "attempt_id": "fa651636efff", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:37.272854Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.09758298005909, "ttft_ms": 13.680667034350336, "decode_ms": 13.785250019282103}, "total_wall_ms": 105.65516701899469, "ttft_ms": 13.680667034350336, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204092928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981864, "mlx_cache_bytes": 12627351216, "process_rss_bytes": 1204092928}, "peak_prefill_memory": null, "peak_decode_memory": 13043981864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 790 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "226eb6dd167438d41d2cb086", "attempt_id": "f075d9f460cd", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:37.406336Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1320, "cache_tensor_bytes": null, "serialized_payload_bytes": 1320, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9785.778457997367, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.8787499293685, "ttft_ms": 13.52687506005168, "decode_ms": 13.558499980717897}, "total_wall_ms": 106.00875003729016, "ttft_ms": 13.52687506005168, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 10916, "sender_output_tokens": 512, "sender_prefill_ms": 1628.6891250638291, "sender_ttft_ms": 16.647915937937796, "sender_decode_ms": 8126.827667001635}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204092928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077208616, "mlx_cache_bytes": 12788930224, "process_rss_bytes": 1204092928}, "peak_prefill_memory": null, "peak_decode_memory": 13077208616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "21631bf0bc9d811884c501afa0f865879447886f491ccf1b97ed5a8e2fb4b1bb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 791 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4e71902bc8b09561597cda3b", "attempt_id": "546ef5aaa355", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:47.212042Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 409, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.53633297979832, "ttft_ms": 13.835833058692515, "decode_ms": 13.557166093960404}, "total_wall_ms": 85.98233398515731, "ttft_ms": 13.835833058692515, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204174848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12890479704, "mlx_cache_bytes": 13372888752, "process_rss_bytes": 1204174848}, "peak_prefill_memory": null, "peak_decode_memory": 12890479704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 792 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c72545620e902385dcb135f2", "attempt_id": "3ae81940072b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:47.328089Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 403, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.09070891235024, "ttft_ms": 13.462833012454212, "decode_ms": 13.332749949768186}, "total_wall_ms": 80.71675000246614, "ttft_ms": 13.462833012454212, "input_usage": {"receiver_prompt_tokens": 403, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204174848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887399512, "mlx_cache_bytes": 13597824688, "process_rss_bytes": 1204174848}, "peak_prefill_memory": null, "peak_decode_memory": 12887399512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 793 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c62827a67f2979b3e7bf82dd", "attempt_id": "c99cb3ec3215", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:47.437482Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 401, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.284917026758194, "ttft_ms": 13.481916976161301, "decode_ms": 13.328208005987108}, "total_wall_ms": 80.97212493885309, "ttft_ms": 13.481916976161301, "input_usage": {"receiver_prompt_tokens": 401, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887039064, "mlx_cache_bytes": 13676467888, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12887039064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 794 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f32c55d07d79d040f5adab8", "attempt_id": "98e9da2076c0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:47.547111Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 417, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.83775001205504, "ttft_ms": 13.406167039647698, "decode_ms": 13.646458042785525}, "total_wall_ms": 79.74049996118993, "ttft_ms": 13.406167039647698, "input_usage": {"receiver_prompt_tokens": 417, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12895116376, "mlx_cache_bytes": 13924390576, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12895116376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 795 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7d2f7b65dcb553c08e7c5680", "attempt_id": "9c5193c47237", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:47.655415Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 411, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.28204210288823, "ttft_ms": 13.833541888743639, "decode_ms": 13.36266694124788}, "total_wall_ms": 80.29241603799164, "ttft_ms": 13.833541888743639, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12892036184, "mlx_cache_bytes": 14153799344, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12892036184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 796 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d482e8d2b3bbb03fb9495685", "attempt_id": "2abc1798f71f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:47.763881Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 419, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.077374960295856, "ttft_ms": 13.488415977917612, "decode_ms": 13.474333914928138}, "total_wall_ms": 83.97629100363702, "ttft_ms": 13.488415977917612, "input_usage": {"receiver_prompt_tokens": 419, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12896672856, "mlx_cache_bytes": 14403311280, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12896672856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 797 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5e420662be53a286b3b1c6bd", "attempt_id": "37c52a9374b6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:47.876006Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 413, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.585375029593706, "ttft_ms": 13.459249981679022, "decode_ms": 40.81116698216647}, "total_wall_ms": 107.7495840145275, "ttft_ms": 13.459249981679022, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12914285656, "mlx_cache_bytes": 14550210224, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12914285656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "617,950", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "6b9cf2afe575d2d7c90e6d92915b4ec409eada4ec5fcccc08295fa97e18440f1"} | ||||
| 798 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "727d46439265f10ec6b0eef9", "attempt_id": "97c99ee06a1b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.012288Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 408, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.60774993803352, "ttft_ms": 13.449750025756657, "decode_ms": 13.558125006966293}, "total_wall_ms": 80.45987493824214, "ttft_ms": 13.449750025756657, "input_usage": {"receiver_prompt_tokens": 408, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12890479704, "mlx_cache_bytes": 14550210224, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12890479704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 799 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c5ca8fad0b8d2970c839561", "attempt_id": "f1823b801b4b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.121292Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 412, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.241583936847746, "ttft_ms": 13.82141700014472, "decode_ms": 13.216541963629425}, "total_wall_ms": 80.09929198306054, "ttft_ms": 13.82141700014472, "input_usage": {"receiver_prompt_tokens": 412, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12919397464, "mlx_cache_bytes": 14550210224, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12919397464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 800 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93fd2a9568105c31a161fd73", "attempt_id": "64eff572f91e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.229914Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 415, "message_tokens": 289, "message_utf8_bytes": 808, "cache_tensor_bytes": null, "serialized_payload_bytes": 808, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9669.90400000941, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.27941705379635, "ttft_ms": 13.641750090755522, "decode_ms": 13.73579096980393}, "total_wall_ms": 80.47704200726002, "ttft_ms": 13.641750090755522, "input_usage": {"receiver_prompt_tokens": 415, "sender_input_tokens": 10946, "sender_output_tokens": 512, "sender_prefill_ms": 1515.9690829459578, "sender_ttft_ms": 16.201207996346056, "sender_decode_ms": 8129.257000051439}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204191232, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12894755928, "mlx_cache_bytes": 14631605936, "process_rss_bytes": 1204191232}, "peak_prefill_memory": null, "peak_decode_memory": 12894755928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "81d53f434ba1fa91aefb9c8958962b43895f819b08ce109526d2f407aeb693e2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 801 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1d83b37e0df3cbac982fa11f", "attempt_id": "d6ea703291c3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.346958Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 611, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.42941607628018, "ttft_ms": 13.644124963320792, "decode_ms": 13.444999931380153}, "total_wall_ms": 104.5589999994263, "ttft_ms": 13.644124963320792, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204224000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047979528, "mlx_cache_bytes": 14946571952, "process_rss_bytes": 1204224000}, "peak_prefill_memory": null, "peak_decode_memory": 13047979528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 802 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5ecd9165b07b1afed9f9b30", "attempt_id": "f01c6296d902", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.479922Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 605, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.1398749416694, "ttft_ms": 13.716833898797631, "decode_ms": 26.891915942542255}, "total_wall_ms": 116.73179198987782, "ttft_ms": 13.716833898797631, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1204224000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032889864, "mlx_cache_bytes": 15307036336, "process_rss_bytes": 1204224000}, "peak_prefill_memory": null, "peak_decode_memory": 13032889864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 803 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d70c100999223751ac7450d3", "attempt_id": "99093a9bebfb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.625022Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 603, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.87583300098777, "ttft_ms": 13.64837505389005, "decode_ms": 27.13608299382031}, "total_wall_ms": 116.79354205261916, "ttft_ms": 13.64837505389005, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1204224000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13062118920, "mlx_cache_bytes": 15462422192, "process_rss_bytes": 1204224000}, "peak_prefill_memory": null, "peak_decode_memory": 13062118920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 804 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0b995720cbb62b937707154a", "attempt_id": "092c3ca76bf8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.770259Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 619, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.7967919819057, "ttft_ms": 13.715374981984496, "decode_ms": 67.58420797996223}, "total_wall_ms": 159.174875007011, "ttft_ms": 13.715374981984496, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1204224000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13072178696, "mlx_cache_bytes": 15621936816, "process_rss_bytes": 1204224000}, "peak_prefill_memory": null, "peak_decode_memory": 13072178696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,508,495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "ea2d0d4ea7c5a27f529371c174ffa18ae918bd063c4b6f163c1ee00a702c9a47"} | ||||
| 805 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c64872022cae2f89c4d8fa69", "attempt_id": "c04064f56932", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:48.958012Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 613, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.51729101780802, "ttft_ms": 13.521417044103146, "decode_ms": 40.29262496624142}, "total_wall_ms": 131.36641692835838, "ttft_ms": 13.521417044103146, "input_usage": {"receiver_prompt_tokens": 613}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1204224000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13076405768, "mlx_cache_bytes": 15621936816, "process_rss_bytes": 1204224000}, "peak_prefill_memory": null, "peak_decode_memory": 13076405768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "398,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "7ed3eb84d3dee4b9313aea5c7d8738d64fcf782470f2ca443edee1d334b3c9f0"} | ||||
| 806 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a2e67ca1d01d3433020b8f9f", "attempt_id": "66ecf0a0810f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:49.118229Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 621, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.09991694334894, "ttft_ms": 13.438374968245625, "decode_ms": 67.32224998995662}, "total_wall_ms": 157.94062498025596, "ttft_ms": 13.438374968245625, "input_usage": {"receiver_prompt_tokens": 621}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1204224000, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 15621936816, "process_rss_bytes": 1204224000}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Noveshnov-17", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "d6fe017af1cd3900970d0d254e5dd20ffcdc0a138a502387710ef2d1ece4e266"} | ||||
| 807 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1971022a03229d6ebbede49", "attempt_id": "acf52a5740c6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:49.304794Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 615, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.59537496510893, "ttft_ms": 13.619457953609526, "decode_ms": 67.17416597530246}, "total_wall_ms": 158.44883397221565, "ttft_ms": 13.619457953609526, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1204256768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083016, "mlx_cache_bytes": 15621936816, "process_rss_bytes": 1204256768}, "peak_prefill_memory": null, "peak_decode_memory": 13039083016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,821,445", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "c14321a318e6d581e96b3edf257815ef039a1243ded6713ac61a27dd60d91b7b"} | ||||
| 808 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e7f5b3fa8296a76ac2eb5708", "attempt_id": "d3cae4631b15", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:49.491986Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 610, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.23258407693356, "ttft_ms": 13.480416964739561, "decode_ms": 67.27975001558661}, "total_wall_ms": 158.02783309482038, "ttft_ms": 13.480416964739561, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1204256768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047979528, "mlx_cache_bytes": 15621936816, "process_rss_bytes": 1204256768}, "peak_prefill_memory": null, "peak_decode_memory": 13047979528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,502,349", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "cf89548da53f34e1947419dd2b3e8469f99b23f9e8cab655e41c3a51bb5a20b7"} | ||||
| 809 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "23cb350ff0dad3184130200d", "attempt_id": "7ef7110b9890", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:49.678075Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 614, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.39433396980166, "ttft_ms": 13.469291036017239, "decode_ms": 13.420374947600067}, "total_wall_ms": 104.32483302429318, "ttft_ms": 13.469291036017239, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204256768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13076766216, "mlx_cache_bytes": 15621936816, "process_rss_bytes": 1204256768}, "peak_prefill_memory": null, "peak_decode_memory": 13076766216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 810 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "92b7f9c4a520ddcd6799697b", "attempt_id": "5bb6fbc42270", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:49.810909Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 617, "message_tokens": 506, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.8446249244734645, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.80504210293293, "ttft_ms": 13.699084054678679, "decode_ms": 13.366417028009892}, "total_wall_ms": 104.90570799447596, "ttft_ms": 13.699084054678679, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1204256768, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640072, "mlx_cache_bytes": 15803602608, "process_rss_bytes": 1204256768}, "peak_prefill_memory": null, "peak_decode_memory": 13039640072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a162eba422bc855c1761dd7f0dc73667643d526ad16092c00f9979e4baa6f36", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 811 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "855f8e0aa87487dcce735c73", "attempt_id": "92dc133a1193", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:52.753006Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 44, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.901666099205613, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.28070799726993, "ttft_ms": 67.28070799726993, "decode_ms": 47.24129196256399}, "total_wall_ms": 125.26887492276728, "ttft_ms": 67.28070799726993, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1825538048, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 14951880721, "process_rss_bytes": 1825538048}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not found.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "0802559db1375af3ff5caabba71acea1d6299f1a7fc64b6a5024f19cbd33b72f"} | ||||
| 812 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7ecfa491e72b368ddabddab2", "attempt_id": "b16aae44e870", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:52.907430Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 38, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.581625012680888, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.38316701631993, "ttft_ms": 26.38316701631993, "decode_ms": 15.694250003434718}, "total_wall_ms": 52.88008297793567, "ttft_ms": 26.38316701631993, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1825538048, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14573180136, "mlx_cache_bytes": 14979176465, "process_rss_bytes": 1825538048}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14573180136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 813 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4e38d02f692a02aacf10e7cb", "attempt_id": "004d9ff6a0cc", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:52.989368Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 36, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.594416029751301, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.16620795056224, "ttft_ms": 28.16620795056224, "decode_ms": 16.061958041973412}, "total_wall_ms": 54.17283298447728, "ttft_ms": 28.16620795056224, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1825538048, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14574834920, "mlx_cache_bytes": 14998018065, "process_rss_bytes": 1825538048}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14574834920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 814 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0f50f6238a5f06096cf3211d", "attempt_id": "58dbc3923d98", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.072761Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 52, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.570332959294319, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.943125042133033, "ttft_ms": 28.943125042133033, "decode_ms": 78.35245900787413}, "total_wall_ms": 117.71841708105057, "ttft_ms": 28.943125042133033, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1825570816, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 15411831873, "process_rss_bytes": 1825570816}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,051,960", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "2e5f6a00a6e392dbb9dad32e098dc1553097615102b5c951f399695634c314fc"} | ||||
| 815 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "55f4f5a10519583f8f48f5c9", "attempt_id": "b9c4ae85ff56", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.220003Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 46, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.5920000625774264, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.040833025239408, "ttft_ms": 27.040833025239408, "decode_ms": 31.027042074128985}, "total_wall_ms": 68.00729199312627, "ttft_ms": 27.040833025239408, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 46}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1825570816, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14576669960, "mlx_cache_bytes": 15445992513, "process_rss_bytes": 1825570816}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14576669960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 816 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f8a1bb9afeabdf55489c7945", "attempt_id": "c9dec607b575", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.317791Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 54, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.5379579747095704, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.984749991446733, "ttft_ms": 27.984749991446733, "decode_ms": 78.68512498680502}, "total_wall_ms": 116.97487498167902, "ttft_ms": 27.984749991446733, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1825587200, "backend_memory": {"mlx_active_bytes": 14489277448, "mlx_peak_bytes": 14583371016, "mlx_cache_bytes": 15801626965, "process_rss_bytes": 1825587200}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14583371016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "841949370899ae54bd62052c2e4322335615fa29894321478d7c9ae44c157ecd"} | ||||
| 817 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "df6e8f0a151c67b449859881", "attempt_id": "774b3b7ce00b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.463739Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 48, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.383291022852063, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.24654197320342, "ttft_ms": 28.24654197320342, "decode_ms": 77.98508298583329}, "total_wall_ms": 116.53454101178795, "ttft_ms": 28.24654197320342, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1825587200, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 15824302421, "process_rss_bytes": 1825587200}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,390,225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "9a5320df65e472ec88327b6e5547b7b8b90ea70e75578f243458315e23f8620d"} | ||||
| 818 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f3445bc19c47feb0c1f9f18", "attempt_id": "5007f1e9e40f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.608840Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 43, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.6434999890625477, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.90954092051834, "ttft_ms": 27.90954092051834, "decode_ms": 30.874542077071965}, "total_wall_ms": 68.72049998492002, "ttft_ms": 27.90954092051834, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 43}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1825587200, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 15825219925, "process_rss_bytes": 1825587200}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 819 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a904f89bf859021708faf2b7", "attempt_id": "aaed8d37b373", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.706181Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 47, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.6542500127106905, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.098874958232045, "ttft_ms": 28.098874958232045, "decode_ms": 30.9240419883281}, "total_wall_ms": 68.98966699372977, "ttft_ms": 28.098874958232045, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1825587200, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577292544, "mlx_cache_bytes": 15837278549, "process_rss_bytes": 1825587200}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14577292544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 820 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1afdf46a3b88b8debc99f151", "attempt_id": "011c8bf8a8ca", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.803702Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10842, "keep": 2710, "compress_ms": 14.129708986729383}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 50, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817685, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2808.3018750185147, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 14.168792054988444, "serialize_ms": 1023.7312919925898, "load_ms": 2.412416972219944, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.944291941821575, "ttft_ms": 27.944291941821575, "decode_ms": 15.469916979782283}, "total_wall_ms": 53.79462498240173, "ttft_ms": 27.944291941821575, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1825587200, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14582682880, "mlx_cache_bytes": 15852302677, "process_rss_bytes": 1825587200}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14582682880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f62188c4876e8befd99ff2a687629fd88c57c485bec148b6f768ecd57afde551", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 821 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4718801205536caa9ca220dc", "attempt_id": "3e16d5b2bd31", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:53.887494Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 44, "compress_ms": 2365.8472090028226}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 44, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2455.678791971877, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 2373.156917048618, "serialize_ms": 82.33666606247425, "load_ms": 34.91562500130385, "receiver_prefill_ms": 0.0, "query_prefill_ms": 441.1735830362886, "ttft_ms": 441.1735830362886, "decode_ms": 142.0520000392571}, "total_wall_ms": 3082.2136249626055, "ttft_ms": 441.1735830362886, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1668972544, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 18441662909, "process_rss_bytes": 1668972544}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-56F-6105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "ce19f1de10dcab0eee002d716faa220946d8af410293bc2f7e9d058712b49180"} | ||||
| 822 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3af6af68e0c9ccd7b45682be", "attempt_id": "9888c4e69966", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:56.999995Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 38, "compress_ms": 151.25474997330457}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 38, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 226.09529201872647, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 158.57479209080338, "serialize_ms": 67.26941699162126, "load_ms": 2.0275829592719674, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.317667030729353, "ttft_ms": 27.317667030729353, "decode_ms": 33.40695798397064}, "total_wall_ms": 298.50620799697936, "ttft_ms": 27.317667030729353, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1982791680, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14573147368, "mlx_cache_bytes": 18495648189, "process_rss_bytes": 1982791680}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14573147368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 823 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8a48e7648b831d2e4a3972b8", "attempt_id": "65549c349e0e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:57.331065Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 36, "compress_ms": 128.14858404453844}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 36, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 192.05366703681648, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 136.63625007029623, "serialize_ms": 55.20212498959154, "load_ms": 2.026124973781407, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.695042012259364, "ttft_ms": 28.695042012259364, "decode_ms": 33.213583985343575}, "total_wall_ms": 264.01166594587266, "ttft_ms": 28.695042012259364, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1982709760, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14574572776, "mlx_cache_bytes": 18533560765, "process_rss_bytes": 1982709760}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14574572776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 824 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae6419ee6b74e96d39a545e3", "attempt_id": "ae3229e5fee2", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:57.630313Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 52, "compress_ms": 133.37491697166115}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 52, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 195.5388329224661, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 141.5843330323696, "serialize_ms": 53.745292010717094, "load_ms": 1.9279590342193842, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.21883298829198, "ttft_ms": 32.21883298829198, "decode_ms": 83.96950003225356}, "total_wall_ms": 322.0448329811916, "ttft_ms": 32.21883298829198, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1984020480, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 18591347133, "process_rss_bytes": 1984020480}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,508,495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "ea2d0d4ea7c5a27f529371c174ffa18ae918bd063c4b6f163c1ee00a702c9a47"} | ||||
| 825 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "75f7291b4c6089c8d473cf4a", "attempt_id": "fef8194bc743", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:57.986207Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 46, "compress_ms": 127.16283299960196}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 46, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 180.98725005984306, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 135.47529198694974, "serialize_ms": 45.3070419607684, "load_ms": 2.440165961161256, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.888167019933462, "ttft_ms": 26.888167019933462, "decode_ms": 46.996291959658265}, "total_wall_ms": 264.8347089998424, "ttft_ms": 26.888167019933462, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 46}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1985298432, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14576669960, "mlx_cache_bytes": 18653131197, "process_rss_bytes": 1985298432}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14576669960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "399,010", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "2faf9e33010eea3c1ce04111c66169764f8106b978560e4e04b529b48b10820f"} | ||||
| 826 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6499d3d1cbe39be43d8294fe", "attempt_id": "316114f2c5fa", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:58.286183Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 54, "compress_ms": 131.47700007539243}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 54, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 183.82112495601177, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 138.76375008840114, "serialize_ms": 44.86258304677904, "load_ms": 2.4502499727532268, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.513790992088616, "ttft_ms": 27.513790992088616, "decode_ms": 101.58587503246963}, "total_wall_ms": 322.8844170225784, "ttft_ms": 27.513790992088616, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1985921024, "backend_memory": {"mlx_active_bytes": 14489277448, "mlx_peak_bytes": 14583371016, "mlx_cache_bytes": 18726416829, "process_rss_bytes": 1985921024}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14583371016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lunzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "841949370899ae54bd62052c2e4322335615fa29894321478d7c9ae44c157ecd"} | ||||
| 827 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db0a68bb342495d19a556d4b", "attempt_id": "8ff0d7f2e549", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:58.640936Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 48, "compress_ms": 129.35645796824247}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 48, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 181.2406670069322, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 136.5310000255704, "serialize_ms": 44.51937507838011, "load_ms": 2.353916992433369, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.23416597675532, "ttft_ms": 28.23416597675532, "decode_ms": 78.60433403402567}, "total_wall_ms": 298.7790419720113, "ttft_ms": 28.23416597675532, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1986101248, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 18777305533, "process_rss_bytes": 1986101248}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,661,395", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "09ebd844111232bfa237fffd87bfb1ed6ed491a1f3475ab848df9fb989efc6c8"} | ||||
| 828 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "14ffdaed4067ac43c855bac8", "attempt_id": "2f8a8a883fcf", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:58.971480Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 43, "compress_ms": 126.49979197885841}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 43, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 177.7623750967905, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 133.8198339799419, "serialize_ms": 43.75566600356251, "load_ms": 2.3790838895365596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.687374925240874, "ttft_ms": 31.687374925240874, "decode_ms": 47.531957970932126}, "total_wall_ms": 266.8486669426784, "ttft_ms": 31.687374925240874, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1986592768, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 18822984125, "process_rss_bytes": 1986592768}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "35.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "72e72b41e40336eeef6045c40e3ac2988411fbadc42958caf30e7dbf1b729e00"} | ||||
| 829 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1efd77513286a9c5f16e1019", "attempt_id": "4b1a3b909f03", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:59.269935Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 47, "compress_ms": 131.7292080493644}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 47, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817724, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.5505420351401, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 139.00537497829646, "serialize_ms": 45.35745794419199, "load_ms": 2.35970807261765, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.95595899503678, "ttft_ms": 30.95595899503678, "decode_ms": 15.613708063028753}, "total_wall_ms": 240.98495801445097, "ttft_ms": 30.95595899503678, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1986576384, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577292544, "mlx_cache_bytes": 18871906749, "process_rss_bytes": 1986576384}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14577292544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bcc0bf5faae8feb04504873ccc19a7e4a46b10f9de46e1c9773c9ffc99bec2cd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 830 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1478b181688327687574b4ae", "attempt_id": "dc6619f7363e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:50:59.542340Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10842, "keep": 2710, "window_tokens": 50, "compress_ms": 129.08216705545783}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 50, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 310804480, "serialized_payload_bytes": 310817725, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 301.2683748966083, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 136.34058402385563, "serialize_ms": 164.74166698753834, "load_ms": 2.0692499820142984, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.56054101884365, "ttft_ms": 36.56054101884365, "decode_ms": 15.64683299511671}, "total_wall_ms": 363.6280839564279, "ttft_ms": 36.56054101884365, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1986347008, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14579569920, "mlx_cache_bytes": 18934247869, "process_rss_bytes": 1986347008}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 14579569920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2358834512bcbc9d3ca4697003a22b17c0f722c75cbaa56d7c0d89e084f3056d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 831 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "206e56d36b22cf654486d7d0", "attempt_id": "b6e1a1850b96", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:00.294216Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 44, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 14.908417011611164, "receiver_prefill_ms": 0.0, "query_prefill_ms": 100.97454104106873, "ttft_ms": 100.97454104106873, "decode_ms": 140.77591709792614}, "total_wall_ms": 265.06295893341303, "ttft_ms": 100.97454104106873, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2781675520, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15492254552, "mlx_cache_bytes": 20467723709, "process_rss_bytes": 2781675520}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15492254552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "HM-56F-6105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "ce19f1de10dcab0eee002d716faa220946d8af410293bc2f7e9d058712b49180"} | ||||
| 832 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bdb252eb725bb82a91577a0d", "attempt_id": "9c7eb6a58828", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:00.595629Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 38, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 3.793541924096644, "receiver_prefill_ms": 0.0, "query_prefill_ms": 49.9136250000447, "ttft_ms": 49.9136250000447, "decode_ms": 38.339875056408346}, "total_wall_ms": 99.80691701639444, "ttft_ms": 49.9136250000447, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2105212928, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15470655744, "mlx_cache_bytes": 20587299005, "process_rss_bytes": 2105212928}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15470655744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 833 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7feae3a62a2793b7f38e44bf", "attempt_id": "b7b91a2abb58", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:00.760488Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 36, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 3.871290944516659, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.44079098012298, "ttft_ms": 36.44079098012298, "decode_ms": 37.48883295338601}, "total_wall_ms": 85.57162503711879, "ttft_ms": 36.44079098012298, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2105229312, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15466985728, "mlx_cache_bytes": 20700151997, "process_rss_bytes": 2105229312}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15466985728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 834 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a1340c015f67780a07b2c6ba", "attempt_id": "fc8f96211d83", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:00.879562Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 52, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 4.345499910414219, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.807082990184426, "ttft_ms": 37.807082990184426, "decode_ms": 95.1187500031665}, "total_wall_ms": 144.9036670383066, "ttft_ms": 37.807082990184426, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2105294848, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15521420680, "mlx_cache_bytes": 21623726397, "process_rss_bytes": 2105294848}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15521420680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,508,495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "ea2d0d4ea7c5a27f529371c174ffa18ae918bd063c4b6f163c1ee00a702c9a47"} | ||||
| 835 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7961ab9e36cbc46f1ba9959e", "attempt_id": "6236826a2b7f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:01.053258Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 46, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 4.176749964244664, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.08533302415162, "ttft_ms": 37.08533302415162, "decode_ms": 55.403999984264374}, "total_wall_ms": 104.56662497017533, "ttft_ms": 37.08533302415162, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 46}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2105311232, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15499728264, "mlx_cache_bytes": 21768954173, "process_rss_bytes": 2105311232}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15499728264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "399,010", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "2faf9e33010eea3c1ce04111c66169764f8106b978560e4e04b529b48b10820f"} | ||||
| 836 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d20baa7336445b2362c32481", "attempt_id": "44e1a73119ac", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:01.186811Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 54, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 3.8982920814305544, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.71529195364565, "ttft_ms": 37.71529195364565, "decode_ms": 110.01620790921152}, "total_wall_ms": 159.15420895908028, "ttft_ms": 37.71529195364565, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2105344000, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15528498896, "mlx_cache_bytes": 21937521405, "process_rss_bytes": 2105344000}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15528498896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Dradrawen-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "076ae4e439223f035d7ae5d706e7b20f026fb4720184ee4f24b43aed0556c07e"} | ||||
| 837 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c6c12890797d1915553ccce0", "attempt_id": "4a1639677756", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:01.374791Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 48, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 4.134790971875191, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.58954198565334, "ttft_ms": 37.58954198565334, "decode_ms": 91.89716598484665}, "total_wall_ms": 141.60120801534504, "ttft_ms": 37.58954198565334, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2105376768, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15506376544, "mlx_cache_bytes": 22089040637, "process_rss_bytes": 2105376768}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15506376544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,563,210", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "dc44047a5de9f6fe8fbc7c0faa74092ebeb3feba41f0fd4934b04a532a3b61d5"} | ||||
| 838 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "83f8d2ce8c952625d8145036", "attempt_id": "305caac7fa5c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:01.545027Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 43, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 4.071458010002971, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.40350005682558, "ttft_ms": 37.40350005682558, "decode_ms": 55.61775004025549}, "total_wall_ms": 105.04366701934487, "ttft_ms": 37.40350005682558, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2105393152, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15489103936, "mlx_cache_bytes": 22223913725, "process_rss_bytes": 2105393152}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15489103936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "35.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "72e72b41e40336eeef6045c40e3ac2988411fbadc42958caf30e7dbf1b729e00"} | ||||
| 839 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31044d07d8e9da12f2773c1a", "attempt_id": "d2755a1467a1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:01.681131Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 47, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 4.049041075631976, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.58262505289167, "ttft_ms": 37.58262505289167, "decode_ms": 18.44383403658867}, "total_wall_ms": 67.64829205349088, "ttft_ms": 37.58262505289167, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2105393152, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15503230816, "mlx_cache_bytes": 22371369725, "process_rss_bytes": 2105393152}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15503230816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 840 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d04a17bc876d85484e48bae4", "attempt_id": "40d7f242f1dd", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:01.779153Z", "task_family": "synthetic", "document_id": "syn_03005_16000", "document_hash": "9c6f3343b2ab71d9f7e4670098820bae2ce40fdba51f9a559ea11eeea35d143a", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03005_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10782, "source_tokens_receiver": 10782, "query_tokens": 50, "message_tokens": 10842, "message_utf8_bytes": 58870, "cache_tensor_bytes": 660581376, "serialized_payload_bytes": 660609217, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 356.9444159511477, "doc_prefill_ms": 1754.1371670085937, "compress_ms": 77.01175007969141, "serialize_ms": 279.5722500886768, "load_ms": 3.3898750552907586, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.80604200437665, "ttft_ms": 37.80604200437665, "decode_ms": 18.79116694908589}, "total_wall_ms": 67.49895797111094, "ttft_ms": 37.80604200437665, "input_usage": {"receiver_prefix_tokens": 10842, "dense_cache_bytes": 1243447296, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2105409536, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15515010912, "mlx_cache_bytes": 22529377021, "process_rss_bytes": 2105409536}, "peak_prefill_memory": 14290703424, "peak_decode_memory": 15515010912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03005_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "97bb1c3df4ff7da633375b81e144c53c73bd8d175c4ae1838dcb9ef9d46a4a3d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 841 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "88bfd7c31518e3ea292e90e6", "attempt_id": "6a001f45a2b0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:02.611092Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1976, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 9278.393249958754, "ttft_ms": 50.28858396690339, "decode_ms": 137.7670409856364}, "total_wall_ms": 9469.521000050008, "ttft_ms": 50.28858396690339, "input_usage": {"receiver_prompt_tokens": 1976}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1480720384, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13459747612, "mlx_cache_bytes": 2795689108, "process_rss_bytes": 1480720384}, "peak_prefill_memory": null, "peak_decode_memory": 13459747612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 842 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e2c09fe458782b08d7bc1a90", "attempt_id": "9b1eb93e6c99", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:12.099297Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.22412497363985, "ttft_ms": 13.706290978007019, "decode_ms": 13.529124902561307}, "total_wall_ms": 238.1654999917373, "ttft_ms": 13.706290978007019, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1480769536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13455045404, "mlx_cache_bytes": 3567752340, "process_rss_bytes": 1480769536}, "peak_prefill_memory": null, "peak_decode_memory": 13455045404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 843 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e287c9f8454ec55101a4cb0a", "attempt_id": "12a2f1e9bcb4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:12.352892Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1964, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 205.75491699855775, "ttft_ms": 14.128750073723495, "decode_ms": 13.895667041651905}, "total_wall_ms": 236.339750001207, "ttft_ms": 14.128750073723495, "input_usage": {"receiver_prompt_tokens": 1964}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1480769536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13455045404, "mlx_cache_bytes": 3567752340, "process_rss_bytes": 1480769536}, "peak_prefill_memory": null, "peak_decode_memory": 13455045404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 844 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "755db3bae19648900511bb99", "attempt_id": "c0df6962a346", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:12.604198Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1981, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.07795897033066, "ttft_ms": 14.069708064198494, "decode_ms": 110.08512496482581}, "total_wall_ms": 333.88020808342844, "ttft_ms": 14.069708064198494, "input_usage": {"receiver_prompt_tokens": 1981}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1480851456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13461599296, "mlx_cache_bytes": 4346369172, "process_rss_bytes": 1480851456}, "peak_prefill_memory": null, "peak_decode_memory": 13461599296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10107545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "6faba9de4e29949bbdd8934f69fc2110f07076db6801b211aeca9351292537fe"} | ||||
| 845 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5bea82a6c90b25a9edbce522", "attempt_id": "408db6b1eddd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:12.953075Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1974, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 206.23112504836172, "ttft_ms": 13.885791064240038, "decode_ms": 122.6307499455288}, "total_wall_ms": 345.38558300118893, "ttft_ms": 13.885791064240038, "input_usage": {"receiver_prompt_tokens": 1974}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1480851456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13459288860, "mlx_cache_bytes": 4887958676, "process_rss_bytes": 1480851456}, "peak_prefill_memory": null, "peak_decode_memory": 13459288860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 846 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5ac446452d7bf3381a6c1fb9", "attempt_id": "9d638d8b95fe", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:13.313420Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1983, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 212.87029201630503, "ttft_ms": 13.839749968610704, "decode_ms": 82.22537499386817}, "total_wall_ms": 311.8590840604156, "ttft_ms": 13.839749968610704, "input_usage": {"receiver_prompt_tokens": 1983}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1480884224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13462664256, "mlx_cache_bytes": 5667640468, "process_rss_bytes": 1480884224}, "peak_prefill_memory": null, "peak_decode_memory": 13462664256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 847 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9eb0c6f0c360f3d4fab76808", "attempt_id": "07b84960fb1c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:13.640570Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1976, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 220.66841705236584, "ttft_ms": 14.086541952565312, "decode_ms": 96.19687497615814}, "total_wall_ms": 333.61545798834413, "ttft_ms": 14.086541952565312, "input_usage": {"receiver_prompt_tokens": 1976}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1480900608, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13459747612, "mlx_cache_bytes": 5667640468, "process_rss_bytes": 1480900608}, "peak_prefill_memory": null, "peak_decode_memory": 13459747612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2008495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "75a7c2a3d23ae6c737cf160cf066ee8169b265933c32058dc30ac492df1670ff"} | ||||
| 848 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "712fef36e8022dafef36b516", "attempt_id": "53e865c664d4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:13.989090Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1973, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 224.2808749433607, "ttft_ms": 13.709541992284358, "decode_ms": 136.2467500148341}, "total_wall_ms": 376.917332992889, "ttft_ms": 13.709541992284358, "input_usage": {"receiver_prompt_tokens": 1973}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1480900608, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13458895644, "mlx_cache_bytes": 6208836756, "process_rss_bytes": 1480900608}, "peak_prefill_memory": null, "peak_decode_memory": 13458895644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13942878.2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "672f43fa223ba87eb15981f1cd70d47b901e2d2aaca5e980e15c8b624fe84244"} | ||||
| 849 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb757f175c16f817aababe0d", "attempt_id": "c008611399f0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:14.381145Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1977, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 219.08704098314047, "ttft_ms": 13.980041956529021, "decode_ms": 13.59183294698596}, "total_wall_ms": 249.23791689798236, "ttft_ms": 13.980041956529021, "input_usage": {"receiver_prompt_tokens": 1977}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1480916992, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13460075584, "mlx_cache_bytes": 6751212692, "process_rss_bytes": 1480916992}, "peak_prefill_memory": null, "peak_decode_memory": 13460075584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 850 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e8b42e324bf03c8284a3e49f", "attempt_id": "94f566c2f22f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:14.645610Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 1978, "message_tokens": 1890, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.017042038962244987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 231.2757499748841, "ttft_ms": 13.91641702502966, "decode_ms": 13.895082985982299}, "total_wall_ms": 261.7299170233309, "ttft_ms": 13.91641702502966, "input_usage": {"receiver_prompt_tokens": 1978}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1480933376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13460812864, "mlx_cache_bytes": 7293850772, "process_rss_bytes": 1480933376}, "peak_prefill_memory": null, "peak_decode_memory": 13460812864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 851 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a4f2fd22ea6004dc61c528ea", "attempt_id": "cf6a2aef6117", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:22.108024Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.79066603910178, "ttft_ms": 13.369666994549334, "decode_ms": 132.6701670186594}, "total_wall_ms": 218.28595909755677, "ttft_ms": 13.369666994549334, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1481932800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 8676856980, "process_rss_bytes": 1481932800}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 852 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7bf4f294381a43c163e52c76", "attempt_id": "75c2326e9a59", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:22.342413Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.03545796032995, "ttft_ms": 13.187374919652939, "decode_ms": 13.653167057782412}, "total_wall_ms": 98.24920806568116, "ttft_ms": 13.187374919652939, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989817944, "mlx_cache_bytes": 9036158100, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12989817944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 853 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bb1c33170c773940f93d886b", "attempt_id": "183baa1e0ab8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:22.456953Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.52887494117022, "ttft_ms": 13.218624982982874, "decode_ms": 13.052291935309768}, "total_wall_ms": 96.67574998456985, "ttft_ms": 13.218624982982874, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989817944, "mlx_cache_bytes": 9036158100, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12989817944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 854 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fd4a9e6e03a4378f83093f64", "attempt_id": "4ea85d97a576", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:22.569549Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.28824998997152, "ttft_ms": 13.353458023630083, "decode_ms": 119.65137498918921}, "total_wall_ms": 204.26762499846518, "ttft_ms": 13.353458023630083, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997551192, "mlx_cache_bytes": 9390740628, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12997551192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 855 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a95a2699f040348f530be9c2", "attempt_id": "64dfb69f4b86", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:22.789506Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.44250005856156, "ttft_ms": 13.376459013670683, "decode_ms": 120.20637502428144}, "total_wall_ms": 204.97487497050315, "ttft_ms": 13.376459013670683, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994028632, "mlx_cache_bytes": 9637876884, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12994028632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 856 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ffcb3855dfdc272f6d23fe6", "attempt_id": "e938e8b26e4d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:23.009823Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.08566605206579, "ttft_ms": 13.311958988197148, "decode_ms": 13.519583968445659}, "total_wall_ms": 100.92195798642933, "ttft_ms": 13.311958988197148, "input_usage": {"receiver_prompt_tokens": 610, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12999599192, "mlx_cache_bytes": 10015069332, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12999599192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 857 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a21f20eaff346132a6024734", "attempt_id": "f83ab451723f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:23.127214Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.24587504565716, "ttft_ms": 13.237375067546964, "decode_ms": 93.70166703592986}, "total_wall_ms": 178.22274996433407, "ttft_ms": 13.237375067546964, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 10015069332, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8908553", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "5ad9e777dc3be36808c74badfc8aae217b41a486754d07adf1abda6f6bce9aca"} | ||||
| 858 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9ec7580df95e47c911523c5e", "attempt_id": "246e11db9971", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:23.321537Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.01804106403142, "ttft_ms": 13.346042018383741, "decode_ms": 66.47037505172193}, "total_wall_ms": 150.7907910272479, "ttft_ms": 13.346042018383741, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008331864, "mlx_cache_bytes": 10195457172, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 13008331864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "39700", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "d8f3f4a352330800cb9f3d838e47d965e9c710d166f53c6b3724fdeae73c9a5e"} | ||||
| 859 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6b1552966e598a45bab812d7", "attempt_id": "78d854bf4802", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:23.487965Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.21104102022946, "ttft_ms": 13.535500038415194, "decode_ms": 13.15483299549669}, "total_wall_ms": 97.84779197070748, "ttft_ms": 13.535500038415194, "input_usage": {"receiver_prompt_tokens": 604, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995306584, "mlx_cache_bytes": 10443871380, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12995306584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 860 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4095ffc03d78bf288fe6e5d2", "attempt_id": "d33728a147a8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:23.601610Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1090, "cache_tensor_bytes": null, "serialized_payload_bytes": 1090, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7185.209417017177, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.10966690722853, "ttft_ms": 13.31958407536149, "decode_ms": 13.010250055231154}, "total_wall_ms": 97.3800839856267, "ttft_ms": 13.31958407536149, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 2006, "sender_output_tokens": 512, "sender_prefill_ms": 239.9587919935584, "sender_ttft_ms": 13.741167029365897, "sender_decode_ms": 6926.870875060558}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1481965568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995601496, "mlx_cache_bytes": 10692580500, "process_rss_bytes": 1481965568}, "peak_prefill_memory": null, "peak_decode_memory": 12995601496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59ebcb001cb3b215cde08e24830c6746ced6f1f9e503fe9746effea5a14644d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 861 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b2a6ebdf286adc07fa424920", "attempt_id": "b6859021cb57", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:30.875159Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 449, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.197041063569486, "ttft_ms": 13.404458994045854, "decode_ms": 132.5288750231266}, "total_wall_ms": 203.10516702011228, "ttft_ms": 13.404458994045854, "input_usage": {"receiver_prompt_tokens": 449, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1482866688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12972350320, "mlx_cache_bytes": 11888237460, "process_rss_bytes": 1482866688}, "peak_prefill_memory": null, "peak_decode_memory": 12972350320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XM-76Q-2958", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "cf42691eec772b9ec74d67643944de2e19e53724d7b772cef1e0f2d5ef3b4926"} | ||||
| 862 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b76b19dc53db7cf2c26bda37", "attempt_id": "c5d6e5225769", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.094992Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 437, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.25737495534122, "ttft_ms": 13.208833057433367, "decode_ms": 13.451291946694255}, "total_wall_ms": 81.76279091276228, "ttft_ms": 13.208833057433367, "input_usage": {"receiver_prompt_tokens": 437, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482883072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12963289968, "mlx_cache_bytes": 12229368724, "process_rss_bytes": 1482883072}, "peak_prefill_memory": null, "peak_decode_memory": 12963289968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 863 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "626e6be0cc2034e5e4e0f12e", "attempt_id": "bbfaa9ff33f2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.192699Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 437, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.635082906112075, "ttft_ms": 13.090625056065619, "decode_ms": 13.325124979019165}, "total_wall_ms": 80.84104198496789, "ttft_ms": 13.090625056065619, "input_usage": {"receiver_prompt_tokens": 437, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482883072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12963289968, "mlx_cache_bytes": 12229368724, "process_rss_bytes": 1482883072}, "peak_prefill_memory": null, "peak_decode_memory": 12963289968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 864 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2d1bd4e203e825ff65c413a4", "attempt_id": "47268d637f40", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.289439Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 454, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.50916702486575, "ttft_ms": 13.256334001198411, "decode_ms": 13.388999970629811}, "total_wall_ms": 82.97195797786117, "ttft_ms": 13.256334001198411, "input_usage": {"receiver_prompt_tokens": 454, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482883072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12977658756, "mlx_cache_bytes": 12605645480, "process_rss_bytes": 1482883072}, "peak_prefill_memory": null, "peak_decode_memory": 12977658756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 865 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "07e32297d372014a7c9b4857", "attempt_id": "823e67efef60", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.388250Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 447, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.90645796433091, "ttft_ms": 13.295457931235433, "decode_ms": 13.175917090848088}, "total_wall_ms": 81.20641694404185, "ttft_ms": 13.295457931235433, "input_usage": {"receiver_prompt_tokens": 447, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482883072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971432816, "mlx_cache_bytes": 12850619048, "process_rss_bytes": 1482883072}, "peak_prefill_memory": null, "peak_decode_memory": 12971432816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 866 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e0243c2531800214d1e2a6e7", "attempt_id": "bc64950ac598", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.485042Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 456, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.88312493637204, "ttft_ms": 13.634457951411605, "decode_ms": 13.402458978816867}, "total_wall_ms": 83.84745893999934, "ttft_ms": 13.634457951411605, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482899456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978854796, "mlx_cache_bytes": 13100575172, "process_rss_bytes": 1482899456}, "peak_prefill_memory": null, "peak_decode_memory": 12978854796, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 867 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bcdc8ccd7e75c7e6ddf794a5", "attempt_id": "e63dde0b04f5", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.584514Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 449, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.153416025452316, "ttft_ms": 13.514042017050087, "decode_ms": 13.097916962578893}, "total_wall_ms": 80.65083401743323, "ttft_ms": 13.514042017050087, "input_usage": {"receiver_prompt_tokens": 449, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482899456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12972350320, "mlx_cache_bytes": 13100575172, "process_rss_bytes": 1482899456}, "peak_prefill_memory": null, "peak_decode_memory": 12972350320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 868 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "53aabf1175bb45a8119a2c32", "attempt_id": "85d5b5d683a9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.681269Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 446, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.81641595158726, "ttft_ms": 13.231500051915646, "decode_ms": 93.26341701671481}, "total_wall_ms": 161.12275002524257, "ttft_ms": 13.231500051915646, "input_usage": {"receiver_prompt_tokens": 446, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1482899456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12970908528, "mlx_cache_bytes": 13257337284, "process_rss_bytes": 1482899456}, "peak_prefill_memory": null, "peak_decode_memory": 12970908528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "139,100", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "cd3bbe7734b3922ff064adf8d059c2c0b63a668c9df3827d85eaef4e1fe2ee32"} | ||||
| 869 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8856b579c45631d7ea000286", "attempt_id": "0f6b05551bc1", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.858368Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 450, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.76316693238914, "ttft_ms": 13.518666964955628, "decode_ms": 13.243708992376924}, "total_wall_ms": 82.34424993861467, "ttft_ms": 13.518666964955628, "input_usage": {"receiver_prompt_tokens": 450, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482899456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12917332844, "mlx_cache_bytes": 13442345412, "process_rss_bytes": 1482899456}, "peak_prefill_memory": null, "peak_decode_memory": 12917332844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 870 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f378ed4038ccb3f75dba2d2", "attempt_id": "133b8c39f4a4", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:31.956733Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 451, "message_tokens": 347, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7160.46904202085, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.083999992348254, "ttft_ms": 13.869832968339324, "decode_ms": 13.267874950543046}, "total_wall_ms": 83.11833394691348, "ttft_ms": 13.869832968339324, "input_usage": {"receiver_prompt_tokens": 451, "sender_input_tokens": 2034, "sender_output_tokens": 512, "sender_prefill_ms": 211.27929200883955, "sender_ttft_ms": 13.526708004064858, "sender_decode_ms": 6933.882917044684}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482899456, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12917627756, "mlx_cache_bytes": 13627648452, "process_rss_bytes": 1482899456}, "peak_prefill_memory": null, "peak_decode_memory": 12917627756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6eb36e552c0b20e1d4c0ec60c923ef1a6dfb4d2e9f9261c0c21f9440e14d599b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 871 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d4a453c589d03f02aa44b0c3", "attempt_id": "6081cbd7b5ef", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:32.057335Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 592, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.56249999348074, "ttft_ms": 13.390292064286768, "decode_ms": 13.263458968140185}, "total_wall_ms": 97.1742500551045, "ttft_ms": 13.390292064286768, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990407768, "mlx_cache_bytes": 13871147460, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12990407768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 872 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d430ecdfe16b665bd3c508cf", "attempt_id": "dd6d9ff1291c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:32.170877Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 580, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.97112499084324, "ttft_ms": 13.1963329622522, "decode_ms": 13.081875047646463}, "total_wall_ms": 97.20600000582635, "ttft_ms": 13.1963329622522, "input_usage": {"receiver_prompt_tokens": 580}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983428184, "mlx_cache_bytes": 14209509828, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12983428184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 873 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c0a28ed1f08e3a0712a54ed", "attempt_id": "31de2e3c4abb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:32.283996Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 580, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.70337498933077, "ttft_ms": 13.542083906941116, "decode_ms": 13.589291949756444}, "total_wall_ms": 97.75470802560449, "ttft_ms": 13.542083906941116, "input_usage": {"receiver_prompt_tokens": 580}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983428184, "mlx_cache_bytes": 14209509828, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12983428184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 874 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd4480d156de0cadf376e59b", "attempt_id": "9a5cc7bf18b4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:32.397281Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 597, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.13799995183945, "ttft_ms": 13.430375023745, "decode_ms": 120.03000010736287}, "total_wall_ms": 204.54129111021757, "ttft_ms": 13.430375023745, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993504344, "mlx_cache_bytes": 14535436740, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12993504344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 875 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cde21c3f8ee7895fc75bfe47", "attempt_id": "a484447d6aec", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:32.617268Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 590, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.58825001493096, "ttft_ms": 13.282582978717983, "decode_ms": 120.2466250397265}, "total_wall_ms": 204.06575000379235, "ttft_ms": 13.282582978717983, "input_usage": {"receiver_prompt_tokens": 590}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989817944, "mlx_cache_bytes": 14535436740, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12989817944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 876 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea58c6e9dcd3cef91263cb4f", "attempt_id": "c4565426251e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:32.837109Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 599, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.58808295894414, "ttft_ms": 13.175499974749982, "decode_ms": 79.77395795751363}, "total_wall_ms": 163.48650003783405, "ttft_ms": 13.175499974749982, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012984920, "mlx_cache_bytes": 14623615428, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 13012984920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Draosttek-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "2b3e2f36e669a543bfead6d94871991d5157079209ba24d18bc5c19f41b9d99e"} | ||||
| 877 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b6c33bad644899a40d7210a8", "attempt_id": "8853140d584f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:33.015852Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 592, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.54987498465925, "ttft_ms": 13.258208986371756, "decode_ms": 132.73958396166563}, "total_wall_ms": 216.5108749177307, "ttft_ms": 13.258208986371756, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990407768, "mlx_cache_bytes": 14623615428, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12990407768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14,334,768", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "fa3548ab283548ec7659e6ec1453988ea7690324de2848122ead67843be5a6a4"} | ||||
| 878 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8034429d6f9842ac56936206", "attempt_id": "0eb2d88b6c7c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:33.248241Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 589, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.47087496519089, "ttft_ms": 13.141792034730315, "decode_ms": 13.357582967728376}, "total_wall_ms": 96.9545419793576, "ttft_ms": 13.141792034730315, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989129816, "mlx_cache_bytes": 14865836484, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12989129816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 879 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6cd950f55e0a8ec26eaf33f8", "attempt_id": "c809a59656d9", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:33.361320Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 593, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.8973749531433, "ttft_ms": 13.352290960028768, "decode_ms": 13.406374957412481}, "total_wall_ms": 97.5625419523567, "ttft_ms": 13.352290960028768, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 15109630404, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 880 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c0960bed3bc9c73159daeb2", "attempt_id": "5ac22227f03f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:33.474490Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 594, "message_tokens": 505, "message_utf8_bytes": 1253, "cache_tensor_bytes": null, "serialized_payload_bytes": 1253, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6319589922204614, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.35479200910777, "ttft_ms": 13.16120894625783, "decode_ms": 13.336792006157339}, "total_wall_ms": 96.7870419844985, "ttft_ms": 13.16120894625783, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482932224, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13004530776, "mlx_cache_bytes": 15366023620, "process_rss_bytes": 1482932224}, "peak_prefill_memory": null, "peak_decode_memory": 13004530776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "ccb6a6e3a98d9c9654651b396ea6707ca5d72d18b48f062e72c5155669175691", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 881 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ddfa7e212d83622d381b930b", "attempt_id": "f37b8f1034a2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:33.811330Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 1.4954579528421164, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.458417082205415, "ttft_ms": 19.458417082205415, "decode_ms": 134.4048340106383}, "total_wall_ms": 156.76675003487617, "ttft_ms": 19.458417082205415, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1520123904, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12757488892, "mlx_cache_bytes": 16084712013, "process_rss_bytes": 1520123904}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12757488892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "PX-79Z-3050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "4aab49dea099f1d98c6fddf46de1f70be98609e58a7b5a0fa6b1ed0e7320a24b"} | ||||
| 882 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8ddfb8028ff664af75a04bc5", "attempt_id": "e8c7377ee07f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:33.984130Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 1.4027499128133059, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.152582972310483, "ttft_ms": 19.152582972310483, "decode_ms": 13.158250018022954}, "total_wall_ms": 35.10195796843618, "ttft_ms": 19.152582972310483, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1520123904, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12747101436, "mlx_cache_bytes": 16118807117, "process_rss_bytes": 1520123904}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12747101436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 883 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d62b8a1264d9de2b48cb731e", "attempt_id": "a8a3557d631b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.034907Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 0.7026660023257136, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.370417063124478, "ttft_ms": 18.370417063124478, "decode_ms": 13.323292019777}, "total_wall_ms": 33.79483299795538, "ttft_ms": 18.370417063124478, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12747101436, "mlx_cache_bytes": 16118839885, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12747101436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 884 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "879b9f2c233c4ede0cb03f82", "attempt_id": "b2f5c7e47b62", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.084417Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 52, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 1.5099169686436653, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.643041024915874, "ttft_ms": 18.643041024915874, "decode_ms": 80.23541700094938}, "total_wall_ms": 101.7823750153184, "ttft_ms": 18.643041024915874, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 52}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12761683216, "mlx_cache_bytes": 16163601389, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12761683216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "500000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "8d6962a152aee235ba824c41758b8da2371b7077b4ea0afaaec94014e16e3bc7"} | ||||
| 885 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b10254d98c875a3728a81c75", "attempt_id": "14e23d56c73f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.201492Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 45, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 0.6754579953849316, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.287167069502175, "ttft_ms": 18.287167069502175, "decode_ms": 79.68225004151464}, "total_wall_ms": 100.01900000497699, "ttft_ms": 18.287167069502175, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 45}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756260092, "mlx_cache_bytes": 16183280598, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12756260092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "500000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "8d6962a152aee235ba824c41758b8da2371b7077b4ea0afaaec94014e16e3bc7"} | ||||
| 886 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "296f694dd0afc65967eaa6fd", "attempt_id": "35e00ae103f1", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.317158Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 54, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 1.6159169608727098, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.3463329449296, "ttft_ms": 18.3463329449296, "decode_ms": 80.11145796626806}, "total_wall_ms": 101.52687493246049, "ttft_ms": 18.3463329449296, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12764960024, "mlx_cache_bytes": 16213755270, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12764960024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 887 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52ded5fa6a96f21388126194", "attempt_id": "5094c759f939", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.434582Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 0.8438749937340617, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.257916090078652, "ttft_ms": 18.257916090078652, "decode_ms": 66.78112503141165}, "total_wall_ms": 87.26641698740423, "ttft_ms": 18.257916090078652, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12757488892, "mlx_cache_bytes": 16213755270, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12757488892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "41049", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "ecf799bb7a4b7c32e83fffafd2a2ccca02b56fa97a67bf4629cacc43c907adb0"} | ||||
| 888 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da0bcb1b463d6207a073c553", "attempt_id": "551cd4265d89", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.537371Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 44, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 0.5725419614464045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.069999990984797, "ttft_ms": 18.069999990984797, "decode_ms": 66.90558302216232}, "total_wall_ms": 86.90291596576571, "ttft_ms": 18.069999990984797, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12755604732, "mlx_cache_bytes": 16238937478, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12755604732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "5994471abb01112afcc18159f6cc74b4f511b99806da59b3caf5a9c173cacfc5"} | ||||
| 889 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "45cb56f9b7f2b3b0a8904b38", "attempt_id": "1435286df5e2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.640567Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 48, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 1.3026670785620809, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.411582917906344, "ttft_ms": 18.411582917906344, "decode_ms": 13.324833940714598}, "total_wall_ms": 34.4120420049876, "ttft_ms": 18.411582917906344, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12758062352, "mlx_cache_bytes": 16272704902, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12758062352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 890 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "11c415326b737b330c5908cd", "attempt_id": "d367017bb507", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.690672Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1929, "keep": 482, "compress_ms": 11.40529103577137}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 49, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784359, "side_information_bytes": 15911, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 224.27158406935632, "doc_prefill_ms": 204.432874917984, "compress_ms": 11.443209019489586, "serialize_ms": 5.22608298342675, "load_ms": 1.3828329974785447, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.614083994179964, "ttft_ms": 18.614083994179964, "decode_ms": 13.734332984313369}, "total_wall_ms": 35.20375001244247, "ttft_ms": 18.614083994179964, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1520140288, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12761224464, "mlx_cache_bytes": 16307062150, "process_rss_bytes": 1520140288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12761224464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "58eee2ef101c2addb868c891a2c6e74fc343cc5d0c36e3768932815fcc63bace", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 891 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "24da56b85b56ba03df4d40ab", "attempt_id": "169cfdcb2ca0", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.741198Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 47, "compress_ms": 43.4502080315724}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784398, "side_information_bytes": 15950, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.48691700398922, "doc_prefill_ms": 204.432874917984, "compress_ms": 44.77245802991092, "serialize_ms": 7.514791912399232, "load_ms": 1.4757500030100346, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.209957983344793, "ttft_ms": 18.209957983344793, "decode_ms": 66.66979100555182}, "total_wall_ms": 140.31370903830975, "ttft_ms": 18.209957983344793, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1521074176, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12757488892, "mlx_cache_bytes": 16441197142, "process_rss_bytes": 1521074176}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12757488892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Wensel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b628402a14d73d28bc03011ee0e65f62b49c8c74728ebf7b38db02cb08af5d3a", "output_hash": "a9b76f298bfa7c41c50fe499c0ef716ae28f0d4f3be8ab609b3fe58dfde56963"} | ||||
| 892 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "07e8bcc24c454c7ff8b4e496", "attempt_id": "4a93c939aa4e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.897273Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 35, "compress_ms": 41.32041695993394}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784399, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 51.18200008291751, "doc_prefill_ms": 204.432874917984, "compress_ms": 42.601624969393015, "serialize_ms": 8.382500032894313, "load_ms": 1.4914999483153224, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.84079195931554, "ttft_ms": 17.84079195931554, "decode_ms": 13.319374993443489}, "total_wall_ms": 85.31354204751551, "ttft_ms": 17.84079195931554, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1539948544, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12747101436, "mlx_cache_bytes": 16464249430, "process_rss_bytes": 1539948544}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12747101436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b63840ab47d64742317c02d867cc408de6d9be66c82e865b8362db6be98f31b", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 893 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f624b304fdc72e303ac29cb", "attempt_id": "6c866b66d1bf", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:34.998634Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 35, "compress_ms": 41.16029094439}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784396, "side_information_bytes": 15948, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.524500008672476, "doc_prefill_ms": 204.432874917984, "compress_ms": 42.47887502424419, "serialize_ms": 3.8461670046672225, "load_ms": 1.1222920147702098, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.939917044714093, "ttft_ms": 17.939917044714093, "decode_ms": 13.205250026658177}, "total_wall_ms": 80.19762497860938, "ttft_ms": 17.939917044714093, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1539948544, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12747101436, "mlx_cache_bytes": 16464249430, "process_rss_bytes": 1539948544}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12747101436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b04e103255dbd209a4ba1016b2f4c2024bf00490ab160c8c5ba0bf0381ae434", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 894 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "660dfdd7f318ea06c3ea5ebb", "attempt_id": "a4c7ebeec29a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:35.094625Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 52, "compress_ms": 41.40287509653717}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 52, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784399, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 49.57970802206546, "doc_prefill_ms": 204.432874917984, "compress_ms": 42.74970793630928, "serialize_ms": 6.6321250051259995, "load_ms": 1.2238750932738185, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.251832923851907, "ttft_ms": 18.251832923851907, "decode_ms": 94.10124993883073}, "total_wall_ms": 164.6785419434309, "ttft_ms": 18.251832923851907, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1539948544, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12761437456, "mlx_cache_bytes": 16497885782, "process_rss_bytes": 1539948544}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12761437456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1011715", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b63840ab47d64742317c02d867cc408de6d9be66c82e865b8362db6be98f31b", "output_hash": "301f33ef2e919ee909d595384d9aaf6e507a88edf16b982dee8297829adda9f3"} | ||||
| 895 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d33f0e01179f7bcde4994eab", "attempt_id": "4eea08b54445", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:35.275350Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 45, "compress_ms": 42.85845905542374}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 45, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784399, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.893916023895144, "doc_prefill_ms": 204.432874917984, "compress_ms": 44.219624949619174, "serialize_ms": 3.4686661092564464, "load_ms": 1.2019999558106065, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.109249998815358, "ttft_ms": 18.109249998815358, "decode_ms": 120.31266593839973}, "total_wall_ms": 188.99229099042714, "ttft_ms": 18.109249998815358, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1539981312, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096252, "mlx_cache_bytes": 16519447126, "process_rss_bytes": 1539981312}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12756096252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,111,935", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b63840ab47d64742317c02d867cc408de6d9be66c82e865b8362db6be98f31b", "output_hash": "172722abd3a92a5be35556c33c03ff82e1b990a30aa7df88ea78172423ec6e27"} | ||||
| 896 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5c8b95ce1cdfa1cd63ce1b27", "attempt_id": "4b114d8b155a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:35.480486Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 54, "compress_ms": 42.02820791397244}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 54, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784399, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.28312499355525, "doc_prefill_ms": 204.432874917984, "compress_ms": 43.30625000875443, "serialize_ms": 3.771458053961396, "load_ms": 1.2076250277459621, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.09720799792558, "ttft_ms": 18.09720799792558, "decode_ms": 79.79058299679309}, "total_wall_ms": 147.87662506569177, "ttft_ms": 18.09720799792558, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1539981312, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12763878680, "mlx_cache_bytes": 16544678486, "process_rss_bytes": 1539981312}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12763878680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b63840ab47d64742317c02d867cc408de6d9be66c82e865b8362db6be98f31b", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 897 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c6db2ebf3df7df30887a7d1", "attempt_id": "6744edcee029", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:35.644703Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 47, "compress_ms": 39.81941600795835}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784399, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 45.82950007170439, "doc_prefill_ms": 204.432874917984, "compress_ms": 41.15508298855275, "serialize_ms": 4.473667009733617, "load_ms": 0.990999978967011, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.19554204121232, "ttft_ms": 18.19554204121232, "decode_ms": 95.31483298633248}, "total_wall_ms": 161.7903329897672, "ttft_ms": 18.19554204121232, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1539997696, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12757488892, "mlx_cache_bytes": 16544678486, "process_rss_bytes": 1539997696}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12757488892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5453453", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b63840ab47d64742317c02d867cc408de6d9be66c82e865b8362db6be98f31b", "output_hash": "88cc94e13c22d4edb5ecad514a65bde1e53daf2d957a2f1cd2db1dee147991c6"} | ||||
| 898 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1591d760508aeecf570b82c8", "attempt_id": "ec43c9d1853d", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:35.822214Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 44, "compress_ms": 41.87741701025516}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 44, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784399, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.321499907411635, "doc_prefill_ms": 204.432874917984, "compress_ms": 43.21741696912795, "serialize_ms": 3.8939170772209764, "load_ms": 0.9582919301465154, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.915957956574857, "ttft_ms": 17.915957956574857, "decode_ms": 92.77191699948162}, "total_wall_ms": 160.4999580886215, "ttft_ms": 17.915957956574857, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1540046848, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12755227900, "mlx_cache_bytes": 16556425814, "process_rss_bytes": 1540046848}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12755227900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13890.3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b63840ab47d64742317c02d867cc408de6d9be66c82e865b8362db6be98f31b", "output_hash": "16f47ebbe30c2ad72d1d37c001e853fbe02587fc14d9d7eb7cdcf641ba1faa74"} | ||||
| 899 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "baf5197370f029c6cfa04094", "attempt_id": "a282107282cd", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:35.999277Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 48, "compress_ms": 41.57500003930181}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 48, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784399, "side_information_bytes": 15951, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.638333005830646, "doc_prefill_ms": 204.432874917984, "compress_ms": 42.89549996610731, "serialize_ms": 3.5349170211702585, "load_ms": 1.130708958953619, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.004167010076344, "ttft_ms": 18.004167010076344, "decode_ms": 13.31170811317861}, "total_wall_ms": 80.56170796044171, "ttft_ms": 18.004167010076344, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1540046848, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12758062352, "mlx_cache_bytes": 16562356822, "process_rss_bytes": 1540046848}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12758062352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7b63840ab47d64742317c02d867cc408de6d9be66c82e865b8362db6be98f31b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 900 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2809c6b78151708eb61a874d", "attempt_id": "46d0de155020", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.096123Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1929, "keep": 482, "window_tokens": 49, "compress_ms": 41.785999899730086}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 49, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 17768448, "serialized_payload_bytes": 17784400, "side_information_bytes": 15952, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.93012498319149, "doc_prefill_ms": 204.432874917984, "compress_ms": 43.120875023305416, "serialize_ms": 3.600333002395928, "load_ms": 1.2341670226305723, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.242332967929542, "ttft_ms": 18.242332967929542, "decode_ms": 13.473249971866608}, "total_wall_ms": 81.40745793934911, "ttft_ms": 18.242332967929542, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1540046848, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12759471376, "mlx_cache_bytes": 16568418902, "process_rss_bytes": 1540046848}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12759471376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c94d399b13b02465ac2f4deeabf6b40c6bd9b45882fbd4853896f4830d55ba82", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 901 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "71c789486a8aa0f0684aab43", "attempt_id": "cc93d09fbd3f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.212398Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 2.0591659704223275, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.157999988645315, "ttft_ms": 21.157999988645315, "decode_ms": 145.30216704588383}, "total_wall_ms": 169.92000001482666, "ttft_ms": 21.157999988645315, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1617854464, "backend_memory": {"mlx_active_bytes": 12751857032, "mlx_peak_bytes": 12822949800, "mlx_cache_bytes": 16710839710, "process_rss_bytes": 1617854464}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12822949800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 902 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31c2423dc587d91e5a8d99a2", "attempt_id": "cd6833d33f27", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.398713Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.9529999699443579, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.142583991400898, "ttft_ms": 20.142583991400898, "decode_ms": 14.656708925031126}, "total_wall_ms": 38.14933402463794, "ttft_ms": 20.142583991400898, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1617903616, "backend_memory": {"mlx_active_bytes": 12750666152, "mlx_peak_bytes": 12806831616, "mlx_cache_bytes": 16731937150, "process_rss_bytes": 1617903616}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12806831616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 903 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2c43634cc63674de2a05a9d6", "attempt_id": "9a83d21607b2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.452965Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 35, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.6328749479725957, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.539209013804793, "ttft_ms": 20.539209013804793, "decode_ms": 14.52966604847461}, "total_wall_ms": 38.23137504514307, "ttft_ms": 20.539209013804793, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1617903616, "backend_memory": {"mlx_active_bytes": 12750666152, "mlx_peak_bytes": 12806831616, "mlx_cache_bytes": 16731937150, "process_rss_bytes": 1617903616}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12806831616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 904 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6b2b10c2b66bacad4873a552", "attempt_id": "235fb49da635", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.507166Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 52, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.8815420335158706, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.292875055223703, "ttft_ms": 21.292875055223703, "decode_ms": 116.07933405321091}, "total_wall_ms": 140.66799997817725, "ttft_ms": 21.292875055223703, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 52}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1618329600, "backend_memory": {"mlx_active_bytes": 12751860488, "mlx_peak_bytes": 12829386044, "mlx_cache_bytes": 16767406942, "process_rss_bytes": 1618329600}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12829386044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10107545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "6faba9de4e29949bbdd8934f69fc2110f07076db6801b211aeca9351292537fe"} | ||||
| 905 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "941d0c693e918df921c8cf8a", "attempt_id": "c4526ac73adf", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.663619Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 45, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 2.0612500375136733, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.549832959659398, "ttft_ms": 20.549832959659398, "decode_ms": 130.4928750032559}, "total_wall_ms": 154.54954199958593, "ttft_ms": 20.549832959659398, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1618362368, "backend_memory": {"mlx_active_bytes": 12750673928, "mlx_peak_bytes": 12820641600, "mlx_cache_bytes": 16794250846, "process_rss_bytes": 1618362368}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12820641600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 906 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2ecd71d2d2452e2ca3e8b9df", "attempt_id": "7a2b8775d20a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.834431Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 54, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.225583953782916, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.926333032548428, "ttft_ms": 20.926333032548428, "decode_ms": 87.1809161035344}, "total_wall_ms": 110.72954093106091, "ttft_ms": 20.926333032548428, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1618395136, "backend_memory": {"mlx_active_bytes": 12751860488, "mlx_peak_bytes": 12832862372, "mlx_cache_bytes": 16824037822, "process_rss_bytes": 1618395136}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12832862372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 907 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "634efdb4e78a862337322fca", "attempt_id": "ebbf18658f7b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:36.960953Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 47, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.9764159806072712, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.64137498382479, "ttft_ms": 20.64137498382479, "decode_ms": 102.38429205492139}, "total_wall_ms": 126.44008290953934, "ttft_ms": 20.64137498382479, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1618411520, "backend_memory": {"mlx_active_bytes": 12750673928, "mlx_peak_bytes": 12822951744, "mlx_cache_bytes": 16825224382, "process_rss_bytes": 1618411520}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12822951744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2008495", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "75a7c2a3d23ae6c737cf160cf066ee8169b265933c32058dc30ac492df1670ff"} | ||||
| 908 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3fe8734c3fa7a1d87234c12", "attempt_id": "05cea9e1db12", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:37.103587Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 44, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.7413749592378736, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.584041019901633, "ttft_ms": 20.584041019901633, "decode_ms": 130.911709042266}, "total_wall_ms": 154.7242080559954, "ttft_ms": 20.584041019901633, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1618411520, "backend_memory": {"mlx_active_bytes": 12750672808, "mlx_peak_bytes": 12819298112, "mlx_cache_bytes": 16850293022, "process_rss_bytes": 1618411520}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12819298112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "139407000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "3266877e7d5513d28904d75620791d1b8968019798d302a9cc3202e80cde8cae"} | ||||
| 909 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "039fac39a72d826e6fc127c8", "attempt_id": "fcbf9f79b5eb", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:37.274381Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 48, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.9298330880701542, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.64654103014618, "ttft_ms": 20.64654103014618, "decode_ms": 14.71254089847207}, "total_wall_ms": 38.709791959263384, "ttft_ms": 20.64654103014618, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1618427904, "backend_memory": {"mlx_active_bytes": 12750668168, "mlx_peak_bytes": 12824023196, "mlx_cache_bytes": 16877724478, "process_rss_bytes": 1618427904}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12824023196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 910 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35cf188f621c032677577e6e", "attempt_id": "907705f4ed8e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:37.329434Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711820424}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1890, "source_tokens_receiver": 1890, "query_tokens": 49, "message_tokens": 1929, "message_utf8_bytes": 7159, "cache_tensor_bytes": 37777536, "serialized_payload_bytes": 37811718, "side_information_bytes": 34182, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.492582952603698, "doc_prefill_ms": 204.432874917984, "compress_ms": 9.362166048958898, "serialize_ms": 8.786041988059878, "load_ms": 1.946207950823009, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.770082948729396, "ttft_ms": 20.770082948729396, "decode_ms": 14.44312499370426}, "total_wall_ms": 38.62000000663102, "ttft_ms": 20.770082948729396, "input_usage": {"receiver_prefix_tokens": 1929, "dense_cache_bytes": 71110656, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1618444288, "backend_memory": {"mlx_active_bytes": 12750669320, "mlx_peak_bytes": 12826006812, "mlx_cache_bytes": 16905739966, "process_rss_bytes": 1618444288}, "peak_prefill_memory": 13442003740, "peak_decode_memory": 12826006812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "411f35ebbab0053c6a518a6ada06076d56de922e3f9d63c842ec0ca866a36a7d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 911 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e53efcb598dac864c1396b6", "attempt_id": "90f882e8f685", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:37.465377Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1823, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 205.3707919549197, "ttft_ms": 14.027333003468812, "decode_ms": 99.5217920280993}, "total_wall_ms": 321.8375409487635, "ttft_ms": 14.027333003468812, "input_usage": {"receiver_prompt_tokens": 1823}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 916586496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13283160236, "mlx_cache_bytes": 812480080, "process_rss_bytes": 916586496}, "peak_prefill_memory": null, "peak_decode_memory": 13283160236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 912 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dfb277bc76dee12aea8c9d2e", "attempt_id": "40cd61a91991", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:37.813598Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1813, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.46616706065834, "ttft_ms": 13.987833983264863, "decode_ms": 28.101874981075525}, "total_wall_ms": 239.95049996301532, "ttft_ms": 13.987833983264863, "input_usage": {"receiver_prompt_tokens": 1813}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 916586496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13280735404, "mlx_cache_bytes": 1235711568, "process_rss_bytes": 916586496}, "peak_prefill_memory": null, "peak_decode_memory": 13280735404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 913 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0330151f5d3d6e01e3be9dbf", "attempt_id": "6edf8c6c52c0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:38.069232Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1813, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 194.25258308183402, "ttft_ms": 14.090667013078928, "decode_ms": 27.65758300665766}, "total_wall_ms": 238.42183407396078, "ttft_ms": 14.090667013078928, "input_usage": {"receiver_prompt_tokens": 1813}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 916619264, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13280735404, "mlx_cache_bytes": 1235711568, "process_rss_bytes": 916619264}, "peak_prefill_memory": null, "peak_decode_memory": 13280735404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 914 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f99fc90553d68d5e6bf266ef", "attempt_id": "d2f46e78828f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:38.323408Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1829, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.76854198426008, "ttft_ms": 14.479917008429766, "decode_ms": 70.2737090177834}, "total_wall_ms": 285.03629204351455, "ttft_ms": 14.479917008429766, "input_usage": {"receiver_prompt_tokens": 1829}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 916652032, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13284618436, "mlx_cache_bytes": 1696453344, "process_rss_bytes": 916652032}, "peak_prefill_memory": null, "peak_decode_memory": 13284618436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,107,545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "3d6a277763361ef55b8dd3f9791012605d24cd167ac5bdcdd0064ee16de161d4"} | ||||
| 915 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0eea291661dd384367ff05ac", "attempt_id": "af9b00316b8d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:38.624312Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1822, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 194.99329093378037, "ttft_ms": 14.14345798548311, "decode_ms": 70.46237494796515}, "total_wall_ms": 282.07045898307115, "ttft_ms": 14.14345798548311, "input_usage": {"receiver_prompt_tokens": 1822}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 916684800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13319516344, "mlx_cache_bytes": 1752404704, "process_rss_bytes": 916684800}, "peak_prefill_memory": null, "peak_decode_memory": 13319516344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 916 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f74f8a17d4cd93044aaa6f18", "attempt_id": "ce04eeb8a375", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:38.921944Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1831, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 197.23554200027138, "ttft_ms": 13.792790938168764, "decode_ms": 69.20691707637161}, "total_wall_ms": 283.06816692929715, "ttft_ms": 13.792790938168764, "input_usage": {"receiver_prompt_tokens": 1831}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 916701184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13285175500, "mlx_cache_bytes": 2179936120, "process_rss_bytes": 916701184}, "peak_prefill_memory": null, "peak_decode_memory": 13285175500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 917 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a312eab47ef2108f905145d4", "attempt_id": "68ecc24f04d4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:39.220507Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1825, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 193.95370804704726, "ttft_ms": 13.950291904620826, "decode_ms": 363.42895904090255}, "total_wall_ms": 573.8095829728991, "ttft_ms": 13.950291904620826, "input_usage": {"receiver_prompt_tokens": 1825}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": 916815872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13283356868, "mlx_cache_bytes": 2359242616, "process_rss_bytes": 916815872}, "peak_prefill_memory": null, "peak_decode_memory": 13283356868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,908,553 + 5,631,925 + 4,724,290 = 19,284,768", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "fded944830535103864e2459cd918f5825b3ca00388b67ec72ab373b2c29be37"} | ||||
| 918 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed94798cea626ba7dd9cba37", "attempt_id": "cd065aeb9662", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:39.810221Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1821, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 195.21912501659244, "ttft_ms": 14.097208972088993, "decode_ms": 42.124792002141476}, "total_wall_ms": 253.89433407690376, "ttft_ms": 14.097208972088993, "input_usage": {"receiver_prompt_tokens": 1821}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 916848640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13338914988, "mlx_cache_bytes": 2538155896, "process_rss_bytes": 916848640}, "peak_prefill_memory": null, "peak_decode_memory": 13338914988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "39.7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "138c4b663aa3391624efc0a351c82fa6339a5f7ce2617bbf767a8c33c9c6c3e7"} | ||||
| 919 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e3c7c551ea3bc84d8583986", "attempt_id": "772abc59533f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:40.079806Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1825, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 192.72375002037734, "ttft_ms": 13.959917007014155, "decode_ms": 13.96695792209357}, "total_wall_ms": 223.16708392463624, "ttft_ms": 13.959917007014155, "input_usage": {"receiver_prompt_tokens": 1825}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 916848640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13283356868, "mlx_cache_bytes": 2538155896, "process_rss_bytes": 916848640}, "peak_prefill_memory": null, "peak_decode_memory": 13283356868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 920 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf677e1431319769d7d62a3a", "attempt_id": "fa09134b7b5a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:40.318945Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 1827, "message_tokens": 1717, "message_utf8_bytes": 7159, "cache_tensor_bytes": null, "serialized_payload_bytes": 7159, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007417052984237671, "decode_payload_ms": 0.0, "receiver_prefill_ms": 196.30012509878725, "ttft_ms": 14.02141700964421, "decode_ms": 14.048082986846566}, "total_wall_ms": 226.82120802346617, "ttft_ms": 14.02141700964421, "input_usage": {"receiver_prompt_tokens": 1827}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 916848640, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13320909008, "mlx_cache_bytes": 2773774200, "process_rss_bytes": 916848640}, "peak_prefill_memory": null, "peak_decode_memory": 13320909008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 921 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae3a3dcea40a23403ecf7488", "attempt_id": "3151e80bcb30", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:47.945583Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 623, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.42858305573463, "ttft_ms": 13.578625046648085, "decode_ms": 13.653375091962516}, "total_wall_ms": 108.73712506145239, "ttft_ms": 13.578625046648085, "input_usage": {"receiver_prompt_tokens": 623, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 919601152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043424784, "mlx_cache_bytes": 4258831896, "process_rss_bytes": 919601152}, "peak_prefill_memory": null, "peak_decode_memory": 13043424784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 922 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0426a41ef6e45db517025b2a", "attempt_id": "16bc3d36197a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:48.070383Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.6620000358671, "ttft_ms": 13.512209057807922, "decode_ms": 27.733374969102442}, "total_wall_ms": 119.03695901855826, "ttft_ms": 13.512209057807922, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 919601152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821456, "mlx_cache_bytes": 4601355800, "process_rss_bytes": 919601152}, "peak_prefill_memory": null, "peak_decode_memory": 13037821456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 923 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "17902c2d867594498788c99a", "attempt_id": "268bd4171ef6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:48.204985Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.19462499860674, "ttft_ms": 13.75766599085182, "decode_ms": 27.415874996222556}, "total_wall_ms": 118.49691602401435, "ttft_ms": 13.75766599085182, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821456, "mlx_cache_bytes": 4601355800, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13037821456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 924 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eea9e8c5339c3d37fee4146c", "attempt_id": "75d7d6c43990", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:48.339476Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 629, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.58408400695771, "ttft_ms": 13.708625105209649, "decode_ms": 68.71174997650087}, "total_wall_ms": 161.1265839310363, "ttft_ms": 13.708625105209649, "input_usage": {"receiver_prompt_tokens": 629, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046799912, "mlx_cache_bytes": 4976125928, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13046799912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,723,450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "9fe3a92038284b7fee8e842cd5ae5db0bed2488bb3d951e2ca8a96077618b679"} | ||||
| 925 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f4b00976449653d41a004c6c", "attempt_id": "664e76344d2b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:48.516036Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.98070793412626, "ttft_ms": 13.608125038444996, "decode_ms": 67.41224997676909}, "total_wall_ms": 159.13124999497086, "ttft_ms": 13.608125038444996, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073931792, "mlx_cache_bytes": 5014300648, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13073931792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,723,450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "9fe3a92038284b7fee8e842cd5ae5db0bed2488bb3d951e2ca8a96077618b679"} | ||||
| 926 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "267841dc89c2e617f86aa95d", "attempt_id": "49e6f15c8f18", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:48.690451Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.71191699430346, "ttft_ms": 13.727125013247132, "decode_ms": 67.76537501718849}, "total_wall_ms": 160.3442500345409, "ttft_ms": 13.727125013247132, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 5367067072, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 927 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "57b45d4b48584a4efdea274b", "attempt_id": "fe71ac2314d7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:48.866098Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.08724995609373, "ttft_ms": 14.368916978128254, "decode_ms": 68.17958294413984}, "total_wall_ms": 160.79500003252178, "ttft_ms": 14.368916978128254, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981864, "mlx_cache_bytes": 5551092160, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13043981864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,908,553", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "cc434df580a6d88109305257f4ffd4ffb654a607abcff9be07a7507510825b63"} | ||||
| 928 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cfb7761592c79073a1aab091", "attempt_id": "6eed3244d9f2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:49.042663Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.6265409765765, "ttft_ms": 13.568459078669548, "decode_ms": 14.134874916635454}, "total_wall_ms": 105.47337506432086, "ttft_ms": 13.568459078669548, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13081239056, "mlx_cache_bytes": 5672989120, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13081239056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 929 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cbaf417ea8ed46adfe58d503", "attempt_id": "f381975df932", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:49.163373Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.8934580264613, "ttft_ms": 13.565459055826068, "decode_ms": 13.524875044822693}, "total_wall_ms": 105.05987494252622, "ttft_ms": 13.565459055826068, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981864, "mlx_cache_bytes": 5672989120, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13043981864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 930 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d7e0918db47a2b93547d1779", "attempt_id": "fa74d5f15960", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:49.284410Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 2033, "cache_tensor_bytes": null, "serialized_payload_bytes": 2033, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7384.049625019543, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.4563750019297, "ttft_ms": 13.761124922893941, "decode_ms": 13.60333408229053}, "total_wall_ms": 105.92245892621577, "ttft_ms": 13.761124922893941, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 1851, "sender_output_tokens": 512, "sender_prefill_ms": 197.56145903375, "sender_ttft_ms": 13.949708081781864, "sender_decode_ms": 7163.759959046729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 919617536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077208616, "mlx_cache_bytes": 5834568128, "process_rss_bytes": 919617536}, "peak_prefill_memory": null, "peak_decode_memory": 13077208616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa1f0da81c286da8599cec0928af3a6a4130676b6167a503e264e4d4244971e9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 931 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78ccca71453d64c01c85a2a7", "attempt_id": "507cd4ef21e0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:56.795005Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 412, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.98191693145782, "ttft_ms": 13.485000003129244, "decode_ms": 13.482916983775795}, "total_wall_ms": 81.22158295009285, "ttft_ms": 13.485000003129244, "input_usage": {"receiver_prompt_tokens": 412, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12893117528, "mlx_cache_bytes": 6519344928, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12893117528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 932 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d466a62dc4b9e51c17d8d85c", "attempt_id": "708566805ddc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:56.892599Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 402, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.026583045721054, "ttft_ms": 13.460875023156404, "decode_ms": 13.600083068013191}, "total_wall_ms": 80.86762495804578, "ttft_ms": 13.460875023156404, "input_usage": {"receiver_prompt_tokens": 402, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887514200, "mlx_cache_bytes": 6744084256, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12887514200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 933 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa567b993204abd5ae25af70", "attempt_id": "438e07a1bee1", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:56.989090Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 402, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.20058297365904, "ttft_ms": 13.496082974597812, "decode_ms": 13.59891693573445}, "total_wall_ms": 81.09679201152176, "ttft_ms": 13.496082974597812, "input_usage": {"receiver_prompt_tokens": 402, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887514200, "mlx_cache_bytes": 6744084256, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12887514200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 934 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "80d795d4f78e8bc75c70e578", "attempt_id": "82b8245589af", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.085928Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 418, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.85887492634356, "ttft_ms": 13.45916697755456, "decode_ms": 67.25741596892476}, "total_wall_ms": 137.3293340438977, "ttft_ms": 13.45916697755456, "input_usage": {"receiver_prompt_tokens": 418, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12896492632, "mlx_cache_bytes": 6993399584, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12896492632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,107,545", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "3d6a277763361ef55b8dd3f9791012605d24cd167ac5bdcdd0064ee16de161d4"} | ||||
| 935 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "abe303922a84f8d4b08d69be", "attempt_id": "5f1cf355f701", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.238869Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 411, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.24604101385921, "ttft_ms": 13.556292047724128, "decode_ms": 67.26545898709446}, "total_wall_ms": 133.93687503412366, "ttft_ms": 13.556292047724128, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913269848, "mlx_cache_bytes": 7018630944, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12913269848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,107,545", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "3d6a277763361ef55b8dd3f9791012605d24cd167ac5bdcdd0064ee16de161d4"} | ||||
| 936 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e292bca595eb34b7f396265", "attempt_id": "14f228075449", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.388111Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 420, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.7792080109939, "ttft_ms": 13.763541937805712, "decode_ms": 13.706374913454056}, "total_wall_ms": 85.04429191816598, "ttft_ms": 13.763541937805712, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12897754200, "mlx_cache_bytes": 7253610272, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12897754200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 937 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "782046302d8c1a6e34416694", "attempt_id": "b1e76941abfc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.489328Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 414, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.67937493044883, "ttft_ms": 13.338166987523437, "decode_ms": 68.03566601593047}, "total_wall_ms": 134.94458398781717, "ttft_ms": 13.338166987523437, "input_usage": {"receiver_prompt_tokens": 414, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12893674584, "mlx_cache_bytes": 7375507232, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12893674584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,552,050", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "ad87e20bd977f623fb9b905380cfa224e0926ae7f600f13cbbb53d36d4eedd43"} | ||||
| 938 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "717a1c56b5bd3ab2eac95f8e", "attempt_id": "aed9fc6541ec", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.640383Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 410, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.23775003105402, "ttft_ms": 13.450833037495613, "decode_ms": 40.43929104227573}, "total_wall_ms": 106.92462499719113, "ttft_ms": 13.450833037495613, "input_usage": {"receiver_prompt_tokens": 410, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12917988440, "mlx_cache_bytes": 7455919904, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12917988440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "39.7", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "138c4b663aa3391624efc0a351c82fa6339a5f7ce2617bbf767a8c33c9c6c3e7"} | ||||
| 939 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eea1a72fbee1225a5f855bc2", "attempt_id": "cfa96472a7a6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.763259Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 414, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.05125000793487, "ttft_ms": 13.479999965056777, "decode_ms": 13.832750031724572}, "total_wall_ms": 80.14179195743054, "ttft_ms": 13.479999965056777, "input_usage": {"receiver_prompt_tokens": 414, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12893674584, "mlx_cache_bytes": 7455919904, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12893674584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 940 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0346b5dab49df4404c0ede8", "attempt_id": "af9f2cd401bc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.859019Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 416, "message_tokens": 290, "message_utf8_bytes": 801, "cache_tensor_bytes": null, "serialized_payload_bytes": 801, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7389.394083991647, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.1352500654757, "ttft_ms": 13.682791963219643, "decode_ms": 13.617833028547466}, "total_wall_ms": 80.2814579801634, "ttft_ms": 13.682791963219643, "input_usage": {"receiver_prompt_tokens": 416, "sender_input_tokens": 1881, "sender_output_tokens": 512, "sender_prefill_ms": 199.82924999203533, "sender_ttft_ms": 14.002959011122584, "sender_decode_ms": 7173.908332944848}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920453120, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12916251736, "mlx_cache_bytes": 7563071264, "process_rss_bytes": 920453120}, "peak_prefill_memory": null, "peak_decode_memory": 12916251736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f20d5b14ff61baea096a6f3bb507991b229fec7e47ea14e8bf9ee596fbc1e568", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 941 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b60c780184cdf38726ce1ac2", "attempt_id": "f479a2436191", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:57.957173Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 603, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.76495893206447, "ttft_ms": 13.732124934904277, "decode_ms": 13.416375033557415}, "total_wall_ms": 102.9039160348475, "ttft_ms": 13.732124934904277, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920485888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628304, "mlx_cache_bytes": 7922241312, "process_rss_bytes": 920485888}, "peak_prefill_memory": null, "peak_decode_memory": 13031628304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 942 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8782b42557733d912c7cdaf7", "attempt_id": "a88aad96f13e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:58.075611Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 593, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.37399995978922, "ttft_ms": 13.54120799805969, "decode_ms": 27.207500068470836}, "total_wall_ms": 116.13579199183732, "ttft_ms": 13.54120799805969, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 920485888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13025435152, "mlx_cache_bytes": 8275054368, "process_rss_bytes": 920485888}, "peak_prefill_memory": null, "peak_decode_memory": 13025435152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 943 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e88a058e116a6e27a85e9e7", "attempt_id": "9abc8785a18a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:58.207271Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 593, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.32866597082466, "ttft_ms": 13.659375021234155, "decode_ms": 27.497207978740335}, "total_wall_ms": 116.49425001814961, "ttft_ms": 13.659375021234155, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 920485888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13025435152, "mlx_cache_bytes": 8275054368, "process_rss_bytes": 920485888}, "peak_prefill_memory": null, "peak_decode_memory": 13025435152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 944 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8b13d0598f95d15728eb40b8", "attempt_id": "0783f877c51e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:58.339247Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 609, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.76720795966685, "ttft_ms": 13.495333027094603, "decode_ms": 67.92179099284112}, "total_wall_ms": 157.1732920128852, "ttft_ms": 13.495333027094603, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 920485888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034855952, "mlx_cache_bytes": 8547749664, "process_rss_bytes": 920485888}, "peak_prefill_memory": null, "peak_decode_memory": 13034855952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,107,545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "3d6a277763361ef55b8dd3f9791012605d24cd167ac5bdcdd0064ee16de161d4"} | ||||
| 945 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7ee4a2911b42649837744d27", "attempt_id": "c4e0d5c21800", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:58.512313Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 602, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.24416695721447, "ttft_ms": 13.839124934747815, "decode_ms": 68.25479201506823}, "total_wall_ms": 157.3148750467226, "ttft_ms": 13.839124934747815, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 920485888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628304, "mlx_cache_bytes": 8547749664, "process_rss_bytes": 920485888}, "peak_prefill_memory": null, "peak_decode_memory": 13031628304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 946 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "abdda1b79c663900370322c1", "attempt_id": "6d4ddceee680", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:58.685488Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 611, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.15595799870789, "ttft_ms": 13.917083968408406, "decode_ms": 67.8192920750007}, "total_wall_ms": 158.93483301624656, "ttft_ms": 13.917083968408406, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 920485888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13074980368, "mlx_cache_bytes": 8671432480, "process_rss_bytes": 920485888}, "peak_prefill_memory": null, "peak_decode_memory": 13074980368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 947 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7bfee23cfe7ecf9ff5dae272", "attempt_id": "38699c03f49c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:58.859333Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 605, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.4876250391826, "ttft_ms": 13.841500040143728, "decode_ms": 67.53587489947677}, "total_wall_ms": 156.91549994517118, "ttft_ms": 13.841500040143728, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 920502272, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13055729168, "mlx_cache_bytes": 8912785184, "process_rss_bytes": 920502272}, "peak_prefill_memory": null, "peak_decode_memory": 13055729168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,511,780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "5fe0470d868c4456f2896acc9023c624005e418906653e1279e662a21fdf77d0"} | ||||
| 948 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7b3cad26e6c2f4d0536f28ba", "attempt_id": "998e971e99cf", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.032170Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 601, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.27637500222772, "ttft_ms": 13.66512500680983, "decode_ms": 13.5116659803316}, "total_wall_ms": 102.49183292035013, "ttft_ms": 13.66512500680983, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920502272, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031267856, "mlx_cache_bytes": 9030749984, "process_rss_bytes": 920502272}, "peak_prefill_memory": null, "peak_decode_memory": 13031267856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 949 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb323ec0e815d54e10ade09e", "attempt_id": "7b954551f104", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.151044Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 605, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.43316699936986, "ttft_ms": 13.802415924146771, "decode_ms": 13.591459020972252}, "total_wall_ms": 102.81537508126348, "ttft_ms": 13.802415924146771, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920502272, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13063200272, "mlx_cache_bytes": 9030749984, "process_rss_bytes": 920502272}, "peak_prefill_memory": null, "peak_decode_memory": 13063200272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 950 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1e9ca590032f10e8631f9c65", "attempt_id": "066216e45b8a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.269296Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 607, "message_tokens": 496, "message_utf8_bytes": 1569, "cache_tensor_bytes": null, "serialized_payload_bytes": 1569, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6137079801410437, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.86354205664247, "ttft_ms": 13.428417034447193, "decode_ms": 13.732708059251308}, "total_wall_ms": 102.04270808026195, "ttft_ms": 13.428417034447193, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 920502272, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13041982992, "mlx_cache_bytes": 9153629984, "process_rss_bytes": 920502272}, "peak_prefill_memory": null, "peak_decode_memory": 13041982992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6b5091d78c7f43accf3dc27a0c15a2efaac07606e355bce4f70a3d30ce8cbd27", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 951 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bdc69b65e5fce48e7847cbc9", "attempt_id": "52dd025b6f9d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.594549Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 46, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.601291005499661, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.14633305184543, "ttft_ms": 18.14633305184543, "decode_ms": 96.92450007423759}, "total_wall_ms": 118.06329200044274, "ttft_ms": 18.14633305184543, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1022967808, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12959618288, "mlx_cache_bytes": 9706655889, "process_rss_bytes": 1022967808}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12959618288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LS-33C-1476", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "4aeba35fb3e8d9d47179ee60a6bd6ff1016207db144b73b4313f46232cf15dc7"} | ||||
| 952 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "299f37431b8a418698b0b42e", "attempt_id": "e535c964df11", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.728228Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 36, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.5659170458093286, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.597165890038013, "ttft_ms": 17.597165890038013, "decode_ms": 13.625374995172024}, "total_wall_ms": 34.10641697701067, "ttft_ms": 17.597165890038013, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1022967808, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12950148336, "mlx_cache_bytes": 9795309713, "process_rss_bytes": 1022967808}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12950148336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 953 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "205f4a8170e89b785bfeb51a", "attempt_id": "a63a65ba9beb", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.777871Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 36, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.6127090202644467, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.004749970510602, "ttft_ms": 17.004749970510602, "decode_ms": 13.798292027786374}, "total_wall_ms": 33.73762499541044, "ttft_ms": 17.004749970510602, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1022967808, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12950148336, "mlx_cache_bytes": 9795309713, "process_rss_bytes": 1022967808}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12950148336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 954 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "03e43f4c65dcff462a80dd4a", "attempt_id": "dd9223aa5e4b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.827075Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 52, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.5427080215886235, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.002041964791715, "ttft_ms": 18.002041964791715, "decode_ms": 82.46608404442668}, "total_wall_ms": 103.39725005906075, "ttft_ms": 18.002041964791715, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 52}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1022967808, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12964304136, "mlx_cache_bytes": 9825623233, "process_rss_bytes": 1022967808}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12964304136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "$1,200,000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "c65fb0b30b6d53053b7ac31a459756c6a05c57d96b29647f4c197b4e8ff82bcb"} | ||||
| 955 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5eaa05d3e095fad15f0dafa1", "attempt_id": "96fc7bd8d77a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:51:59.946404Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 45, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.709250034764409, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.59037491865456, "ttft_ms": 17.59037491865456, "decode_ms": 27.87216706201434}, "total_wall_ms": 48.520624986849725, "ttft_ms": 17.59037491865456, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1022967808, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12961535216, "mlx_cache_bytes": 9830800577, "process_rss_bytes": 1022967808}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12961535216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 956 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "36c453c402f08eee7614f646", "attempt_id": "88ce77652991", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.010181Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 54, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.666791969910264, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.007166916504502, "ttft_ms": 18.007166916504502, "decode_ms": 69.80575004126877}, "total_wall_ms": 90.8564159180969, "ttft_ms": 18.007166916504502, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1022967808, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12967843088, "mlx_cache_bytes": 9872419285, "process_rss_bytes": 1022967808}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12967843088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 957 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "598a5d11aead44c474d10c50", "attempt_id": "6e5c51195dd9", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.117285Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 48, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.707041054032743, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.77662499807775, "ttft_ms": 17.77662499807775, "decode_ms": 69.55429201480001}, "total_wall_ms": 90.42587503790855, "ttft_ms": 17.77662499807775, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1022967808, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12960584968, "mlx_cache_bytes": 9895750101, "process_rss_bytes": 1022967808}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12960584968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,807,750", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "46c7bca5f0922014cd79728607471c93622e1cabb6696266860667c4f9a57ac3"} | ||||
| 958 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a540cb21736da6b9fd632128", "attempt_id": "1ddf4e7e9c05", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.224036Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 44, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.4657090650871396, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.931749927811325, "ttft_ms": 17.931749927811325, "decode_ms": 192.91416695341468}, "total_wall_ms": 216.5459159296006, "ttft_ms": 17.931749927811325, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 44}, "output_usage": {"output_tokens": 14}, "provider_cached_usage": null, "process_memory": 1023016960, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12961453296, "mlx_cache_bytes": 9917131221, "process_rss_bytes": 1023016960}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12961453296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "There is no information about Praymi-11 in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "b4df0a5bb61423b8839111736beb344e9431c26ad9e4303739ddc39e02fc6aeb"} | ||||
| 959 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db35c7fb84d4384cfd989f02", "attempt_id": "01044782442e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.456638Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 48, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.5606670640408993, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.602792009711266, "ttft_ms": 17.602792009711266, "decode_ms": 27.632958022877574}, "total_wall_ms": 48.131666029803455, "ttft_ms": 17.602792009711266, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 48}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1023033344, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12960584968, "mlx_cache_bytes": 9918966229, "process_rss_bytes": 1023033344}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12960584968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 960 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "240ea7048f31ca26e4ff3ac5", "attempt_id": "77b45edc5af4", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.521095Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12854285320}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1777, "keep": 444, "compress_ms": 10.578791028819978}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 50, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934355, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 207.4632910080254, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.615625069476664, "serialize_ms": 10.54808299522847, "load_ms": 1.4893750194460154, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.987165949307382, "ttft_ms": 17.987165949307382, "decode_ms": 13.653584057465196}, "total_wall_ms": 34.46966700721532, "ttft_ms": 17.987165949307382, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1023033344, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12966089992, "mlx_cache_bytes": 9946999253, "process_rss_bytes": 1023033344}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12966089992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cf121cec30db69aa0278e472f1e4135c4021a15a08717719b7d4acbbacd2d834", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 961 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b25962134abace1dedf3048c", "attempt_id": "073c819227e1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.571697Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 46, "compress_ms": 48.778624972328544}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 46, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934395, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 60.10491703636944, "doc_prefill_ms": 183.69270802941173, "compress_ms": 50.03154103178531, "serialize_ms": 9.88937506917864, "load_ms": 0.5404999246820807, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.48920895624906, "ttft_ms": 17.48920895624906, "decode_ms": 95.90620896779001}, "total_wall_ms": 175.54950003977865, "ttft_ms": 17.48920895624906, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1023967232, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12959618288, "mlx_cache_bytes": 10186484285, "process_rss_bytes": 1023967232}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12959618288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5fe9f9224a2235a341a6075ac5c352492962dcfe86be94ddbf512282a6f7b8d", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 962 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d99c4c0e2c9fbbb01adcc208", "attempt_id": "f78004b7f6fc", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.762981Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 36, "compress_ms": 43.76633302308619}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 36, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.404292022809386, "doc_prefill_ms": 183.69270802941173, "compress_ms": 45.04837503191084, "serialize_ms": 9.175124927423894, "load_ms": 1.4736659359186888, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.808749991469085, "ttft_ms": 16.808749991469085, "decode_ms": 27.30920899193734}, "total_wall_ms": 101.37720801867545, "ttft_ms": 16.808749991469085, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1075412992, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12950148336, "mlx_cache_bytes": 10205522493, "process_rss_bytes": 1075412992}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12950148336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 963 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c85b5ba2b4288d9974b35ce3", "attempt_id": "8d06ba9aaf4c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.880482Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 36, "compress_ms": 42.93312504887581}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 36, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.079041954129934, "doc_prefill_ms": 183.69270802941173, "compress_ms": 44.19391602277756, "serialize_ms": 7.709499914199114, "load_ms": 0.5610419902950525, "receiver_prefill_ms": 0.0, "query_prefill_ms": 16.83229103218764, "ttft_ms": 16.83229103218764, "decode_ms": 27.257459005340934}, "total_wall_ms": 98.16166595555842, "ttft_ms": 16.83229103218764, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1075412992, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12950148336, "mlx_cache_bytes": 10205522493, "process_rss_bytes": 1075412992}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12950148336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 964 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf792ab2ca8919466f508189", "attempt_id": "e964369837f5", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:00.994843Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 52, "compress_ms": 44.9821250513196}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 52, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934393, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.43233402911574, "doc_prefill_ms": 183.69270802941173, "compress_ms": 46.25787504483014, "serialize_ms": 7.986208074726164, "load_ms": 1.521207974292338, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.530082957819104, "ttft_ms": 17.530082957819104, "decode_ms": 69.07025002874434}, "total_wall_ms": 143.97887489758432, "ttft_ms": 17.530082957819104, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1075412992, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12964304136, "mlx_cache_bytes": 10214844989, "process_rss_bytes": 1075412992}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12964304136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,107,545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8e11a92ca8434c0cfeb259e989e26d99f5f17004bfde5cad93e10855381a39f0", "output_hash": "3d6a277763361ef55b8dd3f9791012605d24cd167ac5bdcdd0064ee16de161d4"} | ||||
| 965 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f4480ef8d1d63cb90688aa40", "attempt_id": "0bb944a65a64", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:01.155780Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 45, "compress_ms": 43.23537496384233}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 45, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.0714579615742, "doc_prefill_ms": 183.69270802941173, "compress_ms": 44.485207996331155, "serialize_ms": 7.408624980598688, "load_ms": 1.4097080565989017, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.81279193609953, "ttft_ms": 21.81279193609953, "decode_ms": 69.04029194265604}, "total_wall_ms": 145.72808390948921, "ttft_ms": 21.81279193609953, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1075429376, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12961846512, "mlx_cache_bytes": 10225478205, "process_rss_bytes": 1075429376}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12961846512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 966 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "61798f40a55d04d14df78bb0", "attempt_id": "bd97d4ec08fa", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:01.318248Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 54, "compress_ms": 43.855833006091416}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 54, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934395, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.42625000048429, "doc_prefill_ms": 183.69270802941173, "compress_ms": 45.15499994158745, "serialize_ms": 8.072958094999194, "load_ms": 1.3166250428184867, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.627208027988672, "ttft_ms": 17.627208027988672, "decode_ms": 68.92900005914271}, "total_wall_ms": 142.7040830021724, "ttft_ms": 17.627208027988672, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1075429376, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12967843088, "mlx_cache_bytes": 10251430461, "process_rss_bytes": 1075429376}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12967843088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5fe9f9224a2235a341a6075ac5c352492962dcfe86be94ddbf512282a6f7b8d", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 967 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a426d610038ff7707d22323d", "attempt_id": "558e88f891e4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:01.477600Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 48, "compress_ms": 43.879417004063725}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 48, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934395, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.12620894983411, "doc_prefill_ms": 183.69270802941173, "compress_ms": 45.170290977694094, "serialize_ms": 7.74762500077486, "load_ms": 1.3970410218462348, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.447541933506727, "ttft_ms": 17.447541933506727, "decode_ms": 69.60612500552088}, "total_wall_ms": 142.93450000695884, "ttft_ms": 17.447541933506727, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1075445760, "backend_memory": {"mlx_active_bytes": 12913005576, "mlx_peak_bytes": 12960584968, "mlx_cache_bytes": 10259622461, "process_rss_bytes": 1075445760}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12960584968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,191,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b5fe9f9224a2235a341a6075ac5c352492962dcfe86be94ddbf512282a6f7b8d", "output_hash": "1924dfa4bfca65dd175305972f24e92e813ac41f960da791a606cb1e0232d292"} | ||||
| 968 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fbcba5ee53cbbab2b600137b", "attempt_id": "f5dcaa901567", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:01.636775Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 44, "compress_ms": 44.10254198592156}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 44, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.0376659007743, "doc_prefill_ms": 183.69270802941173, "compress_ms": 45.3716249903664, "serialize_ms": 7.468791911378503, "load_ms": 1.577500021085143, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.49004190787673, "ttft_ms": 17.49004190787673, "decode_ms": 41.33108293171972}, "total_wall_ms": 114.88070897758007, "ttft_ms": 17.49004190787673, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1075445760, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12961125616, "mlx_cache_bytes": 10268977725, "process_rss_bytes": 1075445760}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12961125616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "39.7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "138c4b663aa3391624efc0a351c82fa6339a5f7ce2617bbf767a8c33c9c6c3e7"} | ||||
| 969 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "82f3e8ce6958f9cc5a331f85", "attempt_id": "4abe92906135", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:01.768580Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 48, "compress_ms": 43.08412503451109}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 48, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.515333984047174, "doc_prefill_ms": 183.69270802941173, "compress_ms": 44.358208077028394, "serialize_ms": 7.977167028002441, "load_ms": 1.4286659425124526, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.566791968420148, "ttft_ms": 17.566791968420148, "decode_ms": 13.65974999498576}, "total_wall_ms": 86.60745900124311, "ttft_ms": 17.566791968420148, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1075445760, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12960584968, "mlx_cache_bytes": 10268977725, "process_rss_bytes": 1075445760}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12960584968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 970 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "169a40d558a265b4748a56fc", "attempt_id": "d4f13f2a5c2b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:01.871645Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12802905096}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1777, "keep": 444, "window_tokens": 50, "compress_ms": 44.05849997419864}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 50, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 50921472, "serialized_payload_bytes": 50934394, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.20887500420213, "doc_prefill_ms": 183.69270802941173, "compress_ms": 45.32100004144013, "serialize_ms": 7.703457958996296, "load_ms": 1.5158330788835883, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.575833946466446, "ttft_ms": 17.575833946466446, "decode_ms": 13.538166065700352}, "total_wall_ms": 87.25854207295924, "ttft_ms": 17.575833946466446, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1075445760, "backend_memory": {"mlx_active_bytes": 12911170568, "mlx_peak_bytes": 12962583816, "mlx_cache_bytes": 10289965629, "process_rss_bytes": 1075445760}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 12962583816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c9d91a861ffacc54c7017a4606b32df48edb205aabcd8cb2dedf3597ef75df30", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 971 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31d394b1c17467c3a19a5e02", "attempt_id": "71fb8af5922b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:02.004389Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 46, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 3.106791991740465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.42633295059204, "ttft_ms": 20.42633295059204, "decode_ms": 105.07024999242276}, "total_wall_ms": 129.95504098944366, "ttft_ms": 20.42633295059204, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13025907720, "mlx_peak_bytes": 13113348964, "mlx_cache_bytes": 10696326205, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13113348964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "EP-52G-1330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "104db207937fd79e23ce16f9b3f10b1a9ed34f6dd0441a99be6ea1b2d0a09d99"} | ||||
| 972 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a49d650661ea9f6558a16ca5", "attempt_id": "b4f75a616fbc", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:02.150746Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 36, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 2.3202080046758056, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.839750020764768, "ttft_ms": 19.839750020764768, "decode_ms": 29.713458963669837}, "total_wall_ms": 53.26399998739362, "ttft_ms": 19.839750020764768, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13099595528, "mlx_cache_bytes": 10719844157, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13099595528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 973 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "153fdc38ea97dde68f856e11", "attempt_id": "f63a1bb809d8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:02.220136Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 36, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 2.1605000365525484, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.695165916346014, "ttft_ms": 19.695165916346014, "decode_ms": 29.779916047118604}, "total_wall_ms": 52.909040939994156, "ttft_ms": 19.695165916346014, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13099661128, "mlx_cache_bytes": 10719844157, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13099661128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 974 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c6b1847dd28390b07cdd816", "attempt_id": "f1a4a1cb4ee4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:02.289294Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 52, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 2.1716670598834753, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.686125033535063, "ttft_ms": 20.686125033535063, "decode_ms": 74.06154205091298}, "total_wall_ms": 98.23862498160452, "ttft_ms": 20.686125033535063, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13025907720, "mlx_peak_bytes": 13109244108, "mlx_cache_bytes": 10746705853, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13109244108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,107,545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "3d6a277763361ef55b8dd3f9791012605d24cd167ac5bdcdd0064ee16de161d4"} | ||||
| 975 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e15bbbe8ca511e6a8992a3cb", "attempt_id": "2bfee036f1bc", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:02.402981Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 45, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 1.1888340814039111, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.063834032043815, "ttft_ms": 20.063834032043815, "decode_ms": 74.08954203128815}, "total_wall_ms": 96.66570799890906, "ttft_ms": 20.063834032043815, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13025907720, "mlx_peak_bytes": 13116916872, "mlx_cache_bytes": 10774345661, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13116916872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,112,735", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "788fcda908c2029597420995b09d0cc919bfdbf7a28b68dcb0e331db7df7b342"} | ||||
| 976 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6ee3c3ff800ad1e01dc2f07f", "attempt_id": "a11c88ad3fbe", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:02.515721Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 54, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 2.2363329771906137, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.819249912165105, "ttft_ms": 20.819249912165105, "decode_ms": 73.9520420320332}, "total_wall_ms": 98.35229092277586, "ttft_ms": 20.819249912165105, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13025907720, "mlx_peak_bytes": 13111767508, "mlx_cache_bytes": 10802977149, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13111767508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Praymi-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "849597882f995af2b27ff5870d3e46a2cdcc4c3f2814b3873f634447a51e5f26"} | ||||
| 977 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7069b50edb717b7a328974f", "attempt_id": "5ca5b9ab98be", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:02.629901Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 48, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 1.985624898225069, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.31883306335658, "ttft_ms": 20.31883306335658, "decode_ms": 385.2810419630259}, "total_wall_ms": 408.96475000772625, "ttft_ms": 20.31883306335658, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 48}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13026825224, "mlx_peak_bytes": 13116363456, "mlx_cache_bytes": 10968373629, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13116363456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,908,553 + 5,631,925 + 4,724,290 = 19,284,768", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "fded944830535103864e2459cd918f5825b3ca00388b67ec72ab373b2c29be37"} | ||||
| 978 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ecebbdca49566deb1181085a", "attempt_id": "54caadc48519", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:03.055147Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 44, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 2.195541048422456, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.197874982841313, "ttft_ms": 20.197874982841313, "decode_ms": 44.82137493323535}, "total_wall_ms": 68.56754096224904, "ttft_ms": 20.197874982841313, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13024990216, "mlx_peak_bytes": 13115571784, "mlx_cache_bytes": 10970208637, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13115571784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "39.7", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "138c4b663aa3391624efc0a351c82fa6339a5f7ce2617bbf767a8c33c9c6c3e7"} | ||||
| 979 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1704d23b22d4fad72f87ac07", "attempt_id": "df88caab2385", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:03.139466Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 48, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 2.1365840220823884, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.914125092327595, "ttft_ms": 19.914125092327595, "decode_ms": 15.159457921981812}, "total_wall_ms": 38.52075000759214, "ttft_ms": 19.914125092327595, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13025907720, "mlx_peak_bytes": 13116361776, "mlx_cache_bytes": 10969291133, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13116361776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 980 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5a4971f441690b0b9b5f6710", "attempt_id": "38c47fa07d96", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:03.195246Z", "task_family": "synthetic", "document_id": "syn_03006_2000", "document_hash": "89be5e77e0ca114963e9ffdf8dc38fe5610f13a78ac29e7a1956cd9124ce5217", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03006_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12913054728}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1717, "source_tokens_receiver": 1717, "query_tokens": 50, "message_tokens": 1777, "message_utf8_bytes": 7159, "cache_tensor_bytes": 108269056, "serialized_payload_bytes": 108296172, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.140040976926684, "doc_prefill_ms": 183.69270802941173, "compress_ms": 10.336875100620091, "serialize_ms": 18.520875019021332, "load_ms": 2.2452499251812696, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.452624885365367, "ttft_ms": 20.452624885365367, "decode_ms": 14.858540962450206}, "total_wall_ms": 38.84895797818899, "ttft_ms": 20.452624885365367, "input_usage": {"receiver_prefix_tokens": 1777, "dense_cache_bytes": 203800576, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1293778944, "backend_memory": {"mlx_active_bytes": 13025907720, "mlx_peak_bytes": 13119902400, "mlx_cache_bytes": 11000568189, "process_rss_bytes": 1293778944}, "peak_prefill_memory": 13243560108, "peak_decode_memory": 13119902400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03006_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1582f4a02b75f7e6b13b37c485f6a5fab26b77191a41de1a4e380f81886bb35c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 981 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6ef5580c5140bd2ce990cea4", "attempt_id": "46f07ffe0b40", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:03.310524Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5928, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 695.0102921109647, "ttft_ms": 14.234459027647972, "decode_ms": 139.27170902024955}, "total_wall_ms": 857.2623329237103, "ttft_ms": 14.234459027647972, "input_usage": {"receiver_prompt_tokens": 5928}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1159643136, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 2332849592, "process_rss_bytes": 1159643136}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 982 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "511ca680a0076b8ce2dfa422", "attempt_id": "aef317ef0bde", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:04.191070Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5920, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 762.7793329302222, "ttft_ms": 14.24087502527982, "decode_ms": 14.103166060522199}, "total_wall_ms": 799.7707090107724, "ttft_ms": 14.24087502527982, "input_usage": {"receiver_prompt_tokens": 5920}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159675904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3049878968, "process_rss_bytes": 1159675904}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 983 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31a13c80025fe235a18c6fa9", "attempt_id": "3d5c926eebb9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:05.012377Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5921, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 768.9009580062702, "ttft_ms": 14.616333995945752, "decode_ms": 14.421749976463616}, "total_wall_ms": 806.390916928649, "ttft_ms": 14.616333995945752, "input_usage": {"receiver_prompt_tokens": 5921}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159708672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3550442936, "process_rss_bytes": 1159708672}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 984 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cacc7c0e655a66cba6c7c546", "attempt_id": "21c5399e2bbf", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:05.840593Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5934, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 753.2590840710327, "ttft_ms": 14.173457981087267, "decode_ms": 97.23129204940051}, "total_wall_ms": 873.4654580475762, "ttft_ms": 14.173457981087267, "input_usage": {"receiver_prompt_tokens": 5934}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1159741440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13581177920, "mlx_cache_bytes": 4273239480, "process_rss_bytes": 1159741440}, "peak_prefill_memory": null, "peak_decode_memory": 13581177920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5403805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "ebd8c202e450e10a6d90509f598803c77ba6ed9c928c98df1eaddfa99eb333a4"} | ||||
| 985 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c7161cc74124371cb9fa767", "attempt_id": "2c91597fe607", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:06.736269Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5927, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 732.2934999829158, "ttft_ms": 14.035166008397937, "decode_ms": 124.89995907526463}, "total_wall_ms": 879.9561669584364, "ttft_ms": 14.035166008397937, "input_usage": {"receiver_prompt_tokens": 5927}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 4453135800, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 986 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2cb999d40056f01ca8ff2b67", "attempt_id": "da23fddfa47e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:07.638297Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5937, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 725.0495420303196, "ttft_ms": 14.066959032788873, "decode_ms": 83.54679204057902}, "total_wall_ms": 831.4365840051323, "ttft_ms": 14.066959032788873, "input_usage": {"receiver_prompt_tokens": 5937}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1159806976, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13581964352, "mlx_cache_bytes": 4958156216, "process_rss_bytes": 1159806976}, "peak_prefill_memory": null, "peak_decode_memory": 13581964352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithixymi-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "5919268fa866f12eb8b0497583904be835032b475afd544dc2eba31f2b4f6679"} | ||||
| 987 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47b50aaa50061998e423803e", "attempt_id": "aacdd7c47377", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:08.492173Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5929, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 744.7934589581564, "ttft_ms": 14.296874986030161, "decode_ms": 97.62454207520932}, "total_wall_ms": 865.4969589551911, "ttft_ms": 14.296874986030161, "input_usage": {"receiver_prompt_tokens": 5929}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1159839744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5460948408, "process_rss_bytes": 1159839744}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2348494", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "f3e12dbab4ba16d7555fe70f668f670f9092e3a7aa6065378dd6f7263564492f"} | ||||
| 988 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e7a3fe50b34ef21236a84ef", "attempt_id": "ee7e336a580a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:09.380054Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5927, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 735.5297080939636, "ttft_ms": 14.304582960903645, "decode_ms": 55.50879205111414}, "total_wall_ms": 814.0961669851094, "ttft_ms": 14.304582960903645, "input_usage": {"receiver_prompt_tokens": 5927}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1159872512, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5460948408, "process_rss_bytes": 1159872512}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.61", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "c85e09eb8176db9e00c43c8bdc564dd91330c9d14f2a52ad6bc7872931e4c7ef"} | ||||
| 989 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6e084f149f59b698647aeefd", "attempt_id": "97dbea5824c6", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:10.216724Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5932, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 748.6886250553653, "ttft_ms": 14.151584007777274, "decode_ms": 14.05504101421684}, "total_wall_ms": 785.4616249678656, "ttft_ms": 14.151584007777274, "input_usage": {"receiver_prompt_tokens": 5932}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159905280, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13618156608, "mlx_cache_bytes": 6057637304, "process_rss_bytes": 1159905280}, "peak_prefill_memory": null, "peak_decode_memory": 13618156608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 990 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "21c5d09aeb8ab7ff2a7ebfb8", "attempt_id": "e5392e4e6745", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:11.024663Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 5931, "message_tokens": 5843, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016208039596676826, "decode_payload_ms": 0.0, "receiver_prefill_ms": 787.0893330546096, "ttft_ms": 14.872417086735368, "decode_ms": 14.092667028307915}, "total_wall_ms": 824.7840420808643, "ttft_ms": 14.872417086735368, "input_usage": {"receiver_prompt_tokens": 5931}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159938048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13625627712, "mlx_cache_bytes": 6057637304, "process_rss_bytes": 1159938048}, "peak_prefill_memory": null, "peak_decode_memory": 13625627712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 991 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3c5b2987e37c2493272f1a05", "attempt_id": "23fc09833486", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:16.536892Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 366, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.86595795303583, "ttft_ms": 13.321709004230797, "decode_ms": 13.127333018928766}, "total_wall_ms": 75.34466590732336, "ttft_ms": 13.321709004230797, "input_usage": {"receiver_prompt_tokens": 366, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907305508, "mlx_cache_bytes": 7361907564, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12907305508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 992 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8b88565bbd5f2f590198220", "attempt_id": "78a5b983dd23", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:16.635318Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 358, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.89074999280274, "ttft_ms": 13.252333970740438, "decode_ms": 13.292333926074207}, "total_wall_ms": 75.34254097845405, "ttft_ms": 13.252333970740438, "input_usage": {"receiver_prompt_tokens": 358, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901177892, "mlx_cache_bytes": 7642041196, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12901177892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 993 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4286fdd9bbe6f0e5abc0f4a8", "attempt_id": "25506a5c28ef", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:16.733301Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 359, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.655084053985775, "ttft_ms": 13.052709051407874, "decode_ms": 13.186917058192194}, "total_wall_ms": 74.77516599465162, "ttft_ms": 13.052709051407874, "input_usage": {"receiver_prompt_tokens": 359, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901833252, "mlx_cache_bytes": 7838780268, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12901833252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 994 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bced8acfb4646d960e52ff0a", "attempt_id": "6343bd7d7b33", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:16.830168Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 372, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.90554195642471, "ttft_ms": 13.585499953478575, "decode_ms": 13.270499999634922}, "total_wall_ms": 75.6782500538975, "ttft_ms": 13.585499953478575, "input_usage": {"receiver_prompt_tokens": 372, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12911647292, "mlx_cache_bytes": 8141771064, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12911647292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 995 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "294b95440f60b22b118cbd5f", "attempt_id": "d4a0c73c1358", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:16.927758Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 365, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.06470905896276, "ttft_ms": 13.291790965013206, "decode_ms": 13.275457895360887}, "total_wall_ms": 75.53162495605648, "ttft_ms": 13.291790965013206, "input_usage": {"receiver_prompt_tokens": 365, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907043364, "mlx_cache_bytes": 8213336376, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12907043364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 996 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "98a2c1d1d8a26611344ccff6", "attempt_id": "a68b440a8c53", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:17.025596Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 375, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.302375013008714, "ttft_ms": 13.16400000359863, "decode_ms": 94.16858397889882}, "total_wall_ms": 156.55358298681676, "ttft_ms": 13.16400000359863, "input_usage": {"receiver_prompt_tokens": 375, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12914055752, "mlx_cache_bytes": 8506513168, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12914055752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Keryminov-10", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "47d4fb882fdd2db10f1e88942b3f981e24a10a4a4501ff56cdaf321c9eba1c18"} | ||||
| 997 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cebd33b7b3e42a566a3d520c", "attempt_id": "ece04d85e45a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:17.204539Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 367, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.99274995457381, "ttft_ms": 13.22125003207475, "decode_ms": 13.107041013427079}, "total_wall_ms": 75.21829195320606, "ttft_ms": 13.22125003207475, "input_usage": {"receiver_prompt_tokens": 367, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907698748, "mlx_cache_bytes": 8707446544, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12907698748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 998 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "88a914e4a2a0aac12234a220", "attempt_id": "68108d5346b1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:17.302598Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 365, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.024042043834925, "ttft_ms": 13.830334064550698, "decode_ms": 13.872417039237916}, "total_wall_ms": 76.62154198624194, "ttft_ms": 13.830334064550698, "input_usage": {"receiver_prompt_tokens": 365, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907043364, "mlx_cache_bytes": 8707446544, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12907043364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 999 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "926c0d226165452722ceb801", "attempt_id": "ad49b7aa770a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:17.401269Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 370, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.024707939475775, "ttft_ms": 13.395207934081554, "decode_ms": 13.193792081438005}, "total_wall_ms": 75.48450003378093, "ttft_ms": 13.395207934081554, "input_usage": {"receiver_prompt_tokens": 370, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12910467644, "mlx_cache_bytes": 8910083856, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12910467644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1000 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e5b7ed949c0c561471b40fa1", "attempt_id": "dbe90f196610", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:17.498806Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 369, "message_tokens": 277, "message_utf8_bytes": 1329, "cache_tensor_bytes": null, "serialized_payload_bytes": 1329, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4665.696499985643, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.793334000743926, "ttft_ms": 13.095833011902869, "decode_ms": 14.054166967980564}, "total_wall_ms": 75.93320799060166, "ttft_ms": 13.095833011902869, "input_usage": {"receiver_prompt_tokens": 369, "sender_input_tokens": 5959, "sender_output_tokens": 277, "sender_prefill_ms": 747.8036250686273, "sender_ttft_ms": 14.046333031728864, "sender_decode_ms": 3894.0831249346957}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160577024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909140540, "mlx_cache_bytes": 8982435600, "process_rss_bytes": 1160577024}, "peak_prefill_memory": null, "peak_decode_memory": 12909140540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e6e26a3ce2361d707c03fe9125f1a6f0e4fe34971fd8e4114db72478551ab3a3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1001 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49087fa209ccca7343d498f7", "attempt_id": "761033b16789", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:25.344349Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 420, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.01816591620445, "ttft_ms": 13.140375027433038, "decode_ms": 132.2892919415608}, "total_wall_ms": 200.34270803444088, "ttft_ms": 13.140375027433038, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950215420, "mlx_cache_bytes": 10330807708, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12950215420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 1002 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0fc7121fc5f88c7bf3873e73", "attempt_id": "77e5d42ef996", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:25.567545Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 412, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.15762509033084, "ttft_ms": 13.309374917298555, "decode_ms": 13.361666002310812}, "total_wall_ms": 79.67591704800725, "ttft_ms": 13.309374917298555, "input_usage": {"receiver_prompt_tokens": 412, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12944218876, "mlx_cache_bytes": 10580352412, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12944218876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1003 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f68d3155fccbe3f09f673f2", "attempt_id": "6a3467035ef7", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:25.669407Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 413, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.072708029299974, "ttft_ms": 13.447417062707245, "decode_ms": 13.06358294095844}, "total_wall_ms": 79.47895803954452, "ttft_ms": 13.447417062707245, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12944481020, "mlx_cache_bytes": 10733968796, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12944481020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1004 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47bbbea10ebf27d86e590e8c", "attempt_id": "262f44281719", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:25.771056Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 426, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.79325000103563, "ttft_ms": 13.54887499473989, "decode_ms": 13.561709085479379}, "total_wall_ms": 81.83454198297113, "ttft_ms": 13.54887499473989, "input_usage": {"receiver_prompt_tokens": 426, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12955392788, "mlx_cache_bytes": 11081622592, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12955392788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1005 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2f8392aa0bb3766567bf39dc", "attempt_id": "9732c69c2153", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:25.875988Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 419, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.66883298847824, "ttft_ms": 13.154208078049123, "decode_ms": 13.224542024545372}, "total_wall_ms": 80.85012494120747, "ttft_ms": 13.154208078049123, "input_usage": {"receiver_prompt_tokens": 419, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12949428988, "mlx_cache_bytes": 11311129664, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12949428988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1006 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f4087c00ae45dd7cf0461a2d", "attempt_id": "25243870e43e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:25.979462Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 429, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.6425830796361, "ttft_ms": 13.213625061325729, "decode_ms": 13.282582978717983}, "total_wall_ms": 81.00087498314679, "ttft_ms": 13.213625061325729, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12956965664, "mlx_cache_bytes": 11546274544, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12956965664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1007 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8e3e474abc8f13949655cac2", "attempt_id": "83965a71f62f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.082581Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 421, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.85266710072756, "ttft_ms": 13.382124947384, "decode_ms": 94.24537501763552}, "total_wall_ms": 162.39974997006357, "ttft_ms": 13.382124947384, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950608660, "mlx_cache_bytes": 11776961264, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12950608660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13234.5", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "8e67613ffd72e3e838198d5aaa0804dac1921d029e01e414ccf4c0d8df5057f2"} | ||||
| 1008 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "60acad526cf5e8ebce57ae3c", "attempt_id": "23aa0b5d3743", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.267807Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 419, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.39370807632804, "ttft_ms": 13.280541985295713, "decode_ms": 67.5183329731226}, "total_wall_ms": 135.02345804590732, "ttft_ms": 13.280541985295713, "input_usage": {"receiver_prompt_tokens": 419, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12949428988, "mlx_cache_bytes": 11776961264, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12949428988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "34.78", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "8e864b4bf29373b2682918a063990599bf75a03e60b5e25200030cf8c9f8124f"} | ||||
| 1009 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da0226daee14455ce977bac3", "attempt_id": "94d60fb66692", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.425033Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 424, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.28979098703712, "ttft_ms": 13.443624950014055, "decode_ms": 13.549915980547667}, "total_wall_ms": 81.12799993250519, "ttft_ms": 13.443624950014055, "input_usage": {"receiver_prompt_tokens": 424, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12900997884, "mlx_cache_bytes": 11951254256, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12900997884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1010 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d288445a1412adf842f85418", "attempt_id": "9264bcb3f48e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.528079Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 423, "message_tokens": 319, "message_utf8_bytes": 773, "cache_tensor_bytes": null, "serialized_payload_bytes": 773, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7747.767040971667, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.09612490236759, "ttft_ms": 13.169208075851202, "decode_ms": 13.35483300499618}, "total_wall_ms": 80.44729102402925, "ttft_ms": 13.169208075851202, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 5987, "sender_output_tokens": 512, "sender_prefill_ms": 686.4517499925569, "sender_ttft_ms": 13.91787501052022, "sender_decode_ms": 7042.630375013687}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160658944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12900801276, "mlx_cache_bytes": 12013480688, "process_rss_bytes": 1160658944}, "peak_prefill_memory": null, "peak_decode_memory": 12900801276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0ad3785fc1c635862cf032dd968bccaee5b860c1eaa198fc07f12bdba85eeb1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1011 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2237fab4839282b782ab7ae1", "attempt_id": "8c300a0d8e1c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.635296Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 596, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.49662503413856, "ttft_ms": 13.383375015109777, "decode_ms": 13.789874967187643}, "total_wall_ms": 98.6134170088917, "ttft_ms": 13.383375015109777, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992865368, "mlx_cache_bytes": 12409121520, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12992865368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1012 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9cbfc27387bf3cb688437b41", "attempt_id": "7d964d5f51ce", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.755797Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 588, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.85045899637043, "ttft_ms": 13.418624992482364, "decode_ms": 13.428583974018693}, "total_wall_ms": 97.65274997334927, "ttft_ms": 13.418624992482364, "input_usage": {"receiver_prompt_tokens": 588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12988146776, "mlx_cache_bytes": 12752005872, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12988146776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1013 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf59266af4618da5af21041a", "attempt_id": "4b280e1c1028", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.875169Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 589, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.3964579841122, "ttft_ms": 13.204582966864109, "decode_ms": 13.60087504144758}, "total_wall_ms": 97.19916607718915, "ttft_ms": 13.204582966864109, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12988638296, "mlx_cache_bytes": 12994226928, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12988638296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1014 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fbcafde036223ac8e8489dfa", "attempt_id": "e2ac3d81561c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:26.994800Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 602, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.67074999213219, "ttft_ms": 13.19879200309515, "decode_ms": 93.46899995580316}, "total_wall_ms": 178.30620903987437, "ttft_ms": 13.19879200309515, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994421848, "mlx_cache_bytes": 13360605936, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12994421848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5403805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "ebd8c202e450e10a6d90509f598803c77ba6ed9c928c98df1eaddfa99eb333a4"} | ||||
| 1015 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "795f567f93a1b2bfdda2eb46", "attempt_id": "44a11129035b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:27.195188Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 595, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.70158300828189, "ttft_ms": 13.551499927416444, "decode_ms": 119.88183297216892}, "total_wall_ms": 204.14520800113678, "ttft_ms": 13.551499927416444, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 13448194800, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1016 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "66d2444c04a826d62fc44d8e", "attempt_id": "a8961615ea30", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:27.421018Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 605, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.26283396407962, "ttft_ms": 13.562291976995766, "decode_ms": 79.54695797525346}, "total_wall_ms": 164.40241609234363, "ttft_ms": 13.562291976995766, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995601496, "mlx_cache_bytes": 13696903920, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12995601496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithixymi-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "5919268fa866f12eb8b0497583904be835032b475afd544dc2eba31f2b4f6679"} | ||||
| 1017 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "63e865b5e2326407de16bb51", "attempt_id": "496fc345ca33", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:27.608253Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 597, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.60279203485698, "ttft_ms": 13.203750015236437, "decode_ms": 133.06937494780868}, "total_wall_ms": 216.85391606297344, "ttft_ms": 13.203750015236437, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 13942270704, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20,007,722", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "c1a2dc50b31a1af1802e89796a6c1b94f3739ad40aac3938e75defc0b3fdfe27"} | ||||
| 1018 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7d286aeeec7a0ff3e98c767e", "attempt_id": "b45d813a433a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:27.847439Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 595, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.60108410567045, "ttft_ms": 13.356709037907422, "decode_ms": 93.50645903032273}, "total_wall_ms": 177.44512506760657, "ttft_ms": 13.356709037907422, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 13942270704, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8962475", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "75d87f5c0fd251be1b063e18688c9ea78dddb3720a2f1d1d112f38e0ca425264"} | ||||
| 1019 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f0adb53d172526f00df29b8", "attempt_id": "738d397e8b34", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:28.047208Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 600, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.13662508688867, "ttft_ms": 13.57133302371949, "decode_ms": 13.303000014275312}, "total_wall_ms": 97.98312501516193, "ttft_ms": 13.57133302371949, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008036952, "mlx_cache_bytes": 14211033840, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 13008036952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1020 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2ee1d7a827e04ec432fd8839", "attempt_id": "065117a11c8a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:28.167142Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 599, "message_tokens": 510, "message_utf8_bytes": 1251, "cache_tensor_bytes": null, "serialized_payload_bytes": 1251, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.314417019486427, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.58170898724347, "ttft_ms": 13.801417080685496, "decode_ms": 13.319958001375198}, "total_wall_ms": 97.74887503590435, "ttft_ms": 13.801417080685496, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1160691712, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012788312, "mlx_cache_bytes": 14299212528, "process_rss_bytes": 1160691712}, "peak_prefill_memory": null, "peak_decode_memory": 13012788312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8fd5f73341a421c1e7e76efbd3ea1b9a123cbc31b12268aec00389c3b632eb47", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1021 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "24d518fb430172cd690daa61", "attempt_id": "60c6552a693a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.051427Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 46, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.872749999165535, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.5520000141114, "ttft_ms": 27.5520000141114, "decode_ms": 151.41245792619884}, "total_wall_ms": 185.29000005219132, "ttft_ms": 27.5520000141114, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 46}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1215201280, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12977378552, "mlx_cache_bytes": 15104175201, "process_rss_bytes": 1215201280}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977378552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "FZ-81G-6737", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "020955253df4cc2067bc6c5fea663dab27a4b866a9b4b74d8bd1bd49e77add60"} | ||||
| 1022 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "feaedbf8b5207478760469d2", "attempt_id": "dcfbb2139d81", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.259340Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 38, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.7324999207630754, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.743540979921818, "ttft_ms": 23.743540979921818, "decode_ms": 14.149416936561465}, "total_wall_ms": 43.91895805019885, "ttft_ms": 23.743540979921818, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12970824952, "mlx_cache_bytes": 15127751777, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12970824952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1023 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9375be991e104b7568444f2d", "attempt_id": "cf110485f5bf", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.327849Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 39, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.6554169123992324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.857541964389384, "ttft_ms": 23.857541964389384, "decode_ms": 13.775125029496849}, "total_wall_ms": 43.74100000131875, "ttft_ms": 23.857541964389384, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12971201784, "mlx_cache_bytes": 15139613793, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12971201784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1024 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6d8f822bb6ec821dfae6b950", "attempt_id": "286d756f1435", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.393652Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 52, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 0.6840410642325878, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.67354102898389, "ttft_ms": 23.67354102898389, "decode_ms": 55.140208918601274}, "total_wall_ms": 83.69016600772738, "ttft_ms": 23.67354102898389, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 52}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12982392080, "mlx_cache_bytes": 15184162305, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12982392080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "0f8eb4b72b6e0c9e88b388eb967b49e067ef1004bf07bffc22c3acb13b43580a"} | ||||
| 1025 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2ae52fac813cc9fce2f2efe9", "attempt_id": "bee43a571b5b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.499150Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 45, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.7587080365046859, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.670500027947128, "ttft_ms": 23.670500027947128, "decode_ms": 69.42729197908193}, "total_wall_ms": 99.35308306012303, "ttft_ms": 23.670500027947128, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12977067256, "mlx_cache_bytes": 15197844970, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977067256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "5994471abb01112afcc18159f6cc74b4f511b99806da59b3caf5a9c173cacfc5"} | ||||
| 1026 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9adf7c1f52f26666ef95b328", "attempt_id": "71de3e7fc2d6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.620847Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 55, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.7622089944779873, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.11995909642428, "ttft_ms": 24.11995909642428, "decode_ms": 82.41262508090585}, "total_wall_ms": 112.52908397000283, "ttft_ms": 24.11995909642428, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12985144604, "mlx_cache_bytes": 15230662562, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12985144604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithixymi-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "5919268fa866f12eb8b0497583904be835032b475afd544dc2eba31f2b4f6679"} | ||||
| 1027 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "23a5aff415736d56d69b1c45", "attempt_id": "6030b8db79f3", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.755526Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 47, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.5972909750416875, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.871207959018648, "ttft_ms": 23.871207959018648, "decode_ms": 55.25995895732194}, "total_wall_ms": 84.89399997051805, "ttft_ms": 23.871207959018648, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 47}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12978197776, "mlx_cache_bytes": 15244949410, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12978197776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1054", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "7d7179c146d0d6af4ebd304ab799a718fe949a8dcd660cd6d12fb97915f9ab0a"} | ||||
| 1028 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "55337b7eaf209b108ebb2028", "attempt_id": "6d4df333e24e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.862954Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 45, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.4320829650387168, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.740583914332092, "ttft_ms": 23.740583914332092, "decode_ms": 55.31195807270706}, "total_wall_ms": 84.75245803128928, "ttft_ms": 23.740583914332092, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 45}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12977067256, "mlx_cache_bytes": 15244949410, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977067256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1200", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "15197cf7214b58e67cae565e573ffd9aa44bcb81f8ee5d7185dfe8da0a16ef43"} | ||||
| 1029 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "19c007712eca7d71bb91e7ec", "attempt_id": "f7a0fd1b728c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:29.969696Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 50, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 0.7194590289145708, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.36116600781679, "ttft_ms": 23.36116600781679, "decode_ms": 13.676167000085115}, "total_wall_ms": 42.10770793724805, "ttft_ms": 23.36116600781679, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12982277392, "mlx_cache_bytes": 15280207778, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12982277392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1030 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1f3e7f56347feb918ab70a79", "attempt_id": "66eb315eff77", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:30.033774Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5882, "keep": 1470, "compress_ms": 10.05608297418803}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 49, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206268, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 764.6774159511551, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.095417033880949, "serialize_ms": 13.39954196009785, "load_ms": 1.648249919526279, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.363167001865804, "ttft_ms": 24.363167001865804, "decode_ms": 13.611541944555938}, "total_wall_ms": 43.979667010717094, "ttft_ms": 24.363167001865804, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1215217664, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12981703952, "mlx_cache_bytes": 15314565026, "process_rss_bytes": 1215217664}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981703952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "56d3c45b4a686248a09ea1e14c6fa15f23f6e3965a0d225813ba221774899e2a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1031 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a772fd38f67951aa095b6ca3", "attempt_id": "c5e13aa73d85", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:30.100343Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 46, "compress_ms": 68.48129199352115}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 46, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 85.07274999283254, "doc_prefill_ms": 732.3449170216918, "compress_ms": 72.87337502930313, "serialize_ms": 11.983916047029197, "load_ms": 0.6452500820159912, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.35820801090449, "ttft_ms": 23.35820801090449, "decode_ms": 137.62820803094655}, "total_wall_ms": 251.16491701919585, "ttft_ms": 23.35820801090449, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1216659456, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977116408, "mlx_cache_bytes": 15563117578, "process_rss_bytes": 1216659456}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977116408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 1032 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "56896fadec77e010cbf13ce8", "attempt_id": "a9c829e4ad65", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:30.373581Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 38, "compress_ms": 64.48741594795138}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 38, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 79.46083298884332, "doc_prefill_ms": 732.3449170216918, "compress_ms": 68.61974997445941, "serialize_ms": 10.62812504824251, "load_ms": 1.3231249758973718, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.81583391595632, "ttft_ms": 22.81583391595632, "decode_ms": 14.063874958083034}, "total_wall_ms": 122.07587505690753, "ttft_ms": 22.81583391595632, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1258881024, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12970595576, "mlx_cache_bytes": 15589725194, "process_rss_bytes": 1258881024}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12970595576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1033 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8d1eda5e7cbe39c5ef18d5bb", "attempt_id": "dcebe5baf3e6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:30.518673Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 39, "compress_ms": 62.10212502628565}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 39, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.14804101083428, "doc_prefill_ms": 732.3449170216918, "compress_ms": 66.58008298836648, "serialize_ms": 8.343083085492253, "load_ms": 0.5865830462425947, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.514625034295022, "ttft_ms": 23.514625034295022, "decode_ms": 13.848332921043038}, "total_wall_ms": 117.53604107070714, "ttft_ms": 23.514625034295022, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1258881024, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12970939640, "mlx_cache_bytes": 15590052874, "process_rss_bytes": 1258881024}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12970939640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1034 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2babe768ac37b02c1fe57311", "attempt_id": "6b2b81584e3f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:30.658993Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 52, "compress_ms": 61.54137500561774}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 52, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 74.39104106742889, "doc_prefill_ms": 732.3449170216918, "compress_ms": 65.91904198285192, "serialize_ms": 8.259415975771844, "load_ms": 1.4884580159559846, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.296999977901578, "ttft_ms": 23.296999977901578, "decode_ms": 95.68804199807346}, "total_wall_ms": 199.25783399958163, "ttft_ms": 23.296999977901578, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1258881024, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981884176, "mlx_cache_bytes": 15618151434, "process_rss_bytes": 1258881024}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981884176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4150875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "9f908cf585946283f90239132608e9f36a14f3587bfad3942073463dff2947a8"} | ||||
| 1035 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f1c73a9e63316a69e07ac288", "attempt_id": "8ba367a8e003", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:30.881027Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 45, "compress_ms": 63.1623329827562}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 45, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206307, "side_information_bytes": 16227, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 80.49695799127221, "doc_prefill_ms": 732.3449170216918, "compress_ms": 67.29733303654939, "serialize_ms": 12.991208001039922, "load_ms": 0.5867909640073776, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.468916886486113, "ttft_ms": 23.468916886486113, "decode_ms": 96.21949994470924}, "total_wall_ms": 205.2031250204891, "ttft_ms": 23.468916886486113, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1258897408, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976805112, "mlx_cache_bytes": 15635092490, "process_rss_bytes": 1258897408}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976805112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4150875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3014586931153e020201d10d5b0ccf321c2848a8a336297339c0bd88e866f0a5", "output_hash": "9f908cf585946283f90239132608e9f36a14f3587bfad3942073463dff2947a8"} | ||||
| 1036 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a4a0e44a97ac02d174957e4", "attempt_id": "8618496390e2", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:31.109438Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 55, "compress_ms": 63.11575009021908}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 55, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.1464579263702, "doc_prefill_ms": 732.3449170216918, "compress_ms": 67.31454201508313, "serialize_ms": 8.606291958130896, "load_ms": 1.3093330198898911, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.717083036899567, "ttft_ms": 23.717083036899567, "decode_ms": 95.87162500247359}, "total_wall_ms": 201.50458300486207, "ttft_ms": 23.717083036899567, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 55}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1258930176, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12984915228, "mlx_cache_bytes": 15673693194, "process_rss_bytes": 1258930176}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12984915228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Keryminov-10", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "47d4fb882fdd2db10f1e88942b3f981e24a10a4a4501ff56cdaf321c9eba1c18"} | ||||
| 1037 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6db79bb6fbd8260410e23754", "attempt_id": "e6062116cdc0", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:31.333496Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 47, "compress_ms": 63.52466600947082}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 47, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.1736249551177, "doc_prefill_ms": 732.3449170216918, "compress_ms": 67.65604193788022, "serialize_ms": 8.311541983857751, "load_ms": 1.527374959550798, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.4843329526484, "ttft_ms": 23.4843329526484, "decode_ms": 110.60358304530382}, "total_wall_ms": 216.24699991662055, "ttft_ms": 23.4843329526484, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1258930176, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977935632, "mlx_cache_bytes": 15691387914, "process_rss_bytes": 1258930176}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977935632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23284449", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "327e9254f1da6ede364a0587864efafaef2db86e1d8d8b51fa3a8ec6d8f9595d"} | ||||
| 1038 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2310319ad49e3ddf2d613655", "attempt_id": "e532fe380602", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:31.573037Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 45, "compress_ms": 62.53266695421189}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 45, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.08145796600729, "doc_prefill_ms": 732.3449170216918, "compress_ms": 66.66570901870728, "serialize_ms": 8.198499912396073, "load_ms": 0.5642080213874578, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.810582933947444, "ttft_ms": 23.810582933947444, "decode_ms": 55.816125008277595}, "total_wall_ms": 159.71825004089624, "ttft_ms": 23.810582933947444, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 45}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1258962944, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976805112, "mlx_cache_bytes": 15691387914, "process_rss_bytes": 1258962944}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976805112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.61", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "c85e09eb8176db9e00c43c8bdc564dd91330c9d14f2a52ad6bc7872931e4c7ef"} | ||||
| 1039 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d0a9b0c040eb09efd39c7353", "attempt_id": "61ed970dda44", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:31.755684Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 50, "compress_ms": 63.48787504248321}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 50, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.81695895735174, "doc_prefill_ms": 732.3449170216918, "compress_ms": 67.88400001823902, "serialize_ms": 8.722416940145195, "load_ms": 0.8954169461503625, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.860041935928166, "ttft_ms": 22.860041935928166, "decode_ms": 13.62966699525714}, "total_wall_ms": 118.66341705899686, "ttft_ms": 22.860041935928166, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1258979328, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12980753680, "mlx_cache_bytes": 15710213130, "process_rss_bytes": 1258979328}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12980753680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1040 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "42ace3ec190bdd285f3ebd6e", "attempt_id": "dfba6c60a847", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:31.897402Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5882, "keep": 1470, "window_tokens": 49, "compress_ms": 63.41341696679592}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 49, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 54190080, "serialized_payload_bytes": 54206308, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.10816601663828, "doc_prefill_ms": 732.3449170216918, "compress_ms": 67.51900003291667, "serialize_ms": 8.381041930988431, "load_ms": 1.126833027228713, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.71820795815438, "ttft_ms": 23.71820795815438, "decode_ms": 13.921209028922021}, "total_wall_ms": 119.50429202988744, "ttft_ms": 23.71820795815438, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1258979328, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12979918096, "mlx_cache_bytes": 15728661514, "process_rss_bytes": 1258979328}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979918096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "701e33883fd67b98a2e554becbf17528bad4559f33f163d707b2560a0dc1ec1d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1041 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d7c922116acb32fcd3fb28e2", "attempt_id": "c9d61f4df7e2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:32.072866Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 46, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.176624955609441, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.06633396539837, "ttft_ms": 28.06633396539837, "decode_ms": 152.9344579903409}, "total_wall_ms": 187.3982499819249, "ttft_ms": 28.06633396539837, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049582600, "mlx_peak_bytes": 13176473908, "mlx_cache_bytes": 15730969930, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13176473908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 1042 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "00c57d374a0b1aa128f16ce4", "attempt_id": "6ce2be2ea5a8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:32.283139Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 38, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.493874984793365, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.175540919415653, "ttft_ms": 27.175540919415653, "decode_ms": 15.514041995629668}, "total_wall_ms": 49.31887495331466, "ttft_ms": 27.175540919415653, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049418760, "mlx_peak_bytes": 13158533396, "mlx_cache_bytes": 15788805450, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13158533396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1043 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7ba2d40bcb99f946357a976c", "attempt_id": "dd1da3812153", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:32.355455Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 39, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.4401670088991523, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.42449997458607, "ttft_ms": 27.42449997458607, "decode_ms": 15.410957974381745}, "total_wall_ms": 49.68333395663649, "ttft_ms": 27.42449997458607, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049418760, "mlx_peak_bytes": 13160286484, "mlx_cache_bytes": 15848049994, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13160286484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1044 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2811a6e3090d254096eab146", "attempt_id": "0cb5aee04d18", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:32.427446Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 52, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.027333015576005, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.542208019644022, "ttft_ms": 28.542208019644022, "decode_ms": 106.64362506940961}, "total_wall_ms": 141.40037505421788, "ttft_ms": 28.542208019644022, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049648136, "mlx_peak_bytes": 13188931564, "mlx_cache_bytes": 15927075850, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13188931564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5403805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "ebd8c202e450e10a6d90509f598803c77ba6ed9c928c98df1eaddfa99eb333a4"} | ||||
| 1045 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fa311fd31ec7f76fc0965ae3", "attempt_id": "4ba5cd7bb509", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:32.591201Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 45, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.2727909963577986, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.777250041253865, "ttft_ms": 27.777250041253865, "decode_ms": 137.07212498411536}, "total_wall_ms": 171.32929200306535, "ttft_ms": 27.777250041253865, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049385992, "mlx_peak_bytes": 13174293844, "mlx_cache_bytes": 15995626506, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13174293844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1046 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "397fe27784783507d8a83ecf", "attempt_id": "f4e03ecaf986", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:32.784838Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 55, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.4650830309838057, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.541957959532738, "ttft_ms": 28.541957959532738, "decode_ms": 91.56091697514057}, "total_wall_ms": 126.96254102047533, "ttft_ms": 28.541957959532738, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049418760, "mlx_peak_bytes": 13196053320, "mlx_cache_bytes": 15996152858, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13196053320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithixymi-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "5919268fa866f12eb8b0497583904be835032b475afd544dc2eba31f2b4f6679"} | ||||
| 1047 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "be6823d803643d5876be6772", "attempt_id": "7b428c75748c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:32.935173Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 47, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.412875066511333, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.327042004093528, "ttft_ms": 28.327042004093528, "decode_ms": 106.54645902104676}, "total_wall_ms": 141.50233403779566, "ttft_ms": 28.327042004093528, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049648136, "mlx_peak_bytes": 13214080284, "mlx_cache_bytes": 16031640602, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13214080284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2348494", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "f3e12dbab4ba16d7555fe70f668f670f9092e3a7aa6065378dd6f7263564492f"} | ||||
| 1048 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c351bd798611fd349d77c553", "attempt_id": "60f98be922c7", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:33.099440Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 45, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 1.9024579087272286, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.79158391058445, "ttft_ms": 27.79158391058445, "decode_ms": 60.99379202350974}, "total_wall_ms": 95.15887498855591, "ttft_ms": 27.79158391058445, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 45}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049385992, "mlx_peak_bytes": 13174293556, "mlx_cache_bytes": 16031902746, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13174293556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.61", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "c85e09eb8176db9e00c43c8bdc564dd91330c9d14f2a52ad6bc7872931e4c7ef"} | ||||
| 1049 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "515cc416fcd74b10c3ef5d42", "attempt_id": "9827d88d3643", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:33.217375Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 50, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 2.3116659140214324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.276707977056503, "ttft_ms": 28.276707977056503, "decode_ms": 15.381167060695589}, "total_wall_ms": 50.289624952711165, "ttft_ms": 28.276707977056503, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049418760, "mlx_peak_bytes": 13185162524, "mlx_cache_bytes": 16107891738, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13185162524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1050 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "839970668d021154416ba2b1", "attempt_id": "97994c74560b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:33.291646Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932076552}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5843, "source_tokens_receiver": 5843, "query_tokens": 49, "message_tokens": 5882, "message_utf8_bytes": 29152, "cache_tensor_bytes": 115193088, "serialized_payload_bytes": 115227417, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 32.78949996456504, "doc_prefill_ms": 732.3449170216918, "compress_ms": 10.033875005319715, "serialize_ms": 22.412082995288074, "load_ms": 1.4034160412847996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.875708929263055, "ttft_ms": 28.875708929263055, "decode_ms": 15.356707968749106}, "total_wall_ms": 49.82050007674843, "ttft_ms": 28.875708929263055, "input_usage": {"receiver_prefix_tokens": 5882, "dense_cache_bytes": 216834048, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1489846272, "backend_memory": {"mlx_active_bytes": 13049418760, "mlx_peak_bytes": 13236821545, "mlx_cache_bytes": 16126503962, "process_rss_bytes": 1489846272}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13236821545, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "801b233f96f7ca8252ea4c130b17b3fbdd836bd86b4bc76094004db950308edc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1051 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47c861aff23c6487257c866a", "attempt_id": "6b3a8e01508a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:33.442109Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5738, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 675.2666670363396, "ttft_ms": 15.022833948023617, "decode_ms": 103.95487502682954}, "total_wall_ms": 802.0208749221638, "ttft_ms": 15.022833948023617, "input_usage": {"receiver_prompt_tokens": 5738}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13751456820, "mlx_cache_bytes": 2694832472, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13751456820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 1052 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b72382a1dfe1d0b7003ed3b", "attempt_id": "83f33dd58f47", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:34.273652Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5731, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 664.5612079882994, "ttft_ms": 14.85375000629574, "decode_ms": 29.629291035234928}, "total_wall_ms": 716.7425840161741, "ttft_ms": 14.85375000629574, "input_usage": {"receiver_prompt_tokens": 5731}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13749687348, "mlx_cache_bytes": 3076415832, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13749687348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1053 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ab8324b559f7ed5b61097ebb", "attempt_id": "be9bd8a90c8b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:35.011976Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5732, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 670.3766249120235, "ttft_ms": 14.868958038277924, "decode_ms": 29.577375040389597}, "total_wall_ms": 722.4972499534488, "ttft_ms": 14.868958038277924, "input_usage": {"receiver_prompt_tokens": 5732}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13750146100, "mlx_cache_bytes": 3458457944, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13750146100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1054 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28560a17035efa6636d0480e", "attempt_id": "6ebc0eb1d0bf", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:35.755765Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5746, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.210124976933, "ttft_ms": 14.847917016595602, "decode_ms": 73.80004099104553}, "total_wall_ms": 772.9282908840105, "ttft_ms": 14.847917016595602, "input_usage": {"receiver_prompt_tokens": 5746}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13753472052, "mlx_cache_bytes": 3874201944, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13753472052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1055 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fd8d4dec0336eb33b2851e16", "attempt_id": "63ccb5033f1b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:36.550612Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5739, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 679.2164170183241, "ttft_ms": 14.956458006054163, "decode_ms": 73.68291600141674}, "total_wall_ms": 775.668999995105, "ttft_ms": 14.956458006054163, "input_usage": {"receiver_prompt_tokens": 5739}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13751555124, "mlx_cache_bytes": 4035617112, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13751555124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1056 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "90530024ff7c8a6af80e94cc", "attempt_id": "b043dce150a9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:37.347782Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5748, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 686.7323749465868, "ttft_ms": 14.719082973897457, "decode_ms": 88.64983299281448}, "total_wall_ms": 797.7646660292521, "ttft_ms": 14.719082973897457, "input_usage": {"receiver_prompt_tokens": 5748}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13754029108, "mlx_cache_bytes": 4421394776, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13754029108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Keryminov-10", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "47d4fb882fdd2db10f1e88942b3f981e24a10a4a4501ff56cdaf321c9eba1c18"} | ||||
| 1057 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "19786b1682db7b911ed04898", "attempt_id": "a1c29535c0d2", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:38.166474Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5741, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 687.8551660338417, "ttft_ms": 15.454582986421883, "decode_ms": 74.37983294948936}, "total_wall_ms": 785.5198329780251, "ttft_ms": 15.454582986421883, "input_usage": {"receiver_prompt_tokens": 5741}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13752112180, "mlx_cache_bytes": 4805402968, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13752112180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17,531,750", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "a869cf18b73d7793f883a1229d85dc7ce83b7b2430df6cf309f2b9bdc8e33978"} | ||||
| 1058 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8914e9b1f17f76c19740e63c", "attempt_id": "264dd23971d7", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:38.973555Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5738, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 702.5096249999478, "ttft_ms": 15.59249998535961, "decode_ms": 45.65095796715468}, "total_wall_ms": 771.4084580074996, "ttft_ms": 15.59249998535961, "input_usage": {"receiver_prompt_tokens": 5738}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13751456820, "mlx_cache_bytes": 4805402968, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13751456820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.61", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "c85e09eb8176db9e00c43c8bdc564dd91330c9d14f2a52ad6bc7872931e4c7ef"} | ||||
| 1059 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7618e5e3810a584971bbdaeb", "attempt_id": "d0df12d53224", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:39.766259Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5743, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 726.7891250085086, "ttft_ms": 15.397666953504086, "decode_ms": 15.495916013605893}, "total_wall_ms": 765.396875096485, "ttft_ms": 15.397666953504086, "input_usage": {"receiver_prompt_tokens": 5743}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13793498164, "mlx_cache_bytes": 5027963224, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13793498164, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1060 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ffbdf18d7fcb329c1c8185d8", "attempt_id": "30483bf28b6f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:40.552869Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 5743, "message_tokens": 5633, "message_utf8_bytes": 29152, "cache_tensor_bytes": null, "serialized_payload_bytes": 29152, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009208917617797852, "decode_payload_ms": 0.0, "receiver_prefill_ms": 736.9197920197621, "ttft_ms": 15.583875006996095, "decode_ms": 15.194957959465683}, "total_wall_ms": 775.6091670598835, "ttft_ms": 15.583875006996095, "input_usage": {"receiver_prompt_tokens": 5743}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263353856, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13803639860, "mlx_cache_bytes": 5027963224, "process_rss_bytes": 1263353856}, "peak_prefill_memory": null, "peak_decode_memory": 13803639860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1061 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "202f1f3744acc982b44e1cc5", "attempt_id": "e02f09c53034", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:49.725208Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.33104098588228, "ttft_ms": 13.443875010125339, "decode_ms": 13.635374954901636}, "total_wall_ms": 108.33416704554111, "ttft_ms": 13.443875010125339, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263665152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 7075611404, "process_rss_bytes": 1263665152}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1062 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e7a3369be047bd698286e2e", "attempt_id": "02bbdc5988a2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:49.855676Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.77391695324332, "ttft_ms": 13.503166963346303, "decode_ms": 13.376582995988429}, "total_wall_ms": 104.73958298098296, "ttft_ms": 13.503166963346303, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263665152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083020, "mlx_cache_bytes": 7298712332, "process_rss_bytes": 1263665152}, "peak_prefill_memory": null, "peak_decode_memory": 13039083020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1063 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ac8b7c839945707c3ff9cfd", "attempt_id": "c8301364e9ce", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:49.981652Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 616, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.31204195786268, "ttft_ms": 13.631707988679409, "decode_ms": 13.532666955143213}, "total_wall_ms": 104.57604099065065, "ttft_ms": 13.631707988679409, "input_usage": {"receiver_prompt_tokens": 616, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263665152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640076, "mlx_cache_bytes": 7359267596, "process_rss_bytes": 1263665152}, "peak_prefill_memory": null, "peak_decode_memory": 13039640076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1064 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78472b9f65d883823a1b3f7d", "attempt_id": "083a12b4846e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:50.107865Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 630, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.70458306185901, "ttft_ms": 13.62587499897927, "decode_ms": 68.66375007666647}, "total_wall_ms": 161.23612504452467, "ttft_ms": 13.62587499897927, "input_usage": {"receiver_prompt_tokens": 630, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263665152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047176748, "mlx_cache_bytes": 7734430944, "process_rss_bytes": 1263665152}, "peak_prefill_memory": null, "peak_decode_memory": 13047176748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,644,474", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "45891fbe62951d2409b9d0682483fdbfd19a6f82c6a601a0f417aeaa6e93dd7f"} | ||||
| 1065 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0b011bdf453f441884670617", "attempt_id": "073b1d1dd41c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:50.290318Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 623, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.03462499193847, "ttft_ms": 13.906750013120472, "decode_ms": 13.668332947418094}, "total_wall_ms": 105.67670804448426, "ttft_ms": 13.906750013120472, "input_usage": {"receiver_prompt_tokens": 623, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263665152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043424812, "mlx_cache_bytes": 8021576928, "process_rss_bytes": 1263665152}, "peak_prefill_memory": null, "peak_decode_memory": 13043424812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "5feceb66ffc86f38d952786c6d696c79c2dbc239dd4e91b46729d73a27fb57e9"} | ||||
| 1066 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a1e82f4704732a68c6c5143", "attempt_id": "dcd764d7f594", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:50.418037Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 632, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.72266690153629, "ttft_ms": 13.646750012412667, "decode_ms": 81.2509999377653}, "total_wall_ms": 173.77570795360953, "ttft_ms": 13.646750012412667, "input_usage": {"receiver_prompt_tokens": 632, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1263681536, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048438324, "mlx_cache_bytes": 8374736572, "process_rss_bytes": 1263681536}, "peak_prefill_memory": null, "peak_decode_memory": 13048438324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithixymi-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "5919268fa866f12eb8b0497583904be835032b475afd544dc2eba31f2b4f6679"} | ||||
| 1067 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "83176d9098ce5c3888857e35", "attempt_id": "b57d5607ba60", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:50.612666Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.94412500131875, "ttft_ms": 13.7157499557361, "decode_ms": 67.41779204457998}, "total_wall_ms": 159.2410410521552, "ttft_ms": 13.7157499557361, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263697920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981868, "mlx_cache_bytes": 8558761660, "process_rss_bytes": 1263697920}, "peak_prefill_memory": null, "peak_decode_memory": 13043981868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,911,932", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "ce4d42591d3540cf18065f3b1d9432ce0370aef6c7e5b82f46c22fa1f4ae74af"} | ||||
| 1068 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "231d6fc59b6b4d19ad8a53cc", "attempt_id": "cc583bf01990", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:50.793226Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.58862497191876, "ttft_ms": 13.982333010062575, "decode_ms": 13.346959021873772}, "total_wall_ms": 105.02637503668666, "ttft_ms": 13.982333010062575, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263697920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 8558761660, "process_rss_bytes": 1263697920}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1069 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "84db0451ecf4c7a02aa08afe", "attempt_id": "642317b7dd6b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:50.919640Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.33604195527732, "ttft_ms": 13.64337489940226, "decode_ms": 13.450208003632724}, "total_wall_ms": 105.63058301340789, "ttft_ms": 13.64337489940226, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263697920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077192236, "mlx_cache_bytes": 8658802364, "process_rss_bytes": 1263697920}, "peak_prefill_memory": null, "peak_decode_memory": 13077192236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1070 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0d74f69d47eed7b4a1fbd761", "attempt_id": "9fde3bf0b6e1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:51.046849Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 2125, "cache_tensor_bytes": null, "serialized_payload_bytes": 2125, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8375.192791922018, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.55566702689976, "ttft_ms": 13.649750035256147, "decode_ms": 13.440374983474612}, "total_wall_ms": 105.75574997346848, "ttft_ms": 13.649750035256147, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 5767, "sender_output_tokens": 512, "sender_prefill_ms": 781.3405829947442, "sender_ttft_ms": 15.572417061775923, "sender_decode_ms": 7574.1464589955285}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263697920, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13084925484, "mlx_cache_bytes": 8658802364, "process_rss_bytes": 1263697920}, "peak_prefill_memory": null, "peak_decode_memory": 13084925484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "64acf754e1b6ca083016ef65f5ddccb98c36bbd8c0742275b316367bb153bf2f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1071 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0f552d20a2c24c13c799df4f", "attempt_id": "6c7a03cac541", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:59.450531Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 406, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.17974998615682, "ttft_ms": 13.463417068123817, "decode_ms": 93.92708295490593}, "total_wall_ms": 164.57966598682106, "ttft_ms": 13.463417068123817, "input_usage": {"receiver_prompt_tokens": 406, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12889037912, "mlx_cache_bytes": 9387677372, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12889037912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 1072 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f06f90f0acdd1eec4c9a87a7", "attempt_id": "4dba4853b5b9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:59.637503Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 399, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.76920895650983, "ttft_ms": 13.598624966107309, "decode_ms": 13.47658399026841}, "total_wall_ms": 81.68716705404222, "ttft_ms": 13.598624966107309, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885580888, "mlx_cache_bytes": 9610729148, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12885580888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1073 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "71a7082905a43bb88fa82b61", "attempt_id": "b5267159afc2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:59.740598Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 400, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.14937501680106, "ttft_ms": 13.66575004067272, "decode_ms": 13.326499960385263}, "total_wall_ms": 80.95129195135087, "ttft_ms": 13.66575004067272, "input_usage": {"receiver_prompt_tokens": 400, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885957720, "mlx_cache_bytes": 9728497340, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12885957720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1074 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3397170c976504481d97fac5", "attempt_id": "a63b4dbb3c56", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:59.842919Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 414, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.32012504711747, "ttft_ms": 14.283834025263786, "decode_ms": 13.49295792169869}, "total_wall_ms": 80.882583046332, "ttft_ms": 14.283834025263786, "input_usage": {"receiver_prompt_tokens": 414, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12893674584, "mlx_cache_bytes": 9944405692, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12893674584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1075 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "303e71908ffe6c6c118537c0", "attempt_id": "a345c3a076fc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:52:59.945029Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 407, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.349916939623654, "ttft_ms": 13.738458976149559, "decode_ms": 13.520208070985973}, "total_wall_ms": 81.47666603326797, "ttft_ms": 13.738458976149559, "input_usage": {"receiver_prompt_tokens": 407, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12889922648, "mlx_cache_bytes": 10132018876, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12889922648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1076 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7d39a893e610796e13315216", "attempt_id": "1f247f98b16d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.047334Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 416, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.55174997728318, "ttft_ms": 14.132958953268826, "decode_ms": 13.605125015601516}, "total_wall_ms": 81.22791699133813, "ttft_ms": 14.132958953268826, "input_usage": {"receiver_prompt_tokens": 416, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12895083608, "mlx_cache_bytes": 10333738684, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12895083608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1077 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f07e31b6f786a428638496b9", "attempt_id": "dce6713a5eaf", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.151274Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 409, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.950041950680315, "ttft_ms": 13.57129099778831, "decode_ms": 68.49370896816254}, "total_wall_ms": 136.00279204547405, "ttft_ms": 13.57129099778831, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12890479704, "mlx_cache_bytes": 10454062780, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12890479704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,234,500", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "146567d90583dc10755a744a3115028cac700f000aedd5010c1875d55afeed8d"} | ||||
| 1078 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c60edf0447c8415000952d6", "attempt_id": "0a83811ba69f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.310180Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 406, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.906625089235604, "ttft_ms": 14.125042012892663, "decode_ms": 13.500125030986965}, "total_wall_ms": 81.4368330175057, "ttft_ms": 14.125042012892663, "input_usage": {"receiver_prompt_tokens": 406, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12889037912, "mlx_cache_bytes": 10454062780, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12889037912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1079 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b201b29ee29f5366607a3444", "attempt_id": "6e3407129bcc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.414397Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 411, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.44795803446323, "ttft_ms": 13.405959005467594, "decode_ms": 13.32229096442461}, "total_wall_ms": 80.00466704834253, "ttft_ms": 13.405959005467594, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913040472, "mlx_cache_bytes": 10569979580, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12913040472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1080 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "700fb0b60fed2c74fe56310f", "attempt_id": "9c7c33a55d1f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.515614Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 411, "message_tokens": 285, "message_utf8_bytes": 807, "cache_tensor_bytes": null, "serialized_payload_bytes": 807, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8276.2247499777, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.61450004763901, "ttft_ms": 13.376291957683861, "decode_ms": 13.586665969341993}, "total_wall_ms": 80.44379099737853, "ttft_ms": 13.376291957683861, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 5797, "sender_output_tokens": 512, "sender_prefill_ms": 684.1552919941023, "sender_ttft_ms": 15.01374994404614, "sender_decode_ms": 7572.812541038729}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263927296, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12918119512, "mlx_cache_bytes": 10569979580, "process_rss_bytes": 1263927296}, "peak_prefill_memory": null, "peak_decode_memory": 12918119512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d7e26439d04924ca01d266db0742ded1cd7ff9a3f826df3e4c3d90b95e3bebb2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1081 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ac3117a4b48f5f1ba87e5cb2", "attempt_id": "93cb88a8ce22", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.622269Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 611, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.93287497386336, "ttft_ms": 13.603333034552634, "decode_ms": 13.455791980959475}, "total_wall_ms": 105.01549998298287, "ttft_ms": 13.603333034552634, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263943680, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036559884, "mlx_cache_bytes": 10911209148, "process_rss_bytes": 1263943680}, "peak_prefill_memory": null, "peak_decode_memory": 13036559884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1082 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f6b5a95430d8319dde3e256", "attempt_id": "dae6e302399e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.748633Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 604, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.62216599378735, "ttft_ms": 13.793334015645087, "decode_ms": 26.98204095941037}, "total_wall_ms": 116.45466694608331, "ttft_ms": 13.793334015645087, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1263943680, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032709644, "mlx_cache_bytes": 11271476924, "process_rss_bytes": 1263943680}, "peak_prefill_memory": null, "peak_decode_memory": 13032709644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1083 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "72f5ef585348ebcebc268425", "attempt_id": "ec19716bdedd", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:00.886508Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 605, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.52141598332673, "ttft_ms": 13.667999999597669, "decode_ms": 27.16295898426324}, "total_wall_ms": 116.32370902225375, "ttft_ms": 13.667999999597669, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1263943680, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032889868, "mlx_cache_bytes": 11390228156, "process_rss_bytes": 1263943680}, "peak_prefill_memory": null, "peak_decode_memory": 13032889868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1084 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0ca0bac904d87d65295b6a68", "attempt_id": "1355c6269110", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:01.023744Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 619, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.38258300721645, "ttft_ms": 13.738375040702522, "decode_ms": 67.7802920108661}, "total_wall_ms": 158.96787494421005, "ttft_ms": 13.738375040702522, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263960064, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13072080396, "mlx_cache_bytes": 11488990908, "process_rss_bytes": 1263960064}, "peak_prefill_memory": null, "peak_decode_memory": 13072080396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,403,805", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "e47e818846e0397b984e776215a6763ebc28ea8a7b5520559f58b30c401d134f"} | ||||
| 1085 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "834737a7d06fc656ec5e2586", "attempt_id": "01b704f14a83", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:01.204391Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 612, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.65870804339647, "ttft_ms": 13.652166002430022, "decode_ms": 68.05200001690537}, "total_wall_ms": 159.3980420148, "ttft_ms": 13.652166002430022, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1263960064, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13068656140, "mlx_cache_bytes": 11646801596, "process_rss_bytes": 1263960064}, "peak_prefill_memory": null, "peak_decode_memory": 13068656140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1086 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "499dc8d6d22c23d00384344b", "attempt_id": "21457ff0311c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:01.385387Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 621, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.96504099294543, "ttft_ms": 13.673834037035704, "decode_ms": 81.94670802913606}, "total_wall_ms": 173.60191699117422, "ttft_ms": 13.673834037035704, "input_usage": {"receiver_prompt_tokens": 621}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1263960064, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042359820, "mlx_cache_bytes": 11646801596, "process_rss_bytes": 1263960064}, "peak_prefill_memory": null, "peak_decode_memory": 13042359820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithixymi-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "5919268fa866f12eb8b0497583904be835032b475afd544dc2eba31f2b4f6679"} | ||||
| 1087 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4d51ab2b1cd571df211d66a5", "attempt_id": "d73876e303b3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:01.580615Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 614, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.93037507124245, "ttft_ms": 13.803874957375228, "decode_ms": 638.4567909408361}, "total_wall_ms": 730.2930828882381, "ttft_ms": 13.803874957375228, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 48}, "provider_cached_usage": null, "process_memory": 1263992832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13076585996, "mlx_cache_bytes": 11646801596, "process_rss_bytes": 1263992832}, "peak_prefill_memory": null, "peak_decode_memory": 13076585996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,653,745 + 5,580,755 + 6,058,035 + 214,618 + 226,880 + 8,178,473 + 7,428,315 + 8,962", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "0961d1f19757cc97e6a4db9b223d87bd9388a516941fdd57ce80863f7888c1c5"} | ||||
| 1088 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ef5198d770065b9da965d2db", "attempt_id": "5b78a1fd1519", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:02.332148Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 611, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.0889999801293, "ttft_ms": 13.555209035985172, "decode_ms": 13.627624954096973}, "total_wall_ms": 104.35162507928908, "ttft_ms": 13.555209035985172, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263992832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13036559884, "mlx_cache_bytes": 11646801596, "process_rss_bytes": 1263992832}, "peak_prefill_memory": null, "peak_decode_memory": 13036559884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1089 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b929c01e899d38f65dcef054", "attempt_id": "559969ed2d0f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:02.458322Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 616, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.69745897874236, "ttft_ms": 13.63116700667888, "decode_ms": 14.133332995697856}, "total_wall_ms": 105.47633399255574, "ttft_ms": 13.63116700667888, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263992832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640076, "mlx_cache_bytes": 11646801596, "process_rss_bytes": 1263992832}, "peak_prefill_memory": null, "peak_decode_memory": 13039640076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1090 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c0a4d3b5fcd1572ba75be13b", "attempt_id": "6b5cd38438fb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:02.585587Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 506, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 616, "message_tokens": 505, "message_utf8_bytes": 1550, "cache_tensor_bytes": null, "serialized_payload_bytes": 1550, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3807500042021275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.52275008149445, "ttft_ms": 13.537875027395785, "decode_ms": 13.432625099085271}, "total_wall_ms": 104.48733298107982, "ttft_ms": 13.537875027395785, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1263992832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640076, "mlx_cache_bytes": 11646801596, "process_rss_bytes": 1263992832}, "peak_prefill_memory": null, "peak_decode_memory": 13039640076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "534ed30ac155bf7d87d34ab8d3445fb368b6b3de3b51256ee88ccffcdba0d24e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1091 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "586ac7f6c57580d50585ab4e", "attempt_id": "c7f9a78d12de", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:03.507870Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 45, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 1.9648750312626362, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.487665923312306, "ttft_ms": 23.487665923312306, "decode_ms": 43.674124986864626}, "total_wall_ms": 72.97979097347707, "ttft_ms": 23.487665923312306, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 11373309989, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not found.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "0802559db1375af3ff5caabba71acea1d6299f1a7fc64b6a5024f19cbd33b72f"} | ||||
| 1092 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "14e6b741aff4834bc8b08406", "attempt_id": "30435451a482", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:03.602892Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 38, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 2.2269999608397484, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.125208030454814, "ttft_ms": 24.125208030454814, "decode_ms": 28.719875030219555}, "total_wall_ms": 59.139541001059115, "ttft_ms": 24.125208030454814, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13662065892, "mlx_cache_bytes": 11400605733, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13662065892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1093 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e69606d8f8b8d7f5a4f6ad6c", "attempt_id": "466b1ed13e55", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:03.683371Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 39, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 1.592540997080505, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.405709071084857, "ttft_ms": 23.405709071084857, "decode_ms": 14.329583034850657}, "total_wall_ms": 43.535291915759444, "ttft_ms": 23.405709071084857, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 39}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13662524644, "mlx_cache_bytes": 11408273445, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13662524644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1094 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ed032d9016ad29c68ef67c6", "attempt_id": "718daa0a7dff", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:03.748231Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 53, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 2.045250032097101, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.584292037412524, "ttft_ms": 23.584292037412524, "decode_ms": 29.262708965688944}, "total_wall_ms": 58.80545801483095, "ttft_ms": 23.584292037412524, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 53}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13673174276, "mlx_cache_bytes": 11659377862, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13673174276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1095 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c1212d67aca579b161c720e1", "attempt_id": "5ba264cac0b0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:03.828854Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 46, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 1.0384999914094806, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.486542002297938, "ttft_ms": 22.486542002297938, "decode_ms": 28.957042028196156}, "total_wall_ms": 56.3235420268029, "ttft_ms": 22.486542002297938, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 46}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13667587332, "mlx_cache_bytes": 11693538502, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13667587332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1096 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7210cf62ebd985571b15c385", "attempt_id": "71327ffc2b59", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:03.906464Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 55, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 2.0844999235123396, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.87216705735773, "ttft_ms": 22.87216705735773, "decode_ms": 87.81358296982944}, "total_wall_ms": 116.67291703633964, "ttft_ms": 22.87216705735773, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13674714380, "mlx_cache_bytes": 11938318927, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13674714380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Keryminov-10", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "47d4fb882fdd2db10f1e88942b3f981e24a10a4a4501ff56cdaf321c9eba1c18"} | ||||
| 1097 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bf4e8513f94888e8530e349b", "attempt_id": "1021435e707e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:04.044306Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 48, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 1.9669999601319432, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.25795795675367, "ttft_ms": 22.25795795675367, "decode_ms": 72.0727500738576}, "total_wall_ms": 100.40387499611825, "ttft_ms": 22.25795795675367, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13668521220, "mlx_cache_bytes": 11960994383, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13668521220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,044,150", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "4ac117024f5de7b9651bb2c4115d7fbcfc7379363fada0fe090e2cd731dc6721"} | ||||
| 1098 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "accdca106b3c8cdf1d092395", "attempt_id": "d34abe97ce7f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:04.167009Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 45, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 2.0585000747814775, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.373791969381273, "ttft_ms": 21.373791969381273, "decode_ms": 28.757540974766016}, "total_wall_ms": 56.09412502963096, "ttft_ms": 21.373791969381273, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 11961911887, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1099 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "23db6edcad5b3a4287c1a76d", "attempt_id": "560e3cfcca55", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:04.245029Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 50, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 2.0960839465260506, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.513333009555936, "ttft_ms": 22.513333009555936, "decode_ms": 28.906875057145953}, "total_wall_ms": 57.33995803166181, "ttft_ms": 22.513333009555936, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 50}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13674501380, "mlx_cache_bytes": 11976936015, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13674501380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 1100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f37f7a0e62ab32a46d27f041", "attempt_id": "b2bdd722e109", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:04.324359Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5693, "keep": 1423, "compress_ms": 11.208459036424756}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 50, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214135, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 795.9865829907358, "doc_prefill_ms": 745.9642089670524, "compress_ms": 11.246208916418254, "serialize_ms": 30.216375016607344, "load_ms": 1.032334053888917, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.54341694060713, "ttft_ms": 22.54341694060713, "decode_ms": 14.297249959781766}, "total_wall_ms": 41.76616691984236, "ttft_ms": 22.54341694060713, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1590542336, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13674468612, "mlx_cache_bytes": 11976936015, "process_rss_bytes": 1590542336}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13674468612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2bfe8b4004eb5617e90db48d9a3989c48874dde8558df85167cecb5f765774ea", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d62b19feacadfcf7ad2b177", "attempt_id": "599baa3d92a7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:04.388396Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 45, "compress_ms": 86.70929097570479}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 45, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 120.29412505216897, "doc_prefill_ms": 745.9642089670524, "compress_ms": 90.71983303874731, "serialize_ms": 29.388625058345497, "load_ms": 1.8255000468343496, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.96070908010006, "ttft_ms": 20.96070908010006, "decode_ms": 100.92604206874967}, "total_wall_ms": 248.06625000201166, "ttft_ms": 20.96070908010006, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1592754176, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 13355174583, "process_rss_bytes": 1592754176}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 1102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f05bed948942724b2adfacaf", "attempt_id": "daafa731d9ef", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:04.658697Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 38, "compress_ms": 76.82779198512435}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 38, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 106.9073339458555, "doc_prefill_ms": 745.9642089670524, "compress_ms": 80.72941692080349, "serialize_ms": 25.987209053710103, "load_ms": 1.7582920845597982, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.670666988939047, "ttft_ms": 21.670666988939047, "decode_ms": 29.309708043001592}, "total_wall_ms": 163.669417030178, "ttft_ms": 21.670666988939047, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1756069888, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13662049508, "mlx_cache_bytes": 13392087735, "process_rss_bytes": 1756069888}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13662049508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd7d5eeb5f0085c96ee40fdb", "attempt_id": "d387e1abf2c8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:04.845592Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 39, "compress_ms": 77.46612501796335}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 39, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.16320904530585, "doc_prefill_ms": 745.9642089670524, "compress_ms": 81.24525006860495, "serialize_ms": 21.722291014157236, "load_ms": 1.9099999917671084, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.625374909490347, "ttft_ms": 21.625374909490347, "decode_ms": 28.925416059792042}, "total_wall_ms": 159.61595892440528, "ttft_ms": 21.625374909490347, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 39}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1756069888, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13662508260, "mlx_cache_bytes": 13413894839, "process_rss_bytes": 1756069888}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13662508260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8ab07001399e5c4d5f2faa0b", "attempt_id": "0a9b187003f0", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:05.027987Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 53, "compress_ms": 76.88237505499274}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 53, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.94279204774648, "doc_prefill_ms": 745.9642089670524, "compress_ms": 81.04700001422316, "serialize_ms": 22.719500004313886, "load_ms": 1.7469590529799461, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.25049999449402, "ttft_ms": 21.25049999449402, "decode_ms": 72.93916610069573}, "total_wall_ms": 203.93208402674645, "ttft_ms": 21.25049999449402, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1756069888, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13673174276, "mlx_cache_bytes": 13448563383, "process_rss_bytes": 1756069888}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13673174276, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1b14451f68827f7dc2ebae39", "attempt_id": "b4c8cf796d64", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:05.254303Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 46, "compress_ms": 76.25341590028256}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 46, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.06379205919802, "doc_prefill_ms": 745.9642089670524, "compress_ms": 80.21283301059157, "serialize_ms": 21.665207925252616, "load_ms": 1.8804590217769146, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.713958005420864, "ttft_ms": 21.713958005420864, "decode_ms": 72.38749996758997}, "total_wall_ms": 202.14533305261284, "ttft_ms": 21.713958005420864, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1756069888, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13667587332, "mlx_cache_bytes": 13490834103, "process_rss_bytes": 1756069888}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13667587332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dab2b2691132b47d9189a3f3", "attempt_id": "13e3f6daeee6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:05.479563Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 55, "compress_ms": 77.47912500053644}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 55, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.50779199507087, "doc_prefill_ms": 745.9642089670524, "compress_ms": 81.22783398721367, "serialize_ms": 22.0896250102669, "load_ms": 1.757750054821372, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.885083061642945, "ttft_ms": 26.885083061642945, "decode_ms": 86.77795808762312}, "total_wall_ms": 223.0668329866603, "ttft_ms": 26.885083061642945, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1756102656, "backend_memory": {"mlx_active_bytes": 13606638600, "mlx_peak_bytes": 13674714380, "mlx_cache_bytes": 13541313207, "process_rss_bytes": 1756102656}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13674714380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Keryminov-10", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "47d4fb882fdd2db10f1e88942b3f981e24a10a4a4501ff56cdaf321c9eba1c18"} | ||||
| 1107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4aaffa606736a4d0f77bd0f8", "attempt_id": "8cfec87920a3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:05.725858Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 48, "compress_ms": 78.99116689804941}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 48, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.01325002405792, "doc_prefill_ms": 745.9642089670524, "compress_ms": 82.96916703693569, "serialize_ms": 21.856833016499877, "load_ms": 1.6061250353232026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.824666066095233, "ttft_ms": 21.824666066095233, "decode_ms": 552.6842499384657}, "total_wall_ms": 685.2460840018466, "ttft_ms": 21.824666066095233, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 48}, "output_usage": {"output_tokens": 38}, "provider_cached_usage": null, "process_memory": 1756102656, "backend_memory": {"mlx_active_bytes": 13609391112, "mlx_peak_bytes": 13668521220, "mlx_cache_bytes": 14193756855, "process_rss_bytes": 1756102656}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13668521220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,653,745 + 5,580,755 + 6,456,275 + 8,178,473 + 297,050 = 28,010,818", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "404ab436f85a20bc5f29d11483da5cf890d06e21aadabc3a7d2923da0bf364e0"} | ||||
| 1108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c0247ad23e1a6bda2824cb30", "attempt_id": "533df6acd4fc", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:06.433986Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 45, "compress_ms": 76.359250000678}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 45, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214172, "side_information_bytes": 13148, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.3747079782188, "doc_prefill_ms": 745.9642089670524, "compress_ms": 80.40204097051173, "serialize_ms": 22.678290959447622, "load_ms": 1.7930830363184214, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.951375016011298, "ttft_ms": 20.951375016011298, "decode_ms": 43.45879191532731}, "total_wall_ms": 173.61012496985495, "ttft_ms": 20.951375016011298, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1756119040, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 14198344375, "process_rss_bytes": 1756119040}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.61", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2fe418a81aeb7ae14d7d5506cdb72c8720b23e17a14957ab52862b419d6d2b07", "output_hash": "c85e09eb8176db9e00c43c8bdc564dd91330c9d14f2a52ad6bc7872931e4c7ef"} | ||||
| 1109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25c6ec47a7fc12e7c8545779", "attempt_id": "3f9354128981", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:06.630571Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 50, "compress_ms": 78.65016593132168}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 50, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214174, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.6144999563694, "doc_prefill_ms": 745.9642089670524, "compress_ms": 82.51958305481821, "serialize_ms": 21.917833015322685, "load_ms": 1.4113750075921416, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.375166066922247, "ttft_ms": 22.375166066922247, "decode_ms": 14.467666042037308}, "total_wall_ms": 146.96058304980397, "ttft_ms": 22.375166066922247, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1756135424, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13671388420, "mlx_cache_bytes": 14235339447, "process_rss_bytes": 1756135424}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13671388420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c0c66a8952e16230a766b7e8e44c5caacf62a9ba4bff0eabee89d34f9effe37c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3d9cc4831c6fc8620e5ba909", "attempt_id": "3683d940f5f6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:06.800455Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5693, "keep": 1423, "window_tokens": 50, "compress_ms": 77.3864999646321}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 50, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 163201024, "serialized_payload_bytes": 163214173, "side_information_bytes": 13149, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.3934160368517, "doc_prefill_ms": 745.9642089670524, "compress_ms": 81.13558299373835, "serialize_ms": 22.076542023569345, "load_ms": 1.7429590225219727, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.067958023399115, "ttft_ms": 22.067958023399115, "decode_ms": 14.259250019676983}, "total_wall_ms": 145.55508294142783, "ttft_ms": 22.067958023399115, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1756151808, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13671388420, "mlx_cache_bytes": 14235339447, "process_rss_bytes": 1756151808}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 13671388420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0521667cbc7a6bc4017632d4b0bc2c17d7cb435fafd8473d16adff22fd4e4e34", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5db9491587d5954e0878cef4", "attempt_id": "79efe12dd275", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:07.078255Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 45, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 6.640707957558334, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.635459020733833, "ttft_ms": 28.635459020733833, "decode_ms": 116.5021660272032}, "total_wall_ms": 155.9031669748947, "ttft_ms": 28.635459020733833, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13973640200, "mlx_peak_bytes": 14146685992, "mlx_cache_bytes": 15373944695, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14146685992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "BY-78E-8447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "6acdf1f1807eeb525a30ee2d553ebf18ba3bb86ebe5cef8081992457efd3bb8d"} | ||||
| 1112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "21bb350ad6f234d50d7b8402", "attempt_id": "4002875827a4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:07.257312Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 38, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 3.1687499722465873, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.361457934603095, "ttft_ms": 27.361457934603095, "decode_ms": 32.927416963502765}, "total_wall_ms": 67.31662503443658, "ttft_ms": 27.361457934603095, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13972722696, "mlx_peak_bytes": 14132033988, "mlx_cache_bytes": 15438092919, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14132033988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "97863df16be3851c4875e1a5", "attempt_id": "22f2ee0842ca", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:07.347138Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 39, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 3.1378749990835786, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.410250040702522, "ttft_ms": 27.410250040702522, "decode_ms": 32.995334011502564}, "total_wall_ms": 67.4687089631334, "ttft_ms": 27.410250040702522, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 39}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13972722696, "mlx_peak_bytes": 14133788004, "mlx_cache_bytes": 15502485783, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14133788004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a6022f4ffa72108aead2239d", "attempt_id": "6ca20e6eb073", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:07.436597Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 53, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 3.0488750198855996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.527709073387086, "ttft_ms": 28.527709073387086, "decode_ms": 82.16250000987202}, "total_wall_ms": 117.53620905801654, "ttft_ms": 28.527709073387086, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13973640200, "mlx_peak_bytes": 14165317281, "mlx_cache_bytes": 15660829239, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14165317281, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f12db5762b19bbb08db69b97", "attempt_id": "810afc1d34ed", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:07.575646Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 46, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 3.065124968998134, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.03891699295491, "ttft_ms": 28.03891699295491, "decode_ms": 81.90987491980195}, "total_wall_ms": 117.12658300530165, "ttft_ms": 28.03891699295491, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13972722696, "mlx_peak_bytes": 14149341544, "mlx_cache_bytes": 15737835511, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14149341544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,150,875", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "44d2bea5683fa0161cfd0c3e09190160f393c874a2e7f4333b9ad36538effe28"} | ||||
| 1116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1f87da38a2d21a2fca1103f5", "attempt_id": "dd24436d45a0", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:07.715069Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 55, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 3.0970840016379952, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.591290931217372, "ttft_ms": 28.591290931217372, "decode_ms": 98.61495799850672}, "total_wall_ms": 134.1434590285644, "ttft_ms": 28.591290931217372, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13973640200, "mlx_peak_bytes": 14169823209, "mlx_cache_bytes": 15828054615, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14169823209, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Keryminov-10", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "47d4fb882fdd2db10f1e88942b3f981e24a10a4a4501ff56cdaf321c9eba1c18"} | ||||
| 1117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cec442c4bd86dcab2433ba89", "attempt_id": "7a76ce93e971", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:07.871096Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 48, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 2.896792022511363, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.260916005820036, "ttft_ms": 28.260916005820036, "decode_ms": 511.0067909117788}, "total_wall_ms": 546.2760829832405, "ttft_ms": 28.260916005820036, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 48}, "output_usage": {"output_tokens": 31}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13974557704, "mlx_peak_bytes": 14153042084, "mlx_cache_bytes": 16308761175, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14153042084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,653,745 + 5,580,755 + 6,058,035 + 292,875 = 19,545,600", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "7ae601118f0eab649257c21f21be5875c6791faf44e2a4635882ba677f22c279"} | ||||
| 1118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "98c82361e5d32bfc18e44842", "attempt_id": "852b2dd48aa0", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:08.439215Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 45, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 2.9470419976860285, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.773290988989174, "ttft_ms": 27.773290988989174, "decode_ms": 49.42662490066141}, "total_wall_ms": 83.96387496031821, "ttft_ms": 27.773290988989174, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13972722696, "mlx_peak_bytes": 14146680836, "mlx_cache_bytes": 16310596183, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14146680836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.61", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "c85e09eb8176db9e00c43c8bdc564dd91330c9d14f2a52ad6bc7872931e4c7ef"} | ||||
| 1119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a627f84f2c0f7a0ae649c62e", "attempt_id": "18ede0004e0b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:08.545171Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 50, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 3.0772500904276967, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.51887501310557, "ttft_ms": 28.51887501310557, "decode_ms": 16.472875024192035}, "total_wall_ms": 51.947709056548774, "ttft_ms": 28.51887501310557, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13972722696, "mlx_peak_bytes": 14158612644, "mlx_cache_bytes": 16393368151, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14158612644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8c0f5ae7b8c20b248bf5911b", "attempt_id": "61a00f3805be", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:08.619174Z", "task_family": "synthetic", "document_id": "syn_03007_8000", "document_hash": "601a34ce3fb4eb4fe6346a3bc9900160762a432b30f192472ef5821aa5ad3f6f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03007_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13621318664}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5633, "source_tokens_receiver": 5633, "query_tokens": 50, "message_tokens": 5693, "message_utf8_bytes": 29152, "cache_tensor_bytes": 346863104, "serialized_payload_bytes": 346890440, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.41308399196714, "doc_prefill_ms": 745.9642089670524, "compress_ms": 18.141458043828607, "serialize_ms": 90.96733399201185, "load_ms": 3.0836659716442227, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.17016700282693, "ttft_ms": 28.17016700282693, "decode_ms": 16.53195801191032}, "total_wall_ms": 52.03954107128084, "ttft_ms": 28.17016700282693, "input_usage": {"receiver_prefix_tokens": 5693, "dense_cache_bytes": 652918784, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2103590912, "backend_memory": {"mlx_active_bytes": 13972722696, "mlx_peak_bytes": 14158612644, "mlx_cache_bytes": 16393368151, "process_rss_bytes": 2103590912}, "peak_prefill_memory": 13740119092, "peak_decode_memory": 14158612644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03007_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0045166050e69e3367595563a35c47a6b16546247ee11a36732b20b942f7f7c9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5a3ff9b43d307ee962d975b5", "attempt_id": "2d99ce009885", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:08.775603Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11050, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1438.0671659018844, "ttft_ms": 14.598082983866334, "decode_ms": 158.44008303247392}, "total_wall_ms": 1627.7744999388233, "ttft_ms": 14.598082983866334, "input_usage": {"receiver_prompt_tokens": 11050}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1683013632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 3909820856, "process_rss_bytes": 1683013632}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "VJ-84A-2155", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "a1a7cdfb46b3d678be256814fe2c8f5bb5c6d220d4c63e46ac239a4c136fefb4"} | ||||
| 1122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1ec25860123b4420c683362e", "attempt_id": "50bb182c0191", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:10.433627Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11042, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1448.2810420449823, "ttft_ms": 14.450959046371281, "decode_ms": 14.210624969564378}, "total_wall_ms": 1493.0757499532774, "ttft_ms": 14.450959046371281, "input_usage": {"receiver_prompt_tokens": 11042}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683013632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4381335992, "process_rss_bytes": 1683013632}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "32e1ab9d8913eea5d8624cbe", "attempt_id": "6703f3266a73", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:11.957813Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11043, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1476.0499579133466, "ttft_ms": 14.686250011436641, "decode_ms": 14.400999993085861}, "total_wall_ms": 1521.3389169657603, "ttft_ms": 14.686250011436641, "input_usage": {"receiver_prompt_tokens": 11043}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683013632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4711539128, "process_rss_bytes": 1683013632}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "958e310bcf945c708674240f", "attempt_id": "7dfee276c0df", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:13.509661Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11057, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1516.0104589303955, "ttft_ms": 14.695958001539111, "decode_ms": 129.97191702015698}, "total_wall_ms": 1677.2510840091854, "ttft_ms": 14.695958001539111, "input_usage": {"receiver_prompt_tokens": 11057}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1683013632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5191262648, "process_rss_bytes": 1683013632}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,570,705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "cd44b6033df7535fd29532c9e4e7be6317b176330ca7b0a10f0dbd3bd21f4bed"} | ||||
| 1125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b737b17b3f59342fc810cf2d", "attempt_id": "ff0abfc0146f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:15.217430Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11052, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1601.9471670733765, "ttft_ms": 14.88033402711153, "decode_ms": 102.10766596719623}, "total_wall_ms": 1734.9658749299124, "ttft_ms": 14.88033402711153, "input_usage": {"receiver_prompt_tokens": 11052}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1683013632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5525201336, "process_rss_bytes": 1683013632}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5647285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "452d40637e3c51836b99b42abfe7b255c52457db43fc1278ebfdf39cb7de236d"} | ||||
| 1126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2de66a14a65d457a100b00f6", "attempt_id": "1a9ab30716fe", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:16.982809Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11059, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1591.2566669285297, "ttft_ms": 14.96458298061043, "decode_ms": 72.61979195754975}, "total_wall_ms": 1695.1285830000415, "ttft_ms": 14.96458298061043, "input_usage": {"receiver_prompt_tokens": 11059}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1683013632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6026764728, "process_rss_bytes": 1683013632}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Tekdra-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "3e9dfeb045758c8b376f36e3869ade8089296923cd7677fd3abbaf400b0ff1d8"} | ||||
| 1127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "77320e84ae115ecc2d1fa413", "attempt_id": "fd2615ac525d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:18.708178Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11053, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1650.537500041537, "ttft_ms": 14.712292002514005, "decode_ms": 101.50029207579792}, "total_wall_ms": 1782.8540420159698, "ttft_ms": 14.712292002514005, "input_usage": {"receiver_prompt_tokens": 11053}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1683013632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6361194936, "process_rss_bytes": 1683013632}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4144884", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "dd0bed4903ec8fa7cf19e8848999a8918e7bd5f491887d9c0d706d29687b2d4b"} | ||||
| 1128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "565c220e72ea0e1225d68206", "attempt_id": "e3b83bd99d2b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:20.521208Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11049, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1609.6278330078349, "ttft_ms": 14.722042018547654, "decode_ms": 72.8783329250291}, "total_wall_ms": 1713.6498340405524, "ttft_ms": 14.722042018547654, "input_usage": {"receiver_prompt_tokens": 11049}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1683030016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6693855672, "process_rss_bytes": 1683030016}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "b06ff625e497afac6d97bd4e3f65fc6636ba421022f1376300ca2a58f58b7d2b"} | ||||
| 1129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "09922d14198fb8165a7b384f", "attempt_id": "b816cf51215c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:22.265352Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11054, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1593.2697909884155, "ttft_ms": 14.679249958135188, "decode_ms": 14.783374965190887}, "total_wall_ms": 1639.4375420641154, "ttft_ms": 14.679249958135188, "input_usage": {"receiver_prompt_tokens": 11054}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683030016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 7028679096, "process_rss_bytes": 1683030016}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6593e935acb5c22c6058926a", "attempt_id": "669f9d7679d0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:23.934923Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 11055, "message_tokens": 10967, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022083986550569534, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1614.5494999364018, "ttft_ms": 14.933291939087212, "decode_ms": 14.584167045541108}, "total_wall_ms": 1660.5487921042368, "ttft_ms": 14.933291939087212, "input_usage": {"receiver_prompt_tokens": 11055}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683030016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 7363797432, "process_rss_bytes": 1683030016}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3b9d867597e8e9be085c6fd", "attempt_id": "92dba8ec597d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:34.586663Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.74170897249132, "ttft_ms": 13.318584067746997, "decode_ms": 146.3178750127554}, "total_wall_ms": 231.55270796269178, "ttft_ms": 13.318584067746997, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 9146844600, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "VJ-84A-2155", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "a1a7cdfb46b3d678be256814fe2c8f5bb5c6d220d4c63e46ac239a4c136fefb4"} | ||||
| 1132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d4ff4e4043dff0e2725f74d5", "attempt_id": "93f23b636fbd", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:34.848809Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.70787490718067, "ttft_ms": 13.349917018786073, "decode_ms": 13.53162492159754}, "total_wall_ms": 97.71133295726031, "ttft_ms": 13.349917018786073, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990604376, "mlx_cache_bytes": 9492186552, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 12990604376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "901742b3b76a31de3bac6f9b", "attempt_id": "8a1a6bed71f9", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:34.977275Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.70812496729195, "ttft_ms": 13.447417062707245, "decode_ms": 13.473291997797787}, "total_wall_ms": 97.71920798812062, "ttft_ms": 13.447417062707245, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 9735980472, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf0f7c6511a634bc35ece4ca", "attempt_id": "af34cf63dcf4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:35.105217Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.57112490292639, "ttft_ms": 13.298082980327308, "decode_ms": 13.300499995239079}, "total_wall_ms": 98.29708398319781, "ttft_ms": 13.298082980327308, "input_usage": {"receiver_prompt_tokens": 607, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997157976, "mlx_cache_bytes": 10105111992, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 12997157976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85c2299f6f1e3bc5f9429e50", "attempt_id": "6cc3863af2bb", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:35.233853Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.98149992432445, "ttft_ms": 13.16774997394532, "decode_ms": 93.62516598775983}, "total_wall_ms": 177.9721670318395, "ttft_ms": 13.16774997394532, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009888344, "mlx_cache_bytes": 10374907320, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 13009888344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6470822", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "00d30b671c507bdf8ff7ae2b3abde999f52fa8f771f57131cffe68c104946394"} | ||||
| 1136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8eee2becb00c942644ca5a1f", "attempt_id": "8e33204722eb", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:35.441548Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.62670804932714, "ttft_ms": 13.264583074487746, "decode_ms": 66.86870893463492}, "total_wall_ms": 150.88970900978893, "ttft_ms": 13.264583074487746, "input_usage": {"receiver_prompt_tokens": 609, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997846104, "mlx_cache_bytes": 10625189304, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 12997846104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Tekdra-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "3e9dfeb045758c8b376f36e3869ade8089296923cd7677fd3abbaf400b0ff1d8"} | ||||
| 1137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5d828475b9bfc61c07520915", "attempt_id": "ad88e6714f1d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:35.622819Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.71191696356982, "ttft_ms": 13.21616698987782, "decode_ms": 134.8366659367457}, "total_wall_ms": 218.88841595500708, "ttft_ms": 13.21616698987782, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 10873013688, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15,114,234", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "4ad9fb110f4e886601e4cb25a3803bbf0c21d0afa956585aeefb7bd84d2d6c64"} | ||||
| 1138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd2a70440ecfcbb254dbae62", "attempt_id": "b253ba99ece1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:35.871662Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.79233294259757, "ttft_ms": 13.155209016986191, "decode_ms": 13.710791012272239}, "total_wall_ms": 97.80300001148134, "ttft_ms": 13.155209016986191, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994929752, "mlx_cache_bytes": 10961192376, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 12994929752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cb48d5223ef7c1ad248c9ee6", "attempt_id": "f214f30a755c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:36.000170Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.92683303542435, "ttft_ms": 13.248833012767136, "decode_ms": 13.65241699386388}, "total_wall_ms": 97.96837496105582, "ttft_ms": 13.248833012767136, "input_usage": {"receiver_prompt_tokens": 604, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008282712, "mlx_cache_bytes": 11209606584, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 13008282712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cede323d8e22e8c6e4ffa98b", "attempt_id": "3cef3461ed7a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:36.127908Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1440, "cache_tensor_bytes": null, "serialized_payload_bytes": 1440, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8960.729249985889, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.70575002580881, "ttft_ms": 14.120166073553264, "decode_ms": 13.655583024956286}, "total_wall_ms": 99.88866606727242, "ttft_ms": 14.120166073553264, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 11083, "sender_output_tokens": 512, "sender_prefill_ms": 1624.3685410590842, "sender_ttft_ms": 14.707374968566, "sender_decode_ms": 7313.469500048086}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683079168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996125784, "mlx_cache_bytes": 11458315704, "process_rss_bytes": 1683079168}, "peak_prefill_memory": null, "peak_decode_memory": 12996125784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1f203a25f98264d356a8861bd7e7879cc41818b2b81de5e8ec0f93672fc41e89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49d61bbf793228f93b633c8e", "attempt_id": "ec055d6a1f9c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.087549Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 456, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.056124973110855, "ttft_ms": 13.20404198486358, "decode_ms": 13.530333060771227}, "total_wall_ms": 83.742665941827, "ttft_ms": 13.20404198486358, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978658188, "mlx_cache_bytes": 12396039380, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12978658188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31f7fe0c4fe674d8f1ad7ab4", "attempt_id": "bb8ae8bb801c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.202578Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 448, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.13645796943456, "ttft_ms": 13.147416990250349, "decode_ms": 13.45912495162338}, "total_wall_ms": 81.64179197046906, "ttft_ms": 13.147416990250349, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12972530572, "mlx_cache_bytes": 12746132692, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12972530572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "87280c4efc283d7b0e2466ae", "attempt_id": "60f8d55194ef", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.313865Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 449, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.374625043943524, "ttft_ms": 13.306124950759113, "decode_ms": 13.255666010081768}, "total_wall_ms": 80.82537504378706, "ttft_ms": 13.306124950759113, "input_usage": {"receiver_prompt_tokens": 449, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12972923788, "mlx_cache_bytes": 12992023764, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12972923788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff98be9d664c5d2ee120b19f", "attempt_id": "a92abc6d28db", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.424846Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 463, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.16645801253617, "ttft_ms": 13.196917017921805, "decode_ms": 13.398375012911856}, "total_wall_ms": 82.7038330025971, "ttft_ms": 13.196917017921805, "input_usage": {"receiver_prompt_tokens": 463, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12903504784, "mlx_cache_bytes": 13275370508, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12903504784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3bb81fa1d39d9891029c4a95", "attempt_id": "9547456a1083", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.537350Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 458, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.801124962978065, "ttft_ms": 13.125000055879354, "decode_ms": 13.299208949320018}, "total_wall_ms": 82.10891601629555, "ttft_ms": 13.125000055879354, "input_usage": {"receiver_prompt_tokens": 458, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12930522144, "mlx_cache_bytes": 13504599052, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12930522144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3d57f8fa480c32083991b67d", "attempt_id": "7775f92bcad2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.650171Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 465, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.11524993926287, "ttft_ms": 13.213458005338907, "decode_ms": 13.499042019248009}, "total_wall_ms": 82.70349993836135, "ttft_ms": 13.213458005338907, "input_usage": {"receiver_prompt_tokens": 465, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904389528, "mlx_cache_bytes": 13695703884, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12904389528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "42b8e47cdb2f9a5bdc57f31f", "attempt_id": "9aa76dcae4db", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.763314Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 459, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.03004195634276, "ttft_ms": 13.483499991707504, "decode_ms": 13.687166036106646}, "total_wall_ms": 83.1445410149172, "ttft_ms": 13.483499991707504, "input_usage": {"receiver_prompt_tokens": 459, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12930653264, "mlx_cache_bytes": 13904534348, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12930653264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ab3a21f9f34f1c7d9389cb5f", "attempt_id": "cd98d2f3e686", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:45.877527Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 455, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.17541605513543, "ttft_ms": 13.474166975356638, "decode_ms": 55.06624991539866}, "total_wall_ms": 124.65045903809369, "ttft_ms": 13.474166975356638, "input_usage": {"receiver_prompt_tokens": 455, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978396044, "mlx_cache_bytes": 13993794380, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12978396044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "45.6", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "e86cad3c9a7ff5e3719e15bea3cbaab9bdcc0f92e2e08a73ee03cd8ebed173fa"} | ||||
| 1149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9fb847e6c2c5ccd1ec8abfab", "attempt_id": "ef03eb636f61", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:46.031830Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 460, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.07416697219014, "ttft_ms": 13.603791943751276, "decode_ms": 13.815041980706155}, "total_wall_ms": 83.4500000346452, "ttft_ms": 13.603791943751276, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12915776436, "mlx_cache_bytes": 14182832972, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12915776436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e6f78bc354d30463ea86a24", "attempt_id": "d1712f06bc81", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:46.146081Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 461, "message_tokens": 357, "message_utf8_bytes": 818, "cache_tensor_bytes": null, "serialized_payload_bytes": 818, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8823.737625032663, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.54779102001339, "ttft_ms": 13.516207924112678, "decode_ms": 13.586875051259995}, "total_wall_ms": 82.5877080205828, "ttft_ms": 13.516207924112678, "input_usage": {"receiver_prompt_tokens": 461, "sender_input_tokens": 11111, "sender_output_tokens": 512, "sender_prefill_ms": 1479.025417007506, "sender_ttft_ms": 14.524542028084397, "sender_decode_ms": 7321.621791925281}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683095552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902636432, "mlx_cache_bytes": 14372363084, "process_rss_bytes": 1683095552}, "peak_prefill_memory": null, "peak_decode_memory": 12902636432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3ad6a301c2e7b4e2d6ae58d641925e93e0066c630a27d3ad86c7a922575f07e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1cb40bf4ea332038237383a1", "attempt_id": "f4f79c363b6b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:46.266914Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 596, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.13175000995398, "ttft_ms": 13.547042035497725, "decode_ms": 13.581625069491565}, "total_wall_ms": 99.38333299942315, "ttft_ms": 13.547042035497725, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13013066840, "mlx_cache_bytes": 14639405900, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 13013066840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da562684043e56b86cd6ea84", "attempt_id": "236e5b518989", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:46.397006Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 588, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.7084590792656, "ttft_ms": 13.449791935272515, "decode_ms": 13.504082919098437}, "total_wall_ms": 97.72849990986288, "ttft_ms": 13.449791935272515, "input_usage": {"receiver_prompt_tokens": 588}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008086104, "mlx_cache_bytes": 14902811468, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 13008086104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "87bda7935a0dc3e5983b10ef", "attempt_id": "0b19890ba04f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:46.524849Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 589, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.61470795795321, "ttft_ms": 13.919792021624744, "decode_ms": 13.396083028055727}, "total_wall_ms": 98.00670796539634, "ttft_ms": 13.919792021624744, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989178968, "mlx_cache_bytes": 15145032524, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 12989178968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c914c8939e382a0e68e59fa8", "attempt_id": "a6d0d5eff175", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:46.653266Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.43237495236099, "ttft_ms": 13.48870899528265, "decode_ms": 93.62437494564801}, "total_wall_ms": 178.59033402055502, "ttft_ms": 13.48870899528265, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 15145032524, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3230540", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "9e5fef977ea5ee69bae76221845d569e55baabe35fda1d14bcbfae12f76a6b9f"} | ||||
| 1155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "37e4974db94845b3d595b682", "attempt_id": "dd0eb27dfab3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:46.861336Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.02862496301532, "ttft_ms": 13.442999916151166, "decode_ms": 120.33016607165337}, "total_wall_ms": 204.8692499520257, "ttft_ms": 13.442999916151166, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994536536, "mlx_cache_bytes": 15302908748, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 12994536536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,647,285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "20463bb6e5dee768be8060fd148f5fa8abec5ef06fe7925e2b2417d974e95146"} | ||||
| 1156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe6c1d4d87896da1cf09b680", "attempt_id": "927af290c278", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:47.096216Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.24120795540512, "ttft_ms": 13.361666002310812, "decode_ms": 66.80904200766236}, "total_wall_ms": 151.75187506247312, "ttft_ms": 13.361666002310812, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996125784, "mlx_cache_bytes": 15302908748, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 12996125784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Tekdra-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "3e9dfeb045758c8b376f36e3869ade8089296923cd7677fd3abbaf400b0ff1d8"} | ||||
| 1157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93178c3f6393c72ba2b6ba62", "attempt_id": "41f8146c741e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:47.278525Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.88908303901553, "ttft_ms": 13.456583023071289, "decode_ms": 93.27612491324544}, "total_wall_ms": 177.63000004924834, "ttft_ms": 13.456583023071289, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994929752, "mlx_cache_bytes": 15302908748, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 12994929752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1594497", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "90d17df0c92baf8a280fe87f58b1d58c435539e6302c4b49d1c1f89332d6aaed"} | ||||
| 1158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "48976dd6d4c9cd1fa2a7dc31", "attempt_id": "b4901b0ff599", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:47.486301Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 595, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.41058293543756, "ttft_ms": 13.598375022411346, "decode_ms": 13.22737499140203}, "total_wall_ms": 98.23795803822577, "ttft_ms": 13.598375022411346, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010412632, "mlx_cache_bytes": 15390497612, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 13010412632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "013dbc15afe091d01ee376aa", "attempt_id": "947c999102e5", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:47.614704Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.80537495110184, "ttft_ms": 13.563084066845477, "decode_ms": 13.299208949320018}, "total_wall_ms": 97.67145803198218, "ttft_ms": 13.563084066845477, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 15390497612, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "138902142d3a8f88d4fe3a7f", "attempt_id": "52b6c760d39b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:47.742554Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1220, "cache_tensor_bytes": null, "serialized_payload_bytes": 1220, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.057040977291763, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.08979201782495, "ttft_ms": 13.487374992109835, "decode_ms": 13.210625038482249}, "total_wall_ms": 97.82391600310802, "ttft_ms": 13.487374992109835, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1683128320, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993356888, "mlx_cache_bytes": 15478971212, "process_rss_bytes": 1683128320}, "peak_prefill_memory": null, "peak_decode_memory": 12993356888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b158f56028a25416ee29a4dbf8f0463dd1af2497414b0ce61b6d46f2e6baf73e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4c37755cce58a65274917cf0", "attempt_id": "9de98cca7e86", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:49.629876Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 44, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.4571250649169087, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.09824997652322, "ttft_ms": 34.09824997652322, "decode_ms": 141.3025000365451}, "total_wall_ms": 185.6935831019655, "ttft_ms": 34.09824997652322, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268342000, "mlx_cache_bytes": 15958844477, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268342000, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "UP-32B-8542", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "798eea2cae9879810e5e36f02f6558969b788ceeebbe810dc5924a9db20b7b95"} | ||||
| 1162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "087f13a2b9df18067f44ac76", "attempt_id": "820033d35e98", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:49.846683Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 36, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 0.9647499537095428, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.94391694664955, "ttft_ms": 29.94391694664955, "decode_ms": 15.08141600061208}, "total_wall_ms": 54.36224990990013, "ttft_ms": 29.94391694664955, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13260461296, "mlx_cache_bytes": 15993381949, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13260461296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "516c2d4af1ea9b571386fe31", "attempt_id": "12a5da22d4f5", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:49.932033Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 37, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.9807500066235662, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.105083995498717, "ttft_ms": 31.105083995498717, "decode_ms": 13.782416936010122}, "total_wall_ms": 55.0935419742018, "ttft_ms": 31.105083995498717, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13261886704, "mlx_cache_bytes": 16018285629, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13261886704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "435fea5185ff3050ebf3f495", "attempt_id": "b1afb1d882db", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.016849Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 51, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.6286249738186598, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.83116693980992, "ttft_ms": 31.83116693980992, "decode_ms": 98.32462493795902}, "total_wall_ms": 139.83404194004834, "ttft_ms": 31.83116693980992, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 51}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13273683212, "mlx_cache_bytes": 16067339733, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273683212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2570705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "05c059b42e74bde0c19cb8c87109b0e108b32dcfb48039ad1b0e27bcfa7095e7"} | ||||
| 1165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6f1eed9c3065468bda4b83d1", "attempt_id": "40e243ef3903", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.186989Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 46, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.9220419926568866, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.151374987326562, "ttft_ms": 30.151374987326562, "decode_ms": 98.15787500701845}, "total_wall_ms": 138.7250830885023, "ttft_ms": 30.151374987326562, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13269472524, "mlx_cache_bytes": 16099616213, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13269472524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3500000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "2011dac3293f3e90a17e94b8ec4a08cf5babe9d83c48a39dfbd687519ed4635a"} | ||||
| 1166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "339608a544328522defdf750", "attempt_id": "4772fd7743a3", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.356047Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 53, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.9739170093089342, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.25150001142174, "ttft_ms": 31.25150001142174, "decode_ms": 70.09608298540115}, "total_wall_ms": 111.36262502986938, "ttft_ms": 31.25150001142174, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13280253208, "mlx_cache_bytes": 16146360189, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280253208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obyald-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "23c04d115364ebc2975e80d3e8413c0aa596b61e2617ae66ab36d7b585c37f67"} | ||||
| 1167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6fa27f77aad623905e42d32a", "attempt_id": "c3f73b947537", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.498433Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 47, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.8087500939145684, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.00354108028114, "ttft_ms": 31.00354108028114, "decode_ms": 98.08941604569554}, "total_wall_ms": 139.27933399099857, "ttft_ms": 31.00354108028114, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270308108, "mlx_cache_bytes": 16160647037, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270308108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2074447", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "7b8a2a03d6b3d73c5e30c050ede23208dc5760f3bb1fc82ee8110660d1b33a0c"} | ||||
| 1168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7ab647adb935ef52521d0910", "attempt_id": "4abcad1ce39d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.668378Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 43, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.892999978736043, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.491625075228512, "ttft_ms": 30.491625075228512, "decode_ms": 70.16758306417614}, "total_wall_ms": 111.06274998746812, "ttft_ms": 30.491625075228512, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1781497856, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270455536, "mlx_cache_bytes": 16179423101, "process_rss_bytes": 1781497856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270455536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "b06ff625e497afac6d97bd4e3f65fc6636ba421022f1376300ca2a58f58b7d2b"} | ||||
| 1169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a42adb2cc7fe0965668520b", "attempt_id": "b9a76da21ab8", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.809986Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 48, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.9560420187190175, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.474874958395958, "ttft_ms": 29.474874958395958, "decode_ms": 14.016457949765027}, "total_wall_ms": 53.90025000087917, "ttft_ms": 29.474874958395958, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1781514240, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270881548, "mlx_cache_bytes": 16198592381, "process_rss_bytes": 1781514240}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270881548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce2a77575b5b14f85ea8d9a6", "attempt_id": "642e90faab12", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.894028Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11006, "keep": 2752, "compress_ms": 11.187208932824433}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 49, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1758.8464169530198, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 11.221957975067198, "serialize_ms": 23.01112504210323, "load_ms": 1.6984579851850867, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.902415979653597, "ttft_ms": 30.902415979653597, "decode_ms": 14.13054100703448}, "total_wall_ms": 54.85470802523196, "ttft_ms": 30.902415979653597, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1781530624, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13272290572, "mlx_cache_bytes": 16218056573, "process_rss_bytes": 1781530624}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272290572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1d15b7333621d52cf83c82f2", "attempt_id": "025ceb0f1e5d", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:50.979060Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 44, "compress_ms": 98.41716708615422}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 44, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 129.15924994740635, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 106.312167015858, "serialize_ms": 22.605459089390934, "load_ms": 0.7897500181570649, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.15941597893834, "ttft_ms": 29.15941597893834, "decode_ms": 154.62049993220717}, "total_wall_ms": 321.98487501591444, "ttft_ms": 29.15941597893834, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 44}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1782497280, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268030704, "mlx_cache_bytes": 16662816773, "process_rss_bytes": 1782497280}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268030704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "VJ-84A-2155", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "a1a7cdfb46b3d678be256814fe2c8f5bb5c6d220d4c63e46ac239a4c136fefb4"} | ||||
| 1172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "74655a117f1543ecb2d22fa5", "attempt_id": "8f3a9eb9765e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:51.334287Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 36, "compress_ms": 89.2011250834912}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 36, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466046, "side_information_bytes": 16318, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.28104194439948, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 97.51329198479652, "serialize_ms": 17.54033297766, "load_ms": 1.6632499173283577, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.051917023025453, "ttft_ms": 29.051917023025453, "decode_ms": 14.060916029848158}, "total_wall_ms": 168.2071250397712, "ttft_ms": 29.051917023025453, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1883947008, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13260461296, "mlx_cache_bytes": 16690243589, "process_rss_bytes": 1883947008}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13260461296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf1065956912614db2febe5c01f5d64af72dfb61cfacc8b6b3fc8dbc0c547032", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2763d71fc39ce44d423861ba", "attempt_id": "f35d4b3fe0f4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:51.533863Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 37, "compress_ms": 89.52124998904765}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 37, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 113.77945798449218, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 98.00429199822247, "serialize_ms": 15.532666933722794, "load_ms": 0.7458330364897847, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.42641596402973, "ttft_ms": 30.42641596402973, "decode_ms": 14.335917076095939}, "total_wall_ms": 167.4304170301184, "ttft_ms": 30.42641596402973, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1883947008, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13261886704, "mlx_cache_bytes": 16724830213, "process_rss_bytes": 1883947008}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13261886704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c64b5436d42f427fa8298f3", "attempt_id": "291c22faa5ee", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:51.732557Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 51, "compress_ms": 91.32225008215755}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 51, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.61987502500415, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 99.7993340715766, "serialize_ms": 15.59025002643466, "load_ms": 1.719290972687304, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.60687501076609, "ttft_ms": 31.60687501076609, "decode_ms": 126.91229197662324}, "total_wall_ms": 284.4101249938831, "ttft_ms": 31.60687501076609, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 51}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1883963392, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13273683212, "mlx_cache_bytes": 16768641029, "process_rss_bytes": 1883963392}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273683212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,570,705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "cd44b6033df7535fd29532c9e4e7be6317b176330ca7b0a10f0dbd3bd21f4bed"} | ||||
| 1175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9908d7c16dd1183f0519d111", "attempt_id": "72837be50212", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:52.049063Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 46, "compress_ms": 91.40658297110349}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 46, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.90449996199459, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 99.78216700255871, "serialize_ms": 14.902082970365882, "load_ms": 1.680874964222312, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.82720802538097, "ttft_ms": 29.82720802538097, "decode_ms": 99.22012500464916}, "total_wall_ms": 253.74870805535465, "ttft_ms": 29.82720802538097, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1883963392, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13269472524, "mlx_cache_bytes": 16801048581, "process_rss_bytes": 1883963392}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13269472524, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5647285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "452d40637e3c51836b99b42abfe7b255c52457db43fc1278ebfdf39cb7de236d"} | ||||
| 1176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e1ff8d40b8b99fb0527843f", "attempt_id": "eabce72d03cf", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:52.334392Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 53, "compress_ms": 92.94533298816532}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 53, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 116.7057080892846, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 101.88129195012152, "serialize_ms": 14.59787494968623, "load_ms": 1.500000013038516, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.588250025175512, "ttft_ms": 30.588250025175512, "decode_ms": 71.04029098991305}, "total_wall_ms": 228.04783401079476, "ttft_ms": 30.588250025175512, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1883979776, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13275944212, "mlx_cache_bytes": 16855590917, "process_rss_bytes": 1883979776}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13275944212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Tekdra-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "3e9dfeb045758c8b376f36e3869ade8089296923cd7677fd3abbaf400b0ff1d8"} | ||||
| 1177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8bb8b6685f1948a4d28d8feb", "attempt_id": "dfc353c61f97", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:52.595231Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 47, "compress_ms": 92.10254193749279}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 47, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.86899997200817, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 100.40899994783103, "serialize_ms": 15.245249960571527, "load_ms": 1.6766659682616591, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.38058301899582, "ttft_ms": 30.38058301899582, "decode_ms": 99.06087501440197}, "total_wall_ms": 255.1431660540402, "ttft_ms": 30.38058301899582, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1883979776, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270308108, "mlx_cache_bytes": 16888702981, "process_rss_bytes": 1883979776}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270308108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4144884", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "dd0bed4903ec8fa7cf19e8848999a8918e7bd5f491887d9c0d706d29687b2d4b"} | ||||
| 1178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2925c6771e8687c788aeb7b9", "attempt_id": "bf67b12dd0af", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:52.880905Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 43, "compress_ms": 89.47162504773587}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 43, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 112.84449999220669, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 97.38437493797392, "serialize_ms": 15.240999986417592, "load_ms": 1.579540898092091, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.092124943621457, "ttft_ms": 30.092124943621457, "decode_ms": 70.03900001291186}, "total_wall_ms": 222.69750002305955, "ttft_ms": 30.092124943621457, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1883979776, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268276464, "mlx_cache_bytes": 16920078341, "process_rss_bytes": 1883979776}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268276464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "b06ff625e497afac6d97bd4e3f65fc6636ba421022f1376300ca2a58f58b7d2b"} | ||||
| 1179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "360fedc60136ac8d7bc72aaf", "attempt_id": "4c9708d89651", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:53.134798Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 48, "compress_ms": 91.28712501842529}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 48, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.6715831020847, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 99.6957499301061, "serialize_ms": 15.747500001452863, "load_ms": 1.3608329463750124, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.09537497907877, "ttft_ms": 29.09537497907877, "decode_ms": 13.93766701221466}, "total_wall_ms": 168.2305419817567, "ttft_ms": 29.09537497907877, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1883996160, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270881548, "mlx_cache_bytes": 16953894917, "process_rss_bytes": 1883996160}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270881548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a572d197cc42979b32bf226b", "attempt_id": "5aa3b97dc9f1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:53.333760Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11006, "keep": 2752, "window_tokens": 49, "compress_ms": 90.91320796869695}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 49, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.88833301700652, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 98.84400002192706, "serialize_ms": 15.792167047038674, "load_ms": 1.6166249988600612, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.9902080334723, "ttft_ms": 30.9902080334723, "decode_ms": 14.05374996829778}, "total_wall_ms": 169.8124170070514, "ttft_ms": 30.9902080334723, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1883996160, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13272290572, "mlx_cache_bytes": 16988416005, "process_rss_bytes": 1883996160}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272290572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "328483cc9207a71d8ec8ad39", "attempt_id": "0883caeb6380", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:53.607375Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 44, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 6.003666901960969, "receiver_prefill_ms": 0.0, "query_prefill_ms": 51.4104999601841, "ttft_ms": 51.4104999601841, "decode_ms": 180.35716703161597}, "total_wall_ms": 246.32870801724494, "ttft_ms": 51.4104999601841, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 44}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1960722432, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13639439849, "mlx_cache_bytes": 17576771685, "process_rss_bytes": 1960722432}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13639439849, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "VJ-84A-2155", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "a1a7cdfb46b3d678be256814fe2c8f5bb5c6d220d4c63e46ac239a4c136fefb4"} | ||||
| 1182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b7a1bbe19363d1a9d363f260", "attempt_id": "f0e03ada81c1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:53.888115Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 36, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.7628749376162887, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.542875088751316, "ttft_ms": 38.542875088751316, "decode_ms": 16.25183306168765}, "total_wall_ms": 65.7832499127835, "ttft_ms": 38.542875088751316, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1903656960, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13611308405, "mlx_cache_bytes": 17678614629, "process_rss_bytes": 1903656960}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13611308405, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "774b2f2e5306126def199e5d", "attempt_id": "e2056ad3d483", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:53.985052Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 37, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.639374928548932, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.36179200839251, "ttft_ms": 36.36179200839251, "decode_ms": 16.259708907455206}, "total_wall_ms": 63.793125096708536, "ttft_ms": 36.36179200839251, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1903607808, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13694227829, "mlx_cache_bytes": 17704796261, "process_rss_bytes": 1903607808}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13694227829, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9312f8940947380d6cd46086", "attempt_id": "e17663c27104", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:54.079601Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 51, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.830540994182229, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.24433300644159, "ttft_ms": 43.24433300644159, "decode_ms": 146.05695800855756}, "total_wall_ms": 200.17816696781665, "ttft_ms": 43.24433300644159, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 51}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1901756416, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13663314337, "mlx_cache_bytes": 17850390197, "process_rss_bytes": 1901756416}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13663314337, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,570,705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "cd44b6033df7535fd29532c9e4e7be6317b176330ca7b0a10f0dbd3bd21f4bed"} | ||||
| 1185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d4e7b3d5b49e90c42dc4f0e3", "attempt_id": "7391e156f240", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:54.310063Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 46, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.332707983441651, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.07337503693998, "ttft_ms": 46.07337503693998, "decode_ms": 114.06520800665021}, "total_wall_ms": 170.48654099926353, "ttft_ms": 46.07337503693998, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1866924032, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13643041660, "mlx_cache_bytes": 17980544693, "process_rss_bytes": 1866924032}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13643041660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5647285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "452d40637e3c51836b99b42abfe7b255c52457db43fc1278ebfdf39cb7de236d"} | ||||
| 1186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b44529c6c08337cc645d5f8", "attempt_id": "0da8e35c8141", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:54.511038Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 53, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.698624972254038, "receiver_prefill_ms": 0.0, "query_prefill_ms": 155.14658309984952, "ttft_ms": 155.14658309984952, "decode_ms": 86.4915419369936}, "total_wall_ms": 252.77424999512732, "ttft_ms": 155.14658309984952, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1865515008, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13670769297, "mlx_cache_bytes": 18131807717, "process_rss_bytes": 1865515008}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13670769297, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Tekdra-15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "3e9dfeb045758c8b376f36e3869ade8089296923cd7677fd3abbaf400b0ff1d8"} | ||||
| 1187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c5fbe34dfc1fff1ff5fdba83", "attempt_id": "eda9b7494e16", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:54.795903Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 47, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.5265420554205775, "receiver_prefill_ms": 0.0, "query_prefill_ms": 274.56854202318937, "ttft_ms": 274.56854202318937, "decode_ms": 113.76674997154623}, "total_wall_ms": 399.87545798067003, "ttft_ms": 274.56854202318937, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1865482240, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13649534161, "mlx_cache_bytes": 18264845797, "process_rss_bytes": 1865482240}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13649534161, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4141484", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "69df613b473ace585f6ea341a50e0c5fe2c4480989b92863908a80d8a8043af1"} | ||||
| 1188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "653f04f36507698bf5e6ef77", "attempt_id": "9dcfa5dd6102", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:55.229695Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 43, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.736042020842433, "receiver_prefill_ms": 0.0, "query_prefill_ms": 54.32037508580834, "ttft_ms": 54.32037508580834, "decode_ms": 86.75604104064405}, "total_wall_ms": 151.86429198365659, "ttft_ms": 54.32037508580834, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1865465856, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13638422153, "mlx_cache_bytes": 18386480613, "process_rss_bytes": 1865465856}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13638422153, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "b06ff625e497afac6d97bd4e3f65fc6636ba421022f1376300ca2a58f58b7d2b"} | ||||
| 1189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5c97a3a23bf1270dbe5327c3", "attempt_id": "e47c6ddb9551", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:55.412442Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 48, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.3497920483350754, "receiver_prefill_ms": 0.0, "query_prefill_ms": 348.4866670332849, "ttft_ms": 348.4866670332849, "decode_ms": 17.789875040762126}, "total_wall_ms": 377.5341670261696, "ttft_ms": 348.4866670332849, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1566965760, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13652696273, "mlx_cache_bytes": 18523483621, "process_rss_bytes": 1566965760}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13652696273, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fec1cbc28555ea1cd81211a3", "attempt_id": "195858a6c2a4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:55.824390Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10967, "source_tokens_receiver": 10967, "query_tokens": 49, "message_tokens": 11006, "message_utf8_bytes": 58936, "cache_tensor_bytes": 215541504, "serialized_payload_bytes": 215576576, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 71.8912499723956, "doc_prefill_ms": 1706.9744589971378, "compress_ms": 16.014041961170733, "serialize_ms": 55.51991704851389, "load_ms": 2.547916956245899, "receiver_prefill_ms": 0.0, "query_prefill_ms": 203.51279200986028, "ttft_ms": 203.51279200986028, "decode_ms": 16.570209059864283}, "total_wall_ms": 231.83870897628367, "ttft_ms": 203.51279200986028, "input_usage": {"receiver_prefix_tokens": 11006, "dense_cache_bytes": 405725184, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1507770368, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13656775889, "mlx_cache_bytes": 18662157797, "process_rss_bytes": 1507770368}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13656775889, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48aa00bacbc5365794c13888ae6c81fd58c10ab1ad28ab28c50dc9b7cfdf0c29", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5991a87e1dc2bc18f196b961", "attempt_id": "6a705e735af5", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:56.744660Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10865, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1787.833083071746, "ttft_ms": 18.27941695228219, "decode_ms": 132.58699991274625}, "total_wall_ms": 1953.8488329853863, "ttft_ms": 18.27941695228219, "input_usage": {"receiver_prompt_tokens": 10865}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1159036928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14276105280, "mlx_cache_bytes": 6164521304, "process_rss_bytes": 1159036928}, "peak_prefill_memory": null, "peak_decode_memory": 14276105280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "VJ-84A-2155", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "a1a7cdfb46b3d678be256814fe2c8f5bb5c6d220d4c63e46ac239a4c136fefb4"} | ||||
| 1192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ca597942858781bbe54d2e23", "attempt_id": "310f3361402d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:53:58.728685Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10859, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1744.5510419784114, "ttft_ms": 16.65183308068663, "decode_ms": 32.889500027522445}, "total_wall_ms": 1808.8978750165552, "ttft_ms": 16.65183308068663, "input_usage": {"receiver_prompt_tokens": 10859}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1159036928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6396256600, "process_rss_bytes": 1159036928}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "907640680a48a4a56ae44c77", "attempt_id": "749cb0fd50e1", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:00.566400Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10859, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1707.4059590231627, "ttft_ms": 16.61804097238928, "decode_ms": 33.44958310481161}, "total_wall_ms": 1772.2646250622347, "ttft_ms": 16.61804097238928, "input_usage": {"receiver_prompt_tokens": 10859}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1159036928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14275154984, "mlx_cache_bytes": 6396256600, "process_rss_bytes": 1159036928}, "peak_prefill_memory": null, "peak_decode_memory": 14275154984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "688cb84903cf858a4005c0db", "attempt_id": "ea0314451390", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:02.367343Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10874, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1673.0921251000836, "ttft_ms": 16.558417002670467, "decode_ms": 82.63449999503791}, "total_wall_ms": 1786.8653329787776, "ttft_ms": 16.558417002670467, "input_usage": {"receiver_prompt_tokens": 10874}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159036928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14280086592, "mlx_cache_bytes": 6649586008, "process_rss_bytes": 1159036928}, "peak_prefill_memory": null, "peak_decode_memory": 14280086592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,230,540", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "c3d6dd9f1f5f8a9f8de5f4fcf1619fd408783984404ffbda73a45fd686823ec6"} | ||||
| 1195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4f918bc401128c6776ff9763", "attempt_id": "10f9ed48d63c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:04.183973Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10868, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1724.1283749463037, "ttft_ms": 16.97062503080815, "decode_ms": 82.5794159900397}, "total_wall_ms": 1838.2572500267997, "ttft_ms": 16.97062503080815, "input_usage": {"receiver_prompt_tokens": 10868}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159036928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14278054976, "mlx_cache_bytes": 6885056856, "process_rss_bytes": 1159036928}, "peak_prefill_memory": null, "peak_decode_memory": 14278054976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,647,285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "20463bb6e5dee768be8060fd148f5fa8abec5ef06fe7925e2b2417d974e95146"} | ||||
| 1196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e82fe99b9898ce24020325a", "attempt_id": "91a72b2c6139", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:06.050954Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10875, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1687.4361250083894, "ttft_ms": 16.855916008353233, "decode_ms": 82.75020797736943}, "total_wall_ms": 1801.6137920785695, "ttft_ms": 16.855916008353233, "input_usage": {"receiver_prompt_tokens": 10875}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159036928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14280201280, "mlx_cache_bytes": 6968156504, "process_rss_bytes": 1159036928}, "peak_prefill_memory": null, "peak_decode_memory": 14280201280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obyald-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "23c04d115364ebc2975e80d3e8413c0aa596b61e2617ae66ab36d7b585c37f67"} | ||||
| 1197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "13560613e278f44942cb3df8", "attempt_id": "9b7a25ff1c7f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:07.882335Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10870, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1702.551458030939, "ttft_ms": 16.905916039831936, "decode_ms": 82.85654208157212}, "total_wall_ms": 1816.8812500080094, "ttft_ms": 16.905916039831936, "input_usage": {"receiver_prompt_tokens": 10870}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159036928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14278415424, "mlx_cache_bytes": 7091888472, "process_rss_bytes": 1159036928}, "peak_prefill_memory": null, "peak_decode_memory": 14278415424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,975,675", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "26ee4023d532eac46576af3de103a6c23eddcb09bbf1b267c6a7a01081dbcd73"} | ||||
| 1198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "72b30dd414e71d5d00de7886", "attempt_id": "edf74db31049", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:09.727565Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10866, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1708.6224170634523, "ttft_ms": 16.72375004272908, "decode_ms": 49.64074993040413}, "total_wall_ms": 1789.6328329807147, "ttft_ms": 16.72375004272908, "input_usage": {"receiver_prompt_tokens": 10866}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1159086080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14300894272, "mlx_cache_bytes": 7204610392, "process_rss_bytes": 1159086080}, "peak_prefill_memory": null, "peak_decode_memory": 14300894272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "4918d4e05218ac860241eaa4933422bbcda72bd6dde1b937902e13ed2f433d9f"} | ||||
| 1199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3fe22a4e49621812d00a1de6", "attempt_id": "4f54c5c4760d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:11.545657Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10870, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1717.082708957605, "ttft_ms": 16.50037500075996, "decode_ms": 16.620083013549447}, "total_wall_ms": 1764.6294170990586, "ttft_ms": 16.50037500075996, "input_usage": {"receiver_prompt_tokens": 10870}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159086080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14278415424, "mlx_cache_bytes": 7204610392, "process_rss_bytes": 1159086080}, "peak_prefill_memory": null, "peak_decode_memory": 14278415424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b0ae6b5f660456a2bda7e4a6", "attempt_id": "cb590d49d937", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:13.338758Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 10872, "message_tokens": 10762, "message_utf8_bytes": 58936, "cache_tensor_bytes": null, "serialized_payload_bytes": 58936, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1705.5111249210313, "ttft_ms": 16.887916950508952, "decode_ms": 16.69824996497482}, "total_wall_ms": 1754.4442499056458, "ttft_ms": 16.887916950508952, "input_usage": {"receiver_prompt_tokens": 10872}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159086080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14303122496, "mlx_cache_bytes": 7318380888, "process_rss_bytes": 1159086080}, "peak_prefill_memory": null, "peak_decode_memory": 14303122496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b5c02439ae6be11e2a9a9e83", "attempt_id": "edb56416d595", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:25.032778Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 619, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.85312500689179, "ttft_ms": 13.813083060085773, "decode_ms": 54.33187505695969}, "total_wall_ms": 146.5284579899162, "ttft_ms": 13.813083060085773, "input_usage": {"receiver_prompt_tokens": 619, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040901632, "mlx_cache_bytes": 10394682112, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13040901632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "LF-87C", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "4223c114c7b02d0ab6745437f17a67397e50a2f39db752a7227cf9392833bc9d"} | ||||
| 1202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a872e6e2b0ee676240c0f960", "attempt_id": "4dda3e3c18d1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:25.209258Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.44229102879763, "ttft_ms": 14.08762508071959, "decode_ms": 27.667124988511205}, "total_wall_ms": 119.31920901406556, "ttft_ms": 14.08762508071959, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821440, "mlx_cache_bytes": 10737206016, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13037821440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "46956f4f83e302aa680af8a3", "attempt_id": "9c6afb463aa9", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:25.357238Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.92754205688834, "ttft_ms": 13.611292000859976, "decode_ms": 28.084833989851177}, "total_wall_ms": 118.75095905270427, "ttft_ms": 13.611292000859976, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821440, "mlx_cache_bytes": 10737206016, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13037821440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "20980e7470d2fa08f7554679", "attempt_id": "af8abd2171ba", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:25.507012Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 628, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.82612496521324, "ttft_ms": 14.114791993051767, "decode_ms": 13.484708964824677}, "total_wall_ms": 106.55933292582631, "ttft_ms": 14.114791993051767, "input_usage": {"receiver_prompt_tokens": 628, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13054746148, "mlx_cache_bytes": 10816998604, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13054746148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a367fe1b030ae1db34762249", "attempt_id": "b414f8416466", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:25.642582Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.98100002016872, "ttft_ms": 13.690499938093126, "decode_ms": 68.79458297044039}, "total_wall_ms": 160.53925000596792, "ttft_ms": 13.690499938093126, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13066034724, "mlx_cache_bytes": 11039640780, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13066034724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,647,285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "20463bb6e5dee768be8060fd148f5fa8abec5ef06fe7925e2b2417d974e95146"} | ||||
| 1206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b1fa9976fac8e61424c811b5", "attempt_id": "ba1e8bc8cd48", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:25.831879Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 629, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.7387919370085, "ttft_ms": 13.580875005573034, "decode_ms": 68.1152920005843}, "total_wall_ms": 160.5935419211164, "ttft_ms": 13.580875005573034, "input_usage": {"receiver_prompt_tokens": 629, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13058907688, "mlx_cache_bytes": 11084666524, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13058907688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obyald-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "23c04d115364ebc2975e80d3e8413c0aa596b61e2617ae66ab36d7b585c37f67"} | ||||
| 1207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7c43b56ceca0faab42ad9a3c", "attempt_id": "8a50b0099eae", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:26.020750Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.95437502115965, "ttft_ms": 13.648833031766117, "decode_ms": 67.92879197746515}, "total_wall_ms": 159.58245797082782, "ttft_ms": 13.648833031766117, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13051715108, "mlx_cache_bytes": 11176613532, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13051715108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,975,675", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "26ee4023d532eac46576af3de103a6c23eddcb09bbf1b267c6a7a01081dbcd73"} | ||||
| 1208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "17501e72283ca101a84d804e", "attempt_id": "56c8284965dc", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:26.208857Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.04429200384766, "ttft_ms": 13.824666035361588, "decode_ms": 13.39183293748647}, "total_wall_ms": 105.34733301028609, "ttft_ms": 13.824666035361588, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13069245988, "mlx_cache_bytes": 11338946204, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13069245988, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c1f3431759791319ebcc7ca7", "attempt_id": "1f292c302c40", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:26.342615Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.21729204058647, "ttft_ms": 13.767292024567723, "decode_ms": 13.635125011205673}, "total_wall_ms": 105.68579100072384, "ttft_ms": 13.767292024567723, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13055548964, "mlx_cache_bytes": 11342780060, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13055548964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "40fc1085db3f919bd8c5a332", "attempt_id": "ff956ccad6db", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:26.477453Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 1303, "cache_tensor_bytes": null, "serialized_payload_bytes": 1303, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9910.468291025609, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.61929195839912, "ttft_ms": 13.68458301294595, "decode_ms": 13.49020900670439}, "total_wall_ms": 105.94579204916954, "ttft_ms": 13.68458301294595, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 10896, "sender_output_tokens": 512, "sender_prefill_ms": 1739.9690840393305, "sender_ttft_ms": 16.829250031150877, "sender_decode_ms": 8146.032124990597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159544832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13080960548, "mlx_cache_bytes": 11427354268, "process_rss_bytes": 1159544832}, "peak_prefill_memory": null, "peak_decode_memory": 13080960548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f00312fa0bbd42d887163b286c85258f62fcec88f241261a8b3649acc69c2eb8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "21ed63ff2a91717cf3ef2026", "attempt_id": "cdf90a0cf8b8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:36.277532Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 422, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.93845900148153, "ttft_ms": 13.444500043988228, "decode_ms": 13.51862505543977}, "total_wall_ms": 83.82420788984746, "ttft_ms": 13.444500043988228, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12898311256, "mlx_cache_bytes": 11966076572, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12898311256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8849495d91f4425e393abc56", "attempt_id": "1c68755101dd", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:36.390679Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 416, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.97216710075736, "ttft_ms": 13.477541040629148, "decode_ms": 26.80933300871402}, "total_wall_ms": 93.14816701225936, "ttft_ms": 13.477541040629148, "input_usage": {"receiver_prompt_tokens": 416, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12895231064, "mlx_cache_bytes": 12198467228, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12895231064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "713ebd11bed8f262abc79af4", "attempt_id": "a61d97daefb8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:36.513175Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 416, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.41954198572785, "ttft_ms": 13.485625036992133, "decode_ms": 13.528332929126918}, "total_wall_ms": 80.266666947864, "ttft_ms": 13.485625036992133, "input_usage": {"receiver_prompt_tokens": 416, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12895231064, "mlx_cache_bytes": 12198467228, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12895231064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 1214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8359bc545a2674bd71b00a30", "attempt_id": "223030bcb0a0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:36.622457Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 431, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.340958992019296, "ttft_ms": 13.464874937199056, "decode_ms": 13.54887499473989}, "total_wall_ms": 83.2021669484675, "ttft_ms": 13.464874937199056, "input_usage": {"receiver_prompt_tokens": 431, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12903832664, "mlx_cache_bytes": 12455335580, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12903832664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "48513ff476a7a409fd1a1a45", "attempt_id": "891115f84292", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:36.733679Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 425, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.4283750243485, "ttft_ms": 13.501916080713272, "decode_ms": 67.15762498788536}, "total_wall_ms": 136.9200829649344, "ttft_ms": 13.501916080713272, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899753048, "mlx_cache_bytes": 12692395676, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12899753048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,647,285", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "20463bb6e5dee768be8060fd148f5fa8abec5ef06fe7925e2b2417d974e95146"} | ||||
| 1216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "497342a629af37cce0184c04", "attempt_id": "e6f509558b45", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:36.898497Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 432, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.90049999207258, "ttft_ms": 13.751709018833935, "decode_ms": 13.471459038555622}, "total_wall_ms": 83.007083972916, "ttft_ms": 13.751709018833935, "input_usage": {"receiver_prompt_tokens": 432, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904209496, "mlx_cache_bytes": 12819601052, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12904209496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "75eda032c1c42bf34b116bb7", "attempt_id": "167f6cfa185a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.009874Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 427, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.32733409199864, "ttft_ms": 14.190834015607834, "decode_ms": 13.445082935504615}, "total_wall_ms": 83.8578330585733, "ttft_ms": 14.190834015607834, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901309528, "mlx_cache_bytes": 13057955484, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12901309528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eb49c47bea8ede192464fc88", "attempt_id": "5b610f2bce25", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.124576Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 423, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.53658399730921, "ttft_ms": 13.570082955993712, "decode_ms": 13.341541984118521}, "total_wall_ms": 83.29491701442748, "ttft_ms": 13.570082955993712, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899195992, "mlx_cache_bytes": 13140924060, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12899195992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7b48b0275b8df9eec23f3c2f", "attempt_id": "5c5b6883f4f9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.237280Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 427, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.2249999018386, "ttft_ms": 13.437582994811237, "decode_ms": 13.47029092721641}, "total_wall_ms": 83.0488339997828, "ttft_ms": 13.437582994811237, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901309528, "mlx_cache_bytes": 13140924060, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12901309528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2116654042f87d4ddf3a8735", "attempt_id": "143c37143db2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.349158Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 429, "message_tokens": 303, "message_utf8_bytes": 817, "cache_tensor_bytes": null, "serialized_payload_bytes": 817, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9664.964374969713, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.27400004211813, "ttft_ms": 13.526540948078036, "decode_ms": 13.776166015304625}, "total_wall_ms": 83.40141596272588, "ttft_ms": 13.526540948078036, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 10926, "sender_output_tokens": 512, "sender_prefill_ms": 1506.8581660743803, "sender_ttft_ms": 16.098415944725275, "sender_decode_ms": 8134.1620000312105}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159725056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12924542040, "mlx_cache_bytes": 13251450524, "process_rss_bytes": 1159725056}, "peak_prefill_memory": null, "peak_decode_memory": 12924542040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52395d8ccf35446c9bc4e3a5e0c32bb3538b7c2fce97d0b75d0e66577345710f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3c8bb1d91e57d00943d06add", "attempt_id": "1b194082e9d4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.469355Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 608, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.0306670088321, "ttft_ms": 13.544833986088634, "decode_ms": 13.715167064219713}, "total_wall_ms": 103.34899998269975, "ttft_ms": 13.544833986088634, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034528256, "mlx_cache_bytes": 13613602460, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13034528256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "24054d8c9eb034eb54ab9331", "attempt_id": "c7aefd2cdf3e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.600950Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 602, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.84058395493776, "ttft_ms": 13.51116702426225, "decode_ms": 27.20799995586276}, "total_wall_ms": 116.58762500155717, "ttft_ms": 13.51116702426225, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031448064, "mlx_cache_bytes": 13950162588, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13031448064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "419f3ac117d2845fb56ee409", "attempt_id": "9da4bb4c54de", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.746194Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 602, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.45933402050287, "ttft_ms": 13.556291931308806, "decode_ms": 27.168666012585163}, "total_wall_ms": 116.22604203876108, "ttft_ms": 13.556291931308806, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031448064, "mlx_cache_bytes": 13950162588, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13031448064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c0cd3144b90f0f4198408e99", "attempt_id": "3401651dda96", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:37.890983Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 617, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.17162493988872, "ttft_ms": 13.673041947185993, "decode_ms": 67.36404204275459}, "total_wall_ms": 158.2692910451442, "ttft_ms": 13.673041947185993, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040541184, "mlx_cache_bytes": 14071273116, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13040541184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,230,540", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "c3d6dd9f1f5f8a9f8de5f4fcf1619fd408783984404ffbda73a45fd686823ec6"} | ||||
| 1225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8e492792c89a1c1005e7c774", "attempt_id": "afa94502e9fd", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:38.077667Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 611, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.24704099725932, "ttft_ms": 13.701834017410874, "decode_ms": 67.69795902073383}, "total_wall_ms": 158.70454208925366, "ttft_ms": 13.701834017410874, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067443712, "mlx_cache_bytes": 14228723356, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13067443712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,234,135", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "54cc85c7f47936abade0697df9e3c51b72e098f6bc122876ac8e34d8489aaa02"} | ||||
| 1226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9cf853d071450726a47e79e6", "attempt_id": "49dd0ff45e66", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:38.264905Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 618, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.41029206570238, "ttft_ms": 13.52016709279269, "decode_ms": 82.7061659656465}, "total_wall_ms": 173.741125036031, "ttft_ms": 13.52016709279269, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040901632, "mlx_cache_bytes": 14228723356, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13040901632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Aldkour-14", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "ad1ef7279262e73f15f6d511c66db8e69384766c68929e3627b96d47ea63789f"} | ||||
| 1227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d15d947c7c330bbd726d560b", "attempt_id": "6305df66de72", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:38.467509Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 613, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.66987495031208, "ttft_ms": 13.717166963033378, "decode_ms": 446.8859169865027}, "total_wall_ms": 538.3943340275437, "ttft_ms": 13.717166963033378, "input_usage": {"receiver_prompt_tokens": 613}, "output_usage": {"output_tokens": 33}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821440, "mlx_cache_bytes": 14228723356, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13037821440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,975,675 + 2,960,362 + 2,488,120 + 1,203,172 = 11,126,909", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "64474256271236c9fd392373e99bd05ae15b1169cfe89524af9dadd0ac96fc96"} | ||||
| 1228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6f5329b333aafac1d33614ef", "attempt_id": "ea330b8daf98", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:39.035367Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 609, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.7783750994131, "ttft_ms": 13.480708003044128, "decode_ms": 13.50145903415978}, "total_wall_ms": 102.81145805492997, "ttft_ms": 13.480708003044128, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708480, "mlx_cache_bytes": 14348261020, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13034708480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "81e348751e3d7092805f945b", "attempt_id": "55341ae9f580", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:39.166649Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 613, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.09149999916553, "ttft_ms": 13.498540967702866, "decode_ms": 13.6006660759449}, "total_wall_ms": 104.20337493997067, "ttft_ms": 13.498540967702866, "input_usage": {"receiver_prompt_tokens": 613}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821440, "mlx_cache_bytes": 14348261020, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13037821440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "60f90fae9086b21a48c6e128", "attempt_id": "4c737a310bcc", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:39.298719Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 615, "message_tokens": 504, "message_utf8_bytes": 1518, "cache_tensor_bytes": null, "serialized_payload_bytes": 1518, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.184874895960093, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.59416692331433, "ttft_ms": 13.671666965819895, "decode_ms": 13.641666970215738}, "total_wall_ms": 105.01087503507733, "ttft_ms": 13.671666965819895, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1159774208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13070032384, "mlx_cache_bytes": 14567184028, "process_rss_bytes": 1159774208}, "peak_prefill_memory": null, "peak_decode_memory": 13070032384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3deaae94f5f5ff814f3fe44f38ccf7885ac8690a2bfe2612067506aebd5ff8d5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d3bf064b210898d7ecf91386", "attempt_id": "16b530cb630b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.007824Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 43, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.489665988832712, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.626832951791584, "ttft_ms": 32.626832951791584, "decode_ms": 110.55458395276219}, "total_wall_ms": 153.01149990409613, "ttft_ms": 32.626832951791584, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14574523620, "mlx_cache_bytes": 13947852789, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14574523620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "UP-24A-9763", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "35a493b45debec4af7b33682824e19b5b8e7fabb88b07ad9aba542f84596e5c0"} | ||||
| 1232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f91cefcf0f19fceb3a3eec83", "attempt_id": "d928af83f4dd", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.190438Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 37, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.525624935515225, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.640749980695546, "ttft_ms": 28.640749980695546, "decode_ms": 15.519249951466918}, "total_wall_ms": 54.183749947696924, "ttft_ms": 28.640749980695546, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571377892, "mlx_cache_bytes": 13975181301, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571377892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 1233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a97c9ce6a6e63cb92c8db00b", "attempt_id": "9d2798402c53", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.274516Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 37, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.5823749601840973, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.862165985628963, "ttft_ms": 28.862165985628963, "decode_ms": 15.448624966666102}, "total_wall_ms": 54.26312505733222, "ttft_ms": 28.862165985628963, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571377892, "mlx_cache_bytes": 13975181301, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571377892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8263665a3d02cdb380ec909", "attempt_id": "fb7519427f94", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.357983Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 52, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.519582980312407, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.657999937422574, "ttft_ms": 28.657999937422574, "decode_ms": 78.736542025581}, "total_wall_ms": 118.02129202987999, "ttft_ms": 28.657999937422574, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581110016, "mlx_cache_bytes": 14388077605, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581110016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,230,540", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "c3d6dd9f1f5f8a9f8de5f4fcf1619fd408783984404ffbda73a45fd686823ec6"} | ||||
| 1235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3db5c66259cd5cf336e9690e", "attempt_id": "4f6d1f744fe7", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.505375Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 46, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.4296659976243973, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.209334027953446, "ttft_ms": 26.209334027953446, "decode_ms": 30.930083943530917}, "total_wall_ms": 66.94295804481953, "ttft_ms": 26.209334027953446, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 46}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575752456, "mlx_cache_bytes": 14422238245, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575752456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e6fa5e19e020d6006ae42fc", "attempt_id": "4b4a6ea89977", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.601709Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 53, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.6337499730288982, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.147583059966564, "ttft_ms": 29.147583059966564, "decode_ms": 78.22716701775789}, "total_wall_ms": 117.63820901978761, "ttft_ms": 29.147583059966564, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581355780, "mlx_cache_bytes": 14434922694, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581355780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obyald-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "23c04d115364ebc2975e80d3e8413c0aa596b61e2617ae66ab36d7b585c37f67"} | ||||
| 1237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ab5d1ec83f1d8cc19f6dd2f3", "attempt_id": "56cfd94461ec", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.748309Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 48, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.556208986788988, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.145625023171306, "ttft_ms": 28.145625023171306, "decode_ms": 77.67791708465666}, "total_wall_ms": 116.13204202149063, "ttft_ms": 28.145625023171306, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 14457598150, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,930,540", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "4accde602ab785398132121b6711c10bcbeaa612a4a6d968f7520f4fa366b144"} | ||||
| 1238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b2944456325963602776a7d8", "attempt_id": "c36f8b4ce14e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:41.892732Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 44, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.410207991488278, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.728374931029975, "ttft_ms": 27.728374931029975, "decode_ms": 46.953124925494194}, "total_wall_ms": 84.42070800811052, "ttft_ms": 27.728374931029975, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14574703880, "mlx_cache_bytes": 14477537478, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14574703880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "4918d4e05218ac860241eaa4933422bbcda72bd6dde1b937902e13ed2f433d9f"} | ||||
| 1239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c32db40cdaad332cf7c97a7e", "attempt_id": "1e6a7c44b13d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:42.005225Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 48, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.5721670826897025, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.147749952040613, "ttft_ms": 28.147749952040613, "decode_ms": 15.783416922204196}, "total_wall_ms": 53.866124944761395, "ttft_ms": 28.147749952040613, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1467334656, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 14477537478, "process_rss_bytes": 1467334656}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8ecc46b8d450588adb054cc5", "attempt_id": "0fbb6cb643ef", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:42.088162Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10822, "keep": 2706, "compress_ms": 12.917083106003702}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 50, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358933, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1575.4986660322174, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 12.952832970768213, "serialize_ms": 55.41970895137638, "load_ms": 2.420458011329174, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.227374957874417, "ttft_ms": 27.227374957874417, "decode_ms": 15.673249959945679}, "total_wall_ms": 52.7601670473814, "ttft_ms": 27.227374957874417, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1467351040, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14582486272, "mlx_cache_bytes": 14503309510, "process_rss_bytes": 1467351040}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14582486272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "339808f2a0b621a9de9025b1f5a886900dc5022c60b51c174430ae0a967cc579", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3099b1c6b1a46e8c2d4a5e55", "attempt_id": "1e22148a9cfb", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:42.170087Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 43, "compress_ms": 152.1918330108747}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 43, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358972, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 483.98279095999897, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 159.8180829314515, "serialize_ms": 323.9492499269545, "load_ms": 2.0882090320810676, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.685208060778677, "ttft_ms": 28.685208060778677, "decode_ms": 123.97195806261152}, "total_wall_ms": 646.4339169906452, "ttft_ms": 28.685208060778677, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 43}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1258029056, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14574523620, "mlx_cache_bytes": 17086001454, "process_rss_bytes": 1258029056}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14574523620, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "VJ-84A-2155", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "17cc7e408da904f993de787b0e8d120efe2b52d9a8fd36b0cf97925bb7efda8f", "output_hash": "a1a7cdfb46b3d678be256814fe2c8f5bb5c6d220d4c63e46ac239a4c136fefb4"} | ||||
| 1242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0ba35c2e1a092b0d4a905abb", "attempt_id": "893c6df47ad3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:42.848134Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 37, "compress_ms": 126.95866695139557}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 37, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 198.86229105759412, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 134.17625008150935, "serialize_ms": 64.50279196724296, "load_ms": 2.575624966993928, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.16254203207791, "ttft_ms": 28.16254203207791, "decode_ms": 31.230750028043985}, "total_wall_ms": 268.2988749584183, "ttft_ms": 28.16254203207791, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1568849920, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571361508, "mlx_cache_bytes": 17138217262, "process_rss_bytes": 1568849920}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571361508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0dfb8d5e9b7b79e68d949285", "attempt_id": "77bc46d55667", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:43.149006Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 37, "compress_ms": 124.87375002820045}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 37, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 180.50170806236565, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 132.22212495747954, "serialize_ms": 48.07379108387977, "load_ms": 2.4168749805539846, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.206750052049756, "ttft_ms": 28.206750052049756, "decode_ms": 31.15320799406618}, "total_wall_ms": 249.84770896844566, "ttft_ms": 28.206750052049756, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1568751616, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571361508, "mlx_cache_bytes": 17138217262, "process_rss_bytes": 1568751616}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571361508, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e44ed421908e6d4bcf69b3a1", "attempt_id": "66257bd19a18", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:43.430271Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 52, "compress_ms": 130.10679103899747}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 52, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 236.72691697720438, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 137.52608303911984, "serialize_ms": 99.00862502399832, "load_ms": 2.6624170131981373, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.338041971437633, "ttft_ms": 28.338041971437633, "decode_ms": 77.78870896436274}, "total_wall_ms": 353.0660839751363, "ttft_ms": 28.338041971437633, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1568718848, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581110016, "mlx_cache_bytes": 17208750382, "process_rss_bytes": 1568718848}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581110016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,230,540", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "c3d6dd9f1f5f8a9f8de5f4fcf1619fd408783984404ffbda73a45fd686823ec6"} | ||||
| 1245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8398ab7b6cd559addf131d6", "attempt_id": "2ba838916444", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:43.815018Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 46, "compress_ms": 128.78270808141679}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 46, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 191.93904206622392, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 136.14620792213827, "serialize_ms": 55.598916951566935, "load_ms": 2.3334160214290023, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.936291087418795, "ttft_ms": 25.936291087418795, "decode_ms": 77.72191695403308}, "total_wall_ms": 305.41704199276865, "ttft_ms": 25.936291087418795, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1568686080, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575752456, "mlx_cache_bytes": 17271009582, "process_rss_bytes": 1568686080}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575752456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,647,285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "20463bb6e5dee768be8060fd148f5fa8abec5ef06fe7925e2b2417d974e95146"} | ||||
| 1246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "068fe6b2c8519561d4e3bba9", "attempt_id": "98dcdb56344a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:44.151491Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 53, "compress_ms": 131.60941703245044}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 53, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 406.8011249182746, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 138.92966706771404, "serialize_ms": 267.672749934718, "load_ms": 2.4167910451069474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.589957975782454, "ttft_ms": 28.589957975782454, "decode_ms": 77.54483295138925}, "total_wall_ms": 523.188833030872, "ttft_ms": 28.589957975782454, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1568620544, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581355780, "mlx_cache_bytes": 17325814062, "process_rss_bytes": 1568620544}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581355780, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obyald-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "23c04d115364ebc2975e80d3e8413c0aa596b61e2617ae66ab36d7b585c37f67"} | ||||
| 1247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ccef642fd1cdc052379e6fa", "attempt_id": "b914cbc74b96", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:44.706135Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 48, "compress_ms": 130.86087501142174}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 48, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 311.03587499819696, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 138.1276249885559, "serialize_ms": 172.71495901513845, "load_ms": 2.347583998925984, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.63808297459036, "ttft_ms": 27.63808297459036, "decode_ms": 78.291125013493}, "total_wall_ms": 426.83787492569536, "ttft_ms": 27.63808297459036, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1568604160, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 17376604462, "process_rss_bytes": 1568604160}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,975,675", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "6919cef37baccdd317e56be6fbf60f318e7c0d6bf50ef7201b45b80667138bd4"} | ||||
| 1248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8d72f07cd7d95b24729864dd", "attempt_id": "6ab05cda3d39", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:45.164267Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 44, "compress_ms": 127.96883401460946}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 44, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 210.3189160116017, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 135.34129108302295, "serialize_ms": 74.79345903266221, "load_ms": 2.5804999750107527, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.014457969926298, "ttft_ms": 27.014457969926298, "decode_ms": 61.89504102803767}, "total_wall_ms": 309.3524998985231, "ttft_ms": 27.014457969926298, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 44}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1568735232, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14574703880, "mlx_cache_bytes": 17422332206, "process_rss_bytes": 1568735232}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14574703880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29.0 MW", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "3814df75a30ad3b3635d26efd0eec378d2f2f25fdba62b26a4a611ba1bad31a9"} | ||||
| 1249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ee558f51886bb133f736562e", "attempt_id": "1be38c344a33", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:45.504490Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 48, "compress_ms": 128.11495794449002}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 48, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 190.13579201418906, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 135.3665420319885, "serialize_ms": 54.56820910330862, "load_ms": 2.4206250673159957, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.702625025995076, "ttft_ms": 27.702625025995076, "decode_ms": 15.513709047809243}, "total_wall_ms": 243.34020796231925, "ttft_ms": 27.702625025995076, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1568702464, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 17422332206, "process_rss_bytes": 1568702464}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd95276899afd6236488285c", "attempt_id": "2608d3d3b211", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:45.778662Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10822, "keep": 2706, "window_tokens": 50, "compress_ms": 130.77066699042916}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 50, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 310345728, "serialized_payload_bytes": 310358973, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 323.0097080813721, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 138.0546250147745, "serialize_ms": 184.75766596384346, "load_ms": 2.599415951408446, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.952459011226892, "ttft_ms": 26.952459011226892, "decode_ms": 15.51829103846103}, "total_wall_ms": 375.6191659485921, "ttft_ms": 26.952459011226892, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1568702464, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14582453504, "mlx_cache_bytes": 17474285870, "process_rss_bytes": 1568702464}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14582453504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fde9461332f3143dfe714aef08d44871139d2a110972655bc25e7bcce1f294f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8b42f618bdc2b5d4277ba2d", "attempt_id": "4157af2bb20a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:46.808456Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 43, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 14.236291055567563, "receiver_prefill_ms": 0.0, "query_prefill_ms": 46.61941702943295, "ttft_ms": 46.61941702943295, "decode_ms": 150.75170795898885}, "total_wall_ms": 221.01754101458937, "ttft_ms": 46.61941702943295, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 43}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 2117795840, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15486585472, "mlx_cache_bytes": 19002256494, "process_rss_bytes": 2117795840}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15486585472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "VJ-84A-2155", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "a1a7cdfb46b3d678be256814fe2c8f5bb5c6d220d4c63e46ac239a4c136fefb4"} | ||||
| 1252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6bea49c148ed696e1437d14e", "attempt_id": "82ce1216b217", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:47.064341Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 37, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 3.7799590500071645, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.72974999062717, "ttft_ms": 36.72974999062717, "decode_ms": 37.51304105389863}, "total_wall_ms": 86.95220795925707, "ttft_ms": 36.72974999062717, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2117795840, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15464298428, "mlx_cache_bytes": 19118882542, "process_rss_bytes": 2117795840}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15464298428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dde65833dc2ce4e06cc7ae55", "attempt_id": "89fffe2ad519", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:47.185984Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 37, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 3.844665945507586, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.3230420043692, "ttft_ms": 36.3230420043692, "decode_ms": 37.42566693108529}, "total_wall_ms": 86.99499990325421, "ttft_ms": 36.3230420043692, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2117812224, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15464298428, "mlx_cache_bytes": 19118882542, "process_rss_bytes": 2117812224}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15464298428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "732f895ee3a8d781a479e212", "attempt_id": "68b51b879b61", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:47.307973Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 52, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 4.242999944835901, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.099333993159235, "ttft_ms": 38.099333993159235, "decode_ms": 90.87349998299032}, "total_wall_ms": 140.80295898020267, "ttft_ms": 38.099333993159235, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2120056832, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15519782260, "mlx_cache_bytes": 19283828590, "process_rss_bytes": 2120056832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15519782260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,230,540", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "c3d6dd9f1f5f8a9f8de5f4fcf1619fd408783984404ffbda73a45fd686823ec6"} | ||||
| 1255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "34148314b3dc91e5af3c2d44", "attempt_id": "38f6518d0d7c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:47.481255Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 46, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 4.230708000250161, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.13779093232006, "ttft_ms": 37.13779093232006, "decode_ms": 91.29883395507932}, "total_wall_ms": 140.5198749853298, "ttft_ms": 37.13779093232006, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 46}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2120056832, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15497401716, "mlx_cache_bytes": 19427843950, "process_rss_bytes": 2120056832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15497401716, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,647,285", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "20463bb6e5dee768be8060fd148f5fa8abec5ef06fe7925e2b2417d974e95146"} | ||||
| 1256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "30e3f7f2302896a010c0a585", "attempt_id": "861eca96ab3b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:47.650934Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 53, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 4.086124943569303, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.956708925776184, "ttft_ms": 37.956708925776184, "decode_ms": 91.07237495481968}, "total_wall_ms": 140.48445806838572, "ttft_ms": 37.956708925776184, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2120056832, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15522092568, "mlx_cache_bytes": 19593887886, "process_rss_bytes": 2120056832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15522092568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Obyald-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "23c04d115364ebc2975e80d3e8413c0aa596b61e2617ae66ab36d7b585c37f67"} | ||||
| 1257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e90b9338cadc72d3ff980cc", "attempt_id": "0c05475019d6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:47.820999Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 48, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 4.08587499987334, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.15187497437, "ttft_ms": 37.15187497437, "decode_ms": 90.7987920800224}, "total_wall_ms": 139.4255410414189, "ttft_ms": 37.15187497437, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2120056832, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15504049856, "mlx_cache_bytes": 19744194702, "process_rss_bytes": 2120056832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15504049856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,975,675", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "26ee4023d532eac46576af3de103a6c23eddcb09bbf1b267c6a7a01081dbcd73"} | ||||
| 1258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f92d53264952413638b7f6c1", "attempt_id": "0c83ada30c1b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:47.989452Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 44, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 4.209042061120272, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.948332912288606, "ttft_ms": 36.948332912288606, "decode_ms": 54.70462504308671}, "total_wall_ms": 103.23141701519489, "ttft_ms": 36.948332912288606, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2120056832, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15489926848, "mlx_cache_bytes": 19882901646, "process_rss_bytes": 2120056832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15489926848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "29.0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "4918d4e05218ac860241eaa4933422bbcda72bd6dde1b937902e13ed2f433d9f"} | ||||
| 1259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1560dad18ce8eee9b5dd7ef9", "attempt_id": "f81ad8ea648e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:48.121793Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 48, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 4.148334031924605, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.95133305154741, "ttft_ms": 36.95133305154741, "decode_ms": 18.4248749865219}, "total_wall_ms": 67.40733305923641, "ttft_ms": 36.95133305154741, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2120056832, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15504049856, "mlx_cache_bytes": 19882901646, "process_rss_bytes": 2120056832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15504049856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce9b1d9f07fca531f6b83a26", "attempt_id": "2c279bc792d1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:48.218094Z", "task_family": "synthetic", "document_id": "syn_03008_16000", "document_hash": "3ac761a8c9f59f6fb8f9b51c412c8c71676bc87e27f316aad0b17b80dca09b94", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03008_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14521390088}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10762, "source_tokens_receiver": 10762, "query_tokens": 50, "message_tokens": 10822, "message_utf8_bytes": 58936, "cache_tensor_bytes": 659362816, "serialized_payload_bytes": 659390657, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 621.2832920718938, "doc_prefill_ms": 1491.6571250651032, "compress_ms": 353.0141660012305, "serialize_ms": 267.9739169543609, "load_ms": 4.06566692981869, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.48954203911126, "ttft_ms": 37.48954203911126, "decode_ms": 18.16208299715072}, "total_wall_ms": 67.52691697329283, "ttft_ms": 37.48954203911126, "input_usage": {"receiver_prefix_tokens": 10822, "dense_cache_bytes": 1241153536, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2120056832, "backend_memory": {"mlx_active_bytes": 15185662984, "mlx_peak_bytes": 15517075172, "mlx_cache_bytes": 20039499918, "process_rss_bytes": 2120056832}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15517075172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03008_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "671ed264e5a734fb75f50f7471df496d669c3b585be4355e442a59aaea6e384c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ee899783a7013bbf9d99c2f", "attempt_id": "38f42e95905f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:48.944771Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2062, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 3950.0651250127703, "ttft_ms": 26.897666044533253, "decode_ms": 134.4355830224231}, "total_wall_ms": 4115.303625003435, "ttft_ms": 26.897666044533253, "input_usage": {"receiver_prompt_tokens": 2062}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1492500480, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480293472, "mlx_cache_bytes": 2912113644, "process_rss_bytes": 1492500480}, "peak_prefill_memory": null, "peak_decode_memory": 13480293472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 1262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d8a7c0671be41c246a4fbe42", "attempt_id": "d04c768d9460", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:53.100660Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2052, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 228.53495797608048, "ttft_ms": 13.452165992930532, "decode_ms": 13.36908305529505}, "total_wall_ms": 258.1967500736937, "ttft_ms": 13.452165992930532, "input_usage": {"receiver_prompt_tokens": 2052}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1493729280, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480293472, "mlx_cache_bytes": 2928657900, "process_rss_bytes": 1493729280}, "peak_prefill_memory": null, "peak_decode_memory": 13480293472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ab56b1d17b1d9ff57fc942ca", "attempt_id": "495bc41c63e0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:53.375142Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2051, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 222.9284580098465, "ttft_ms": 13.726165983825922, "decode_ms": 13.833999983035028}, "total_wall_ms": 253.2447079429403, "ttft_ms": 13.726165983825922, "input_usage": {"receiver_prompt_tokens": 2051}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1493794816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480293472, "mlx_cache_bytes": 2932098540, "process_rss_bytes": 1493794816}, "peak_prefill_memory": null, "peak_decode_memory": 13480293472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "02ee7ba97a968fb6b1e4dbe1", "attempt_id": "ea999229a765", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:53.644916Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2069, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 232.73354198317975, "ttft_ms": 13.647333020344377, "decode_ms": 108.26300003100187}, "total_wall_ms": 357.4812919832766, "ttft_ms": 13.647333020344377, "input_usage": {"receiver_prompt_tokens": 2069}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1493794816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480297516, "mlx_cache_bytes": 2943747564, "process_rss_bytes": 1493794816}, "peak_prefill_memory": null, "peak_decode_memory": 13480297516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10047105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "bea99610d1e3e75a7f20939faf8e6824e02237b156dacd6442ba2a7e02617510"} | ||||
| 1265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c9e258381add56b678b6a628", "attempt_id": "0e6da8431102", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:54.018449Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2062, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 254.0326250018552, "ttft_ms": 13.573957956396043, "decode_ms": 122.77033308055252}, "total_wall_ms": 393.19687499664724, "ttft_ms": 13.573957956396043, "input_usage": {"receiver_prompt_tokens": 2062}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1493794816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480293472, "mlx_cache_bytes": 2943747564, "process_rss_bytes": 1493794816}, "peak_prefill_memory": null, "peak_decode_memory": 13480293472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,227,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "c3aa599fbb00899728f00a77f6ec2d981fcc6387f12136cbb65878e6772f4889"} | ||||
| 1266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2d5b7297a2fb8b10d498e88b", "attempt_id": "1d9f6fd50460", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:54.427626Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2071, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 250.98616594914347, "ttft_ms": 13.972458895295858, "decode_ms": 95.6641249358654}, "total_wall_ms": 363.39016596321017, "ttft_ms": 13.972458895295858, "input_usage": {"receiver_prompt_tokens": 2071}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1493794816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480297516, "mlx_cache_bytes": 2958788076, "process_rss_bytes": 1493794816}, "peak_prefill_memory": null, "peak_decode_memory": 13480297516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b58a2f2f2cfa658c61146854", "attempt_id": "3d34d3bae2e2", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:54.807729Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2062, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 249.05745906289667, "ttft_ms": 13.748375000432134, "decode_ms": 109.62408292107284}, "total_wall_ms": 375.30479102861136, "ttft_ms": 13.748375000432134, "input_usage": {"receiver_prompt_tokens": 2062}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1493794816, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480293472, "mlx_cache_bytes": 2958788076, "process_rss_bytes": 1493794816}, "peak_prefill_memory": null, "peak_decode_memory": 13480293472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "18764.19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "648d6d38c2ed15b2ecfbb0e3e756167cfed10efee3fc6cfe429c8f7d08c1fd9a"} | ||||
| 1268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f3484c95f86c7f4bf5357540", "attempt_id": "aa1ae68ca0fb", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:55.198908Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2060, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 257.1062910137698, "ttft_ms": 13.791249948553741, "decode_ms": 108.75625000335276}, "total_wall_ms": 382.4196249479428, "ttft_ms": 13.791249948553741, "input_usage": {"receiver_prompt_tokens": 2060}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1493975040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480293472, "mlx_cache_bytes": 2963949036, "process_rss_bytes": 1493975040}, "peak_prefill_memory": null, "peak_decode_memory": 13480293472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22200000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "729d74cdcdb8bf77db0d7fe49537d27949c072e0459abf930eb67c041526bbe1"} | ||||
| 1269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "57f291cfb425d089d5774719", "attempt_id": "d6b6ed870220", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:55.597941Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2064, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 260.12962497770786, "ttft_ms": 13.921499950811267, "decode_ms": 13.678541989065707}, "total_wall_ms": 290.64899997320026, "ttft_ms": 13.921499950811267, "input_usage": {"receiver_prompt_tokens": 2064}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1493991424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480297516, "mlx_cache_bytes": 2963949036, "process_rss_bytes": 1493991424}, "peak_prefill_memory": null, "peak_decode_memory": 13480297516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff8576fe3e8f700729c962f9", "attempt_id": "121ca1866c88", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:54:55.904987Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 2064, "message_tokens": 1976, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.012167030945420265, "decode_payload_ms": 0.0, "receiver_prefill_ms": 265.3197499457747, "ttft_ms": 13.606749940663576, "decode_ms": 13.673082925379276}, "total_wall_ms": 295.43941700831056, "ttft_ms": 13.606749940663576, "input_usage": {"receiver_prompt_tokens": 2064}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1493991424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13480297516, "mlx_cache_bytes": 2963949036, "process_rss_bytes": 1493991424}, "peak_prefill_memory": null, "peak_decode_memory": 13480297516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "824debc3734fb12ef586c3de", "attempt_id": "16f470affa83", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:03.435087Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.56662498507649, "ttft_ms": 13.563707936555147, "decode_ms": 13.405167032033205}, "total_wall_ms": 103.96741703152657, "ttft_ms": 13.563707936555147, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494204416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 3590374892, "process_rss_bytes": 1494204416}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c07b889d30ac91396dc7e610", "attempt_id": "baf6f3095324", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:03.555705Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.88366600126028, "ttft_ms": 13.61079199705273, "decode_ms": 13.432999956421554}, "total_wall_ms": 97.92949992697686, "ttft_ms": 13.61079199705273, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494204416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 3950560748, "process_rss_bytes": 1494204416}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "696696132a1b1eb772c0c825", "attempt_id": "cd28973a678a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:03.669721Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 592, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.42570791579783, "ttft_ms": 13.148084050044417, "decode_ms": 13.089874992147088}, "total_wall_ms": 96.68087493628263, "ttft_ms": 13.148084050044417, "input_usage": {"receiver_prompt_tokens": 592, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494204416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 3950560748, "process_rss_bytes": 1494204416}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b21fa4c82638a855f42b0e72", "attempt_id": "ab5f54f9654e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:03.783758Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.56291601900011, "ttft_ms": 13.367917039431632, "decode_ms": 106.35420901235193}, "total_wall_ms": 194.3210830213502, "ttft_ms": 13.367917039431632, "input_usage": {"receiver_prompt_tokens": 610, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1494204416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12999599192, "mlx_cache_bytes": 4327753196, "process_rss_bytes": 1494204416}, "peak_prefill_memory": null, "peak_decode_memory": 12999599192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10047105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "bea99610d1e3e75a7f20939faf8e6824e02237b156dacd6442ba2a7e02617510"} | ||||
| 1275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fd41008e8e47b867ae7d5bd2", "attempt_id": "59e14390be8e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:03.994949Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.45295799616724, "ttft_ms": 13.3563750423491, "decode_ms": 107.61004104278982}, "total_wall_ms": 192.42904102429748, "ttft_ms": 13.3563750423491, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1494204416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 4327753196, "process_rss_bytes": 1494204416}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10047105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "bea99610d1e3e75a7f20939faf8e6824e02237b156dacd6442ba2a7e02617510"} | ||||
| 1276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35ded10852372ed249374b3e", "attempt_id": "54b9c985e15a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:04.203622Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.12625006306916, "ttft_ms": 13.335124938748777, "decode_ms": 13.653874979354441}, "total_wall_ms": 101.13324993290007, "ttft_ms": 13.335124938748777, "input_usage": {"receiver_prompt_tokens": 612, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494220800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13000483928, "mlx_cache_bytes": 4579509740, "process_rss_bytes": 1494220800}, "peak_prefill_memory": null, "peak_decode_memory": 13000483928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26bfa159cc3e96ed5a6834e8", "attempt_id": "23f54987f707", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:04.321278Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.73954103887081, "ttft_ms": 13.509416952729225, "decode_ms": 92.87008293904364}, "total_wall_ms": 177.18629096634686, "ttft_ms": 13.509416952729225, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1494220800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 4579509740, "process_rss_bytes": 1494220800}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5781336", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "a365e04f74ba5baeccdd9e30dc27a1c5ff916597b828d874e63884b2090a60e2"} | ||||
| 1278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aacd2b18bd994a162f5fdd5f", "attempt_id": "7f47323a3ec5", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:04.514575Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.29220904223621, "ttft_ms": 13.297750032506883, "decode_ms": 13.38595908600837}, "total_wall_ms": 97.96375001315027, "ttft_ms": 13.297750032506883, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494220800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994028632, "mlx_cache_bytes": 4826645996, "process_rss_bytes": 1494220800}, "peak_prefill_memory": null, "peak_decode_memory": 12994028632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe8c1727cc5684b268a0c146", "attempt_id": "fc2df259a978", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:04.629017Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.35054208245128, "ttft_ms": 13.311458984389901, "decode_ms": 13.392208027653396}, "total_wall_ms": 98.0455829994753, "ttft_ms": 13.311458984389901, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494220800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995601496, "mlx_cache_bytes": 5075355116, "process_rss_bytes": 1494220800}, "peak_prefill_memory": null, "peak_decode_memory": 12995601496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6409c43b57fb2989cd9d9c41", "attempt_id": "b90d2b2e9fae", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:04.743534Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7218.310208059847, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.09295804891735, "ttft_ms": 13.363374979235232, "decode_ms": 13.794249971397221}, "total_wall_ms": 98.24191697407514, "ttft_ms": 13.363374979235232, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 2092, "sender_output_tokens": 512, "sender_prefill_ms": 270.42099996469915, "sender_ttft_ms": 13.76624999102205, "sender_decode_ms": 6932.571458048187}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494220800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995601496, "mlx_cache_bytes": 5075355116, "process_rss_bytes": 1494220800}, "peak_prefill_memory": null, "peak_decode_memory": 12995601496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "eb87332a9a94541de21ca1a884fb8ec680d0d390df5424592cac6071ef82bc67", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c27323a6e6fb4311cd325041", "attempt_id": "567020e862fc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.040302Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 336, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.64525005500764, "ttft_ms": 13.3203340228647, "decode_ms": 13.369624968618155}, "total_wall_ms": 75.51833393517882, "ttft_ms": 13.3203340228647, "input_usage": {"receiver_prompt_tokens": 336, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882975344, "mlx_cache_bytes": 5402314220, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12882975344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47454c6a995cf26f0e16ac30", "attempt_id": "413752c690fe", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.133115Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 326, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.388749964535236, "ttft_ms": 13.327749911695719, "decode_ms": 13.372874935157597}, "total_wall_ms": 74.00795898865908, "ttft_ms": 13.327749911695719, "input_usage": {"receiver_prompt_tokens": 326, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12875668080, "mlx_cache_bytes": 5657413100, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12875668080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d2c4d6ace72b5eeced446d41", "attempt_id": "effa9890d4f8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.223576Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 325, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 45.97104201093316, "ttft_ms": 13.038125005550683, "decode_ms": 14.003582997247577}, "total_wall_ms": 73.71066696941853, "ttft_ms": 13.038125005550683, "input_usage": {"receiver_prompt_tokens": 325, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12875405936, "mlx_cache_bytes": 5721114092, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12875405936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27677e5f7fdc4dec8a72124f", "attempt_id": "04864e380c2b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.313580Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 343, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.450666966848075, "ttft_ms": 13.508709031157196, "decode_ms": 13.464833027683198}, "total_wall_ms": 74.17412498034537, "ttft_ms": 13.508709031157196, "input_usage": {"receiver_prompt_tokens": 343, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12888545904, "mlx_cache_bytes": 6000526828, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12888545904, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "971d1a4c3c16651c30bbf7d1", "attempt_id": "2f23991ba6da", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.404079Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 336, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.00429197307676, "ttft_ms": 13.097041985020041, "decode_ms": 13.449541991576552}, "total_wall_ms": 73.29129194840789, "ttft_ms": 13.097041985020041, "input_usage": {"receiver_prompt_tokens": 336, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882975344, "mlx_cache_bytes": 6000526828, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12882975344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "473e5c4d521f9ad90282d3d9", "attempt_id": "a2cd74917823", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.494172Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 345, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.363916946575046, "ttft_ms": 13.099208939820528, "decode_ms": 93.05445803329349}, "total_wall_ms": 153.37487496435642, "ttft_ms": 13.099208939820528, "input_usage": {"receiver_prompt_tokens": 345, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12889725552, "mlx_cache_bytes": 6189532652, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12889725552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "285c49ff957316cac8520a59", "attempt_id": "4dae505249cc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.663775Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 336, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.32712504826486, "ttft_ms": 13.201416004449129, "decode_ms": 13.10887502040714}, "total_wall_ms": 73.38562502991408, "ttft_ms": 13.201416004449129, "input_usage": {"receiver_prompt_tokens": 336, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882975344, "mlx_cache_bytes": 6189532652, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12882975344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "be03c2c07340c99998f500bc", "attempt_id": "ff7b8f224a28", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.753144Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 334, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.54424998443574, "ttft_ms": 13.338415999896824, "decode_ms": 13.333874987438321}, "total_wall_ms": 73.94195895176381, "ttft_ms": 13.338415999896824, "input_usage": {"receiver_prompt_tokens": 334, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12881795696, "mlx_cache_bytes": 6372509164, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12881795696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7250c4d6ce3ca720539bb1be", "attempt_id": "2175460abc5d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.843284Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 338, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.37454205658287, "ttft_ms": 13.341624988242984, "decode_ms": 13.687375001609325}, "total_wall_ms": 74.15625010617077, "ttft_ms": 13.341624988242984, "input_usage": {"receiver_prompt_tokens": 338, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899670640, "mlx_cache_bytes": 6575687148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12899670640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4d1b56a6c662ef9a2e00781c", "attempt_id": "1bb2aeb37339", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:10.933357Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 338, "message_tokens": 234, "message_utf8_bytes": 698, "cache_tensor_bytes": null, "serialized_payload_bytes": 698, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5181.996167055331, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.12183291465044, "ttft_ms": 13.70887493249029, "decode_ms": 13.270499999634922}, "total_wall_ms": 73.8581249024719, "ttft_ms": 13.70887493249029, "input_usage": {"receiver_prompt_tokens": 338, "sender_input_tokens": 2120, "sender_output_tokens": 364, "sender_prefill_ms": 238.1597920320928, "sender_ttft_ms": 13.399999937973917, "sender_decode_ms": 4923.943375004455}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901522056, "mlx_cache_bytes": 6575687148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12901522056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 6, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b7aa2d9d5f9f3a06115e4e65c8ffaf4be2a07d6d067ceac89e49c6efeb6fdd5f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4906b533fe3b5b37f4f61ce0", "attempt_id": "fa2cb0813345", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:11.025345Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 595, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.96933405753225, "ttft_ms": 13.497042004019022, "decode_ms": 13.580666040070355}, "total_wall_ms": 98.06595800910145, "ttft_ms": 13.497042004019022, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 6922896876, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7c256e10f7c467b9e645b5d4", "attempt_id": "84da92eb61fc", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:11.140040Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 585, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.7180419228971, "ttft_ms": 13.232499943114817, "decode_ms": 13.394250068813562}, "total_wall_ms": 97.30758296791464, "ttft_ms": 13.232499943114817, "input_usage": {"receiver_prompt_tokens": 585}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12985984088, "mlx_cache_bytes": 7263815148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12985984088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b9147da02385f408c4705f1", "attempt_id": "e02cde35594e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:11.254091Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 584, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.5576659636572, "ttft_ms": 13.87562497984618, "decode_ms": 13.553624972701073}, "total_wall_ms": 97.9723340133205, "ttft_ms": 13.87562497984618, "input_usage": {"receiver_prompt_tokens": 584}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12985984088, "mlx_cache_bytes": 7263815148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12985984088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa41257979abe957233e0d99", "attempt_id": "3047407e723d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:11.368552Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 602, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.09591604582965, "ttft_ms": 13.433458050712943, "decode_ms": 107.1061659604311}, "total_wall_ms": 191.67383306194097, "ttft_ms": 13.433458050712943, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 7263815148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10047105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "bea99610d1e3e75a7f20939faf8e6824e02237b156dacd6442ba2a7e02617510"} | ||||
| 1295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f9894d4c6b5efc604814b9aa", "attempt_id": "09d8c4ec7e09", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:11.577073Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 595, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.85270802397281, "ttft_ms": 13.596415985375643, "decode_ms": 106.772540952079}, "total_wall_ms": 191.22420891653746, "ttft_ms": 13.596415985375643, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 7263815148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10047105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "bea99610d1e3e75a7f20939faf8e6824e02237b156dacd6442ba2a7e02617510"} | ||||
| 1296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e5e9d0029e70fd2583d05a8c", "attempt_id": "bd37d5297bf2", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:11.784973Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 604, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.37433399818838, "ttft_ms": 13.502791989594698, "decode_ms": 94.14645796641707}, "total_wall_ms": 179.00504195131361, "ttft_ms": 13.502791989594698, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995601496, "mlx_cache_bytes": 7263815148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12995601496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ab78184a5bf0f86d6a8af804", "attempt_id": "fbf41cdb1c0e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:11.980233Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 595, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.71008400432765, "ttft_ms": 13.385041966103017, "decode_ms": 94.33283389080316}, "total_wall_ms": 178.495500003919, "ttft_ms": 13.385041966103017, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 7263815148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1544499", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "82bc2390847d50ecd74e2f772e882f87b8dc67c1f13e108d90ba9b8f96cf1662"} | ||||
| 1298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4d1ad2a1fa7abfb221fe6cec", "attempt_id": "b7bca647936f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:12.174988Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 593, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.8112080572173, "ttft_ms": 13.580958009697497, "decode_ms": 94.38679204322398}, "total_wall_ms": 178.77233400940895, "ttft_ms": 13.580958009697497, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 7263815148, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8227110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "85d83b4a8c9cab866c8a91c79511279096225f73c7a6e4226d40a8b0a70020c7"} | ||||
| 1299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c2182b13b8f274b7f7aff349", "attempt_id": "0a59fd2b942d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:12.370503Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 597, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.57366596907377, "ttft_ms": 13.4274170268327, "decode_ms": 13.3262500166893}, "total_wall_ms": 97.31366590131074, "ttft_ms": 13.4274170268327, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993356888, "mlx_cache_bytes": 7509181932, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12993356888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1a7c6def81614b340f60f843", "attempt_id": "cd2d9b0f620d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:12.484061Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 597, "message_tokens": 508, "message_utf8_bytes": 1257, "cache_tensor_bytes": null, "serialized_payload_bytes": 1257, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.8106659408658743, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.49250004254282, "ttft_ms": 13.500957982614636, "decode_ms": 13.31337506417185}, "total_wall_ms": 97.23591699730605, "ttft_ms": 13.500957982614636, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1494810624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993356888, "mlx_cache_bytes": 7509181932, "process_rss_bytes": 1494810624}, "peak_prefill_memory": null, "peak_decode_memory": 12993356888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "aa23a9921a9fa0ab0ef59999920dca39f710ae6529ef15494d314338a0997d7e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d2ff42a6a0c043c7eb463fa9", "attempt_id": "0fcdbf158c90", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:12.827166Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.6341670416295528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.165916950441897, "ttft_ms": 19.165916950441897, "decode_ms": 133.1799590261653}, "total_wall_ms": 155.46116698533297, "ttft_ms": 19.165916950441897, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12759127292, "mlx_cache_bytes": 8253806373, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12759127292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 1302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "802e8eef49c4695ac01cf914", "attempt_id": "960c7cfffddf", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:12.998934Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.1708749225363135, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.42454099096358, "ttft_ms": 18.42454099096358, "decode_ms": 13.266874942928553}, "total_wall_ms": 34.29670899640769, "ttft_ms": 18.42454099096358, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12712694792, "mlx_peak_bytes": 12752671996, "mlx_cache_bytes": 8288032549, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12752671996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f45816fb655a49e088e69854", "attempt_id": "772a1fd72d11", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.049241Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.1498749954625964, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.183500040322542, "ttft_ms": 18.183500040322542, "decode_ms": 13.11562501359731}, "total_wall_ms": 33.900290960446, "ttft_ms": 18.183500040322542, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12712694792, "mlx_peak_bytes": 12749214972, "mlx_cache_bytes": 8303548197, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12749214972, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a056c9ea089f308d239ab5a4", "attempt_id": "7637d4d13a7b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.099412Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 54, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 0.99612504709512, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.782875034958124, "ttft_ms": 18.782875034958124, "decode_ms": 94.68300000298768}, "total_wall_ms": 115.91891699936241, "ttft_ms": 18.782875034958124, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12766057752, "mlx_cache_bytes": 8338020565, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12766057752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4500000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "415e90d9e30d50997751b49a2fbe5e9e418ddd3c9195d04376076ce5af2d35aa"} | ||||
| 1305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9f8489f1232ca62e3f2f6f02", "attempt_id": "9b3279b5d598", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.231413Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.4945829752832651, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.495791009627283, "ttft_ms": 18.495791009627283, "decode_ms": 80.3257500519976}, "total_wall_ms": 101.76320897880942, "ttft_ms": 18.495791009627283, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12758832380, "mlx_cache_bytes": 8338020565, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12758832380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "350000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "95b088a8f8966bd6ec5e2742936f8ecf24ad5416474986fa5a2af6496979c299"} | ||||
| 1306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "befb47a795765ac61e248ea6", "attempt_id": "cf34258bca10", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.350123Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 56, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.4289590762928128, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.45058298204094, "ttft_ms": 18.45058298204094, "decode_ms": 92.71562506910414}, "total_wall_ms": 114.05016691423953, "ttft_ms": 18.45058298204094, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 56}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12766713120, "mlx_cache_bytes": 8355043989, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12766713120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0bef18ef82e6bedd4c46112a", "attempt_id": "4dabf97f1a71", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.480560Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.4219169970601797, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.440832966007292, "ttft_ms": 18.440832966007292, "decode_ms": 53.31554205622524}, "total_wall_ms": 74.63225000537932, "ttft_ms": 18.440832966007292, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12758832380, "mlx_cache_bytes": 8355043989, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12758832380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1209", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "fd68fcf88c30b4df82ec214bb6b559ede1a5d47f3b1f751524177b998bb6bbdd"} | ||||
| 1308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "19f1cdf6a35fec0af32373c0", "attempt_id": "e50f8f5f2b14", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.571408Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 45, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.3624170096591115, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.74345901887864, "ttft_ms": 18.74345901887864, "decode_ms": 67.05800001509488}, "total_wall_ms": 88.61533307936043, "ttft_ms": 18.74345901887864, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12712989704, "mlx_peak_bytes": 12757439740, "mlx_cache_bytes": 8387011198, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12757439740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "5994471abb01112afcc18159f6cc74b4f511b99806da59b3caf5a9c173cacfc5"} | ||||
| 1309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b92282887baa2b4251cc424a", "attempt_id": "52c02739823b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.676393Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 49, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 0.7850420661270618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.672083970159292, "ttft_ms": 18.672083970159292, "decode_ms": 13.473875005729496}, "total_wall_ms": 34.34041701257229, "ttft_ms": 18.672083970159292, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12762895640, "mlx_cache_bytes": 8426398334, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12762895640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bdf4171302410250a53730a4", "attempt_id": "4ff976ef1ed8", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.726683Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 2015, "keep": 504, "compress_ms": 7.607958046719432}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 49, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595373, "side_information_bytes": 15917, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 229.18279201257974, "doc_prefill_ms": 209.2446250608191, "compress_ms": 7.642791955731809, "serialize_ms": 9.259749902412295, "load_ms": 1.4124170411378145, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.674249993637204, "ttft_ms": 18.674249993637204, "decode_ms": 13.399665942415595}, "total_wall_ms": 34.96479196473956, "ttft_ms": 18.674249993637204, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1532346368, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12763714840, "mlx_cache_bytes": 8426398334, "process_rss_bytes": 1532346368}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12763714840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f6c21b265f2995a16b114b174c540b45fd0b82d4c7f6bae3cec2a7e17340f3ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c164be3efbdcede2303bcd09", "attempt_id": "e5d116229bb9", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.777819Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 47, "compress_ms": 46.20874999091029}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.08158295135945, "doc_prefill_ms": 209.2446250608191, "compress_ms": 47.59812506381422, "serialize_ms": 4.267416894435883, "load_ms": 1.2767090229317546, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.36662506684661, "ttft_ms": 18.36662506684661, "decode_ms": 79.63674992788583}, "total_wall_ms": 152.9090830590576, "ttft_ms": 18.36662506684661, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1533296640, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12758832380, "mlx_cache_bytes": 8530109190, "process_rss_bytes": 1533296640}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12758832380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-5813", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "98a7f796e41a4550e1e7fa3bd51dfe7ff0da4f784ad1716e9eff133a6349a9e7"} | ||||
| 1312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "10a07f328aa7856f7bb8697d", "attempt_id": "17fcd0b15f2b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:13.946214Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 37, "compress_ms": 41.19516699574888}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.98512493632734, "doc_prefill_ms": 209.2446250608191, "compress_ms": 42.58587502408773, "serialize_ms": 4.194125067442656, "load_ms": 1.2054999824613333, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.06812488939613, "ttft_ms": 18.06812488939613, "decode_ms": 13.41216592118144}, "total_wall_ms": 81.15166600327939, "ttft_ms": 18.06812488939613, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1552171008, "backend_memory": {"mlx_active_bytes": 12712694792, "mlx_peak_bytes": 12750132476, "mlx_cache_bytes": 8552260358, "process_rss_bytes": 1552171008}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12750132476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8b5e41ee217690fdcb9f7306", "attempt_id": "2d898b05691e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:14.044112Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 36, "compress_ms": 41.92175006028265}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.31125000398606, "doc_prefill_ms": 209.2446250608191, "compress_ms": 43.42604102566838, "serialize_ms": 3.6496249958872795, "load_ms": 1.247915904968977, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.022750038653612, "ttft_ms": 18.022750038653612, "decode_ms": 13.245792011730373}, "total_wall_ms": 81.31270797457546, "ttft_ms": 18.022750038653612, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1552203776, "backend_memory": {"mlx_active_bytes": 12712694792, "mlx_peak_bytes": 12749100284, "mlx_cache_bytes": 8560272134, "process_rss_bytes": 1552203776}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12749100284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6135f7f30f815ed54b533d2d", "attempt_id": "eb53636bfa77", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:14.141822Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 54, "compress_ms": 42.85237507428974}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 54, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.31854102667421, "doc_prefill_ms": 209.2446250608191, "compress_ms": 44.2320000147447, "serialize_ms": 3.8798749446868896, "load_ms": 1.1320420308038592, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.440915970131755, "ttft_ms": 18.440915970131755, "decode_ms": 106.9611250422895}, "total_wall_ms": 176.35995789896697, "ttft_ms": 18.440915970131755, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 54}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1552220160, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12765222168, "mlx_cache_bytes": 8583176966, "process_rss_bytes": 1552220160}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12765222168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10020000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "6223ae8c02b777db83fb18445c4d0bbdce3f01d96edac71ec225a2cb4bd782a3"} | ||||
| 1315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d921a4a2b560de60c61c564d", "attempt_id": "4168a04d628c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:14.334914Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 47, "compress_ms": 41.474082972854376}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595414, "side_information_bytes": 15958, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.906291908584535, "doc_prefill_ms": 209.2446250608191, "compress_ms": 42.84758307039738, "serialize_ms": 9.843667037785053, "load_ms": 1.200541970320046, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.39758292771876, "ttft_ms": 18.39758292771876, "decode_ms": 106.14470799919218}, "total_wall_ms": 180.21858297288418, "ttft_ms": 18.39758292771876, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1552220160, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12758832380, "mlx_cache_bytes": 8583176966, "process_rss_bytes": 1552220160}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12758832380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10048115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "07ecc454d9a92029fb4ef051af33aa1246aa3956edfe90872219d1c6ea2f5c01", "output_hash": "6e8b85915bc0af581576710670746df4a48c239416cc027d5dcf4b73e85996ce"} | ||||
| 1316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a3ac6c167eaf996bc317523", "attempt_id": "86a1e02cf511", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:14.532893Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 56, "compress_ms": 41.28137498628348}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 56, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.64816602598876, "doc_prefill_ms": 209.2446250608191, "compress_ms": 42.64025005977601, "serialize_ms": 3.788959002122283, "load_ms": 1.000500051304698, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.29962502233684, "ttft_ms": 18.29962502233684, "decode_ms": 94.05879199039191}, "total_wall_ms": 161.5578751079738, "ttft_ms": 18.29962502233684, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 56}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1552220160, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12766516512, "mlx_cache_bytes": 8590861062, "process_rss_bytes": 1552220160}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12766516512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fc5a4fa43a4e66b6b99908ae", "attempt_id": "9435bda32666", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:14.711561Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 47, "compress_ms": 41.93937499076128}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.83654189668596, "doc_prefill_ms": 209.2446250608191, "compress_ms": 43.329334002919495, "serialize_ms": 4.2802500538527966, "load_ms": 1.276666997000575, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.402084009721875, "ttft_ms": 18.402084009721875, "decode_ms": 106.4046670217067}, "total_wall_ms": 175.44200003612787, "ttft_ms": 18.402084009721875, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1552220160, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12758832380, "mlx_cache_bytes": 8590861062, "process_rss_bytes": 1552220160}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12758832380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15034435", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "ae0dcafc8774dba374ff530ac82ab597a65022cfbe446b55a6b4b62aec68619e"} | ||||
| 1318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4791f69bd49404f4218482a3", "attempt_id": "0dba09b98ddc", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:14.903473Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 45, "compress_ms": 42.03045798931271}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 45, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.376916045323014, "doc_prefill_ms": 209.2446250608191, "compress_ms": 43.45541598740965, "serialize_ms": 3.7183749955147505, "load_ms": 1.2253329623490572, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.318166956305504, "ttft_ms": 18.318166956305504, "decode_ms": 106.71158402692527}, "total_wall_ms": 175.1585000893101, "ttft_ms": 18.318166956305504, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 45}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1552220160, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12757439740, "mlx_cache_bytes": 8596677382, "process_rss_bytes": 1552220160}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12757439740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22200000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "729d74cdcdb8bf77db0d7fe49537d27949c072e0459abf930eb67c041526bbe1"} | ||||
| 1319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fcb2cb9305fae011ef38db44", "attempt_id": "fd362c46adaa", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.095451Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 49, "compress_ms": 42.58454102091491}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 49, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.15124999731779, "doc_prefill_ms": 209.2446250608191, "compress_ms": 43.972792103886604, "serialize_ms": 3.9726250106468797, "load_ms": 1.265249913558364, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.297458067536354, "ttft_ms": 18.297458067536354, "decode_ms": 13.488291064277291}, "total_wall_ms": 82.73487503174692, "ttft_ms": 18.297458067536354, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1552220160, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12763141400, "mlx_cache_bytes": 8604902150, "process_rss_bytes": 1552220160}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12763141400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "84dc679d52a2431c32d92161", "attempt_id": "d00c06270b1e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.194890Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 2015, "keep": 504, "window_tokens": 49, "compress_ms": 41.96662502363324}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 49, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 18579456, "serialized_payload_bytes": 18595413, "side_information_bytes": 15957, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.820374951697886, "doc_prefill_ms": 209.2446250608191, "compress_ms": 43.34099998231977, "serialize_ms": 4.283915972337127, "load_ms": 1.246499945409596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.391332938335836, "ttft_ms": 18.391332938335836, "decode_ms": 13.288167072460055}, "total_wall_ms": 82.28133397642523, "ttft_ms": 18.391332938335836, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1552220160, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12763141400, "mlx_cache_bytes": 8604902150, "process_rss_bytes": 1552220160}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12763141400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "60994b8def58be15e588272d06abaf79e6234a7492e199446cfac14922c3b9c0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "237888dc878ebdebf3a83583", "attempt_id": "30c2922c8ce3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.312299Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 2.473082975484431, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.438458003103733, "ttft_ms": 21.438458003103733, "decode_ms": 145.1154169626534}, "total_wall_ms": 170.465583098121, "ttft_ms": 21.438458003103733, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1631043584, "backend_memory": {"mlx_active_bytes": 12756767256, "mlx_peak_bytes": 12830295224, "mlx_cache_bytes": 8718871062, "process_rss_bytes": 1631043584}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12830295224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 1322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b9e03da37d78d8a9483cce3", "attempt_id": "5183d4f407ea", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.499466Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 37, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 1.6394170233979821, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.73783311061561, "ttft_ms": 20.73783311061561, "decode_ms": 14.814832946285605}, "total_wall_ms": 38.62570901401341, "ttft_ms": 20.73783311061561, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1631141888, "backend_memory": {"mlx_active_bytes": 12756816408, "mlx_peak_bytes": 12816697592, "mlx_cache_bytes": 8718821910, "process_rss_bytes": 1631141888}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12816697592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "59d271dabab552dc64e27d1a", "attempt_id": "78d0000ff69f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.554508Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 36, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 1.970082987099886, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.738666993565857, "ttft_ms": 20.738666993565857, "decode_ms": 14.522875077091157}, "total_wall_ms": 38.74350001569837, "ttft_ms": 20.738666993565857, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1631141888, "backend_memory": {"mlx_active_bytes": 12756816408, "mlx_peak_bytes": 12834704528, "mlx_cache_bytes": 8718821910, "process_rss_bytes": 1631141888}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12834704528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4441e263a8d8693d9bc1a142", "attempt_id": "04e7a5372f05", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.609677Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 54, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 1.9634170457720757, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.08224993571639, "ttft_ms": 21.08224993571639, "decode_ms": 116.16824998054653}, "total_wall_ms": 140.65262500662357, "ttft_ms": 21.08224993571639, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 54}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1631141888, "backend_memory": {"mlx_active_bytes": 12756750872, "mlx_peak_bytes": 12840059364, "mlx_cache_bytes": 8751381622, "process_rss_bytes": 1631141888}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12840059364, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10047105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "bea99610d1e3e75a7f20939faf8e6824e02237b156dacd6442ba2a7e02617510"} | ||||
| 1325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2db4bcab9c84a580b05321cd", "attempt_id": "04fe1f1702c8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.766289Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 1.8225000239908695, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.359332953579724, "ttft_ms": 21.359332953579724, "decode_ms": 131.0272499686107}, "total_wall_ms": 155.78970802016556, "ttft_ms": 21.359332953579724, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1631141888, "backend_memory": {"mlx_active_bytes": 12756767256, "mlx_peak_bytes": 12830049112, "mlx_cache_bytes": 8751365238, "process_rss_bytes": 1631141888}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12830049112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,227,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "c3aa599fbb00899728f00a77f6ec2d981fcc6387f12136cbb65878e6772f4889"} | ||||
| 1326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e5214452cf396e2a147c6b78", "attempt_id": "6d6c10d264bb", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:15.939280Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 56, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 1.9507498946040869, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.128583000972867, "ttft_ms": 21.128583000972867, "decode_ms": 102.39829192869365}, "total_wall_ms": 126.94508396089077, "ttft_ms": 21.128583000972867, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 56}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1631141888, "backend_memory": {"mlx_active_bytes": 12756750872, "mlx_peak_bytes": 12842274772, "mlx_cache_bytes": 8785077238, "process_rss_bytes": 1631141888}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12842274772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "05252ba1080ecfac538c9721", "attempt_id": "0bce25e5e248", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:16.083048Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 47, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 1.9478340400382876, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.871334010735154, "ttft_ms": 20.871334010735154, "decode_ms": 101.64708294905722}, "total_wall_ms": 125.92783395666629, "ttft_ms": 20.871334010735154, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1631141888, "backend_memory": {"mlx_active_bytes": 12756750872, "mlx_peak_bytes": 12830049112, "mlx_cache_bytes": 8785077238, "process_rss_bytes": 1631141888}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12830049112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1873485", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "079ca9e5109f90efe90d10f5dc4b65165632bb0c50fc8e3fcaae6c779b2f2a34"} | ||||
| 1328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1ea4cdb38d09b7bb1f7e9f95", "attempt_id": "d44b55dc9691", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:16.225865Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 45, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 2.16683407779783, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.297208033502102, "ttft_ms": 21.297208033502102, "decode_ms": 115.92608294449747}, "total_wall_ms": 140.8316669985652, "ttft_ms": 21.297208033502102, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 45}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1631158272, "backend_memory": {"mlx_active_bytes": 12756750872, "mlx_peak_bytes": 12827738968, "mlx_cache_bytes": 8811914230, "process_rss_bytes": 1631158272}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12827738968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22200000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "729d74cdcdb8bf77db0d7fe49537d27949c072e0459abf930eb67c041526bbe1"} | ||||
| 1329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c4c66f562cad7cef6726d2f1", "attempt_id": "8fac4e38c185", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:16.383366Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 49, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 2.073290990665555, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.95237502362579, "ttft_ms": 20.95237502362579, "decode_ms": 14.405875001102686}, "total_wall_ms": 38.84595795534551, "ttft_ms": 20.95237502362579, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1631174656, "backend_memory": {"mlx_active_bytes": 12756816408, "mlx_peak_bytes": 12836676292, "mlx_cache_bytes": 8841044982, "process_rss_bytes": 1631174656}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12836676292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ddbdc999b9368c0756d32bb2", "attempt_id": "37e6a24f03a8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:16.438881Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12712956440}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1976, "source_tokens_receiver": 1976, "query_tokens": 49, "message_tokens": 2015, "message_utf8_bytes": 7378, "cache_tensor_bytes": 39461760, "serialized_payload_bytes": 39495950, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.607874982990324, "doc_prefill_ms": 209.2446250608191, "compress_ms": 9.51441703364253, "serialize_ms": 8.747917017899454, "load_ms": 1.9362090388312936, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.787416957318783, "ttft_ms": 20.787416957318783, "decode_ms": 14.766792068257928}, "total_wall_ms": 38.92562503460795, "ttft_ms": 20.787416957318783, "input_usage": {"receiver_prefix_tokens": 2015, "dense_cache_bytes": 74280960, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1631174656, "backend_memory": {"mlx_active_bytes": 12756816408, "mlx_peak_bytes": 12836938436, "mlx_cache_bytes": 8841044982, "process_rss_bytes": 1631174656}, "peak_prefill_memory": 13475886144, "peak_decode_memory": 12836938436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8bb2b93f9cff9490a390b317088569a907f1d901cd51603633ec34c79a5c6f57", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "00d5cd38c3b88a6a79a0c04c", "attempt_id": "914f8ac48c7b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:16.544270Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1876, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.71654204186052, "ttft_ms": 14.274209039285779, "decode_ms": 97.8688329923898}, "total_wall_ms": 327.326082973741, "ttft_ms": 14.274209039285779, "input_usage": {"receiver_prompt_tokens": 1876}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 933756928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13296611712, "mlx_cache_bytes": 826838196, "process_rss_bytes": 933756928}, "peak_prefill_memory": null, "peak_decode_memory": 13296611712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 1332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3daea048622e7cc4f13af225", "attempt_id": "4d267fb4c911", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:16.904135Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1868, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 201.10175001900643, "ttft_ms": 14.340833062306046, "decode_ms": 13.963499921374023}, "total_wall_ms": 231.95937497075647, "ttft_ms": 14.340833062306046, "input_usage": {"receiver_prompt_tokens": 1868}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 933756928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13294743936, "mlx_cache_bytes": 1263045812, "process_rss_bytes": 933756928}, "peak_prefill_memory": null, "peak_decode_memory": 13294743936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "61b5f261cd320c920d27c394", "attempt_id": "746796bcf6b9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:17.151608Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1867, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 236.4357499172911, "ttft_ms": 14.880125061608851, "decode_ms": 28.74075004365295}, "total_wall_ms": 282.59620897006243, "ttft_ms": 14.880125061608851, "input_usage": {"receiver_prompt_tokens": 1867}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 933756928, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13332214156, "mlx_cache_bytes": 1320389812, "process_rss_bytes": 933756928}, "peak_prefill_memory": null, "peak_decode_memory": 13332214156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47cfd9f04436d6b3f9e9842c", "attempt_id": "2b3759f0ad91", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:17.450343Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1884, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 249.86333400011063, "ttft_ms": 14.784125029109418, "decode_ms": 70.66299999132752}, "total_wall_ms": 340.6852080952376, "ttft_ms": 14.784125029109418, "input_usage": {"receiver_prompt_tokens": 1884}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 933773312, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13298626976, "mlx_cache_bytes": 1795140128, "process_rss_bytes": 933773312}, "peak_prefill_memory": null, "peak_decode_memory": 13298626976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,047,105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "45ed933586262d1470caf31c89c80a05759b79bd4e620737608286d4591bcde5"} | ||||
| 1335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f54a20070b3bf2d771bc5594", "attempt_id": "88d4c6b071c9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:17.806726Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1877, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 243.95074998028576, "ttft_ms": 15.033458010293543, "decode_ms": 71.94462500046939}, "total_wall_ms": 333.4902919596061, "ttft_ms": 15.033458010293543, "input_usage": {"receiver_prompt_tokens": 1877}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 933773312, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13296710048, "mlx_cache_bytes": 1979558432, "process_rss_bytes": 933773312}, "peak_prefill_memory": null, "peak_decode_memory": 13296710048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,227,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "c3aa599fbb00899728f00a77f6ec2d981fcc6387f12136cbb65878e6772f4889"} | ||||
| 1336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a45f8b492d5a38be199ad0c3", "attempt_id": "9532adf21708", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:18.156240Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1885, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 235.98591692280024, "ttft_ms": 14.581166906282306, "decode_ms": 84.59487499203533}, "total_wall_ms": 337.6841670833528, "ttft_ms": 14.581166906282306, "input_usage": {"receiver_prompt_tokens": 1885}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 933789696, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13298725284, "mlx_cache_bytes": 2164770704, "process_rss_bytes": 933789696}, "peak_prefill_memory": null, "peak_decode_memory": 13298725284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9b4ac8681149cde95beb4bde", "attempt_id": "0a34fe6ecedc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:18.509855Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1878, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 226.06316697783768, "ttft_ms": 14.563750009983778, "decode_ms": 560.9465000452474}, "total_wall_ms": 809.1695419279858, "ttft_ms": 14.563750009983778, "input_usage": {"receiver_prompt_tokens": 1878}, "output_usage": {"output_tokens": 40}, "provider_cached_usage": null, "process_memory": 933838848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13296808352, "mlx_cache_bytes": 2349287312, "process_rss_bytes": 933838848}, "peak_prefill_memory": null, "peak_decode_memory": 13296808352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,247,196 + 5,134,740 + 4,932,140 + 8,497,835 + 8,227,110 = 32,114,321", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "c3a3aeabd940a44a66f47687b96713183fc261d8046369c0885aa0c36fe5a75d"} | ||||
| 1338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e30362ee25ab94124739c548", "attempt_id": "2ebf81a2502a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:19.334803Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1875, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 200.42716700118035, "ttft_ms": 14.228582964278758, "decode_ms": 43.271667091175914}, "total_wall_ms": 260.49945899285376, "ttft_ms": 14.228582964278758, "input_usage": {"receiver_prompt_tokens": 1875}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 933838848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13334278540, "mlx_cache_bytes": 2406877072, "process_rss_bytes": 933838848}, "peak_prefill_memory": null, "peak_decode_memory": 13334278540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "32e91c1240d5f0df215a3d318b26dfb6755680982d5f6722a6aed0dae644c0b3"} | ||||
| 1339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "61de2eca89cdec6955e3849a", "attempt_id": "9cf447e35eed", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:19.611612Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1879, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 213.00666697788984, "ttft_ms": 14.48612508829683, "decode_ms": 14.169165981002152}, "total_wall_ms": 244.221540982835, "ttft_ms": 14.48612508829683, "input_usage": {"receiver_prompt_tokens": 1879}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 933838848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13297267104, "mlx_cache_bytes": 2845607824, "process_rss_bytes": 933838848}, "peak_prefill_memory": null, "peak_decode_memory": 13297267104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dde3f4b830ddca8e8dba0595", "attempt_id": "f5f58e87aa6b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:19.871434Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 1880, "message_tokens": 1770, "message_utf8_bytes": 7378, "cache_tensor_bytes": null, "serialized_payload_bytes": 7378, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 227.3132500704378, "ttft_ms": 14.501583995297551, "decode_ms": 14.33058304246515}, "total_wall_ms": 258.6915000574663, "ttft_ms": 14.501583995297551, "input_usage": {"receiver_prompt_tokens": 1880}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 933838848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13297365408, "mlx_cache_bytes": 3030321040, "process_rss_bytes": 933838848}, "peak_prefill_memory": null, "peak_decode_memory": 13297365408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b35a89b35fe8b276f1c30038", "attempt_id": "0adf4d142929", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:27.567455Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.93720806855708, "ttft_ms": 14.740749960765243, "decode_ms": 13.841292005963624}, "total_wall_ms": 107.26924997288734, "ttft_ms": 14.740749960765243, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 4526176000, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c1872504a89ffeccef21bc0", "attempt_id": "7aa45f6e288d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:27.691081Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.86654198914766, "ttft_ms": 14.059999957680702, "decode_ms": 13.451833976432681}, "total_wall_ms": 105.64620792865753, "ttft_ms": 14.059999957680702, "input_usage": {"receiver_prompt_tokens": 614, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198284, "mlx_cache_bytes": 4869093120, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13038198284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ee6c759736c0ef4d209c8460", "attempt_id": "ea603775ed51", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:27.814545Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.2749999994412, "ttft_ms": 13.897666009142995, "decode_ms": 13.967458042316139}, "total_wall_ms": 105.30133300926536, "ttft_ms": 13.897666009142995, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198284, "mlx_cache_bytes": 4869093120, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13038198284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2120db5373ad71ae4959304b", "attempt_id": "40c931d0380b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:27.936139Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 630, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.44674989953637, "ttft_ms": 13.735916931182146, "decode_ms": 68.71887505985796}, "total_wall_ms": 161.07999999076128, "ttft_ms": 13.735916931182146, "input_usage": {"receiver_prompt_tokens": 630, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047176748, "mlx_cache_bytes": 5209456852, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13047176748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,354,593", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "63548f9c9ae92e741e1e3014ec10c0b361eefca04e1f3e8c1c0bf01e7198b621"} | ||||
| 1345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4b4705b439348cee5123f2d3", "attempt_id": "b35a1a2f5d8f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:28.113169Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 623, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.73820899799466, "ttft_ms": 13.769665965810418, "decode_ms": 13.549750088714063}, "total_wall_ms": 105.18274991773069, "ttft_ms": 13.769665965810418, "input_usage": {"receiver_prompt_tokens": 623, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13051223596, "mlx_cache_bytes": 5473599700, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13051223596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28186ef655ba241654e06f31", "attempt_id": "3ec7b20c7fda", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:28.234258Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.7449170127511, "ttft_ms": 13.734083971939981, "decode_ms": 81.7911250051111}, "total_wall_ms": 174.43095904309303, "ttft_ms": 13.734083971939981, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13055958576, "mlx_cache_bytes": 5741136556, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13055958576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ad57cc1c14f1816f7e8a3f14", "attempt_id": "3086af6a2589", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:28.424489Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.44991697836667, "ttft_ms": 13.702832977287471, "decode_ms": 68.19575000554323}, "total_wall_ms": 160.50524997990578, "ttft_ms": 13.702832977287471, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13055450668, "mlx_cache_bytes": 5924965036, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13055450668, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,247,196", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "40e869c2b62e27bc00d9598728026ccfc12fd1b97b0864921ab5373cfc6a82f7"} | ||||
| 1348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c544ee124cf3efaa8c07c5a4", "attempt_id": "18708954f219", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:28.600669Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.83249993715435, "ttft_ms": 13.4650421096012, "decode_ms": 13.943666941486299}, "total_wall_ms": 105.2577500231564, "ttft_ms": 13.4650421096012, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 5924965036, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ccfa7f94e59c64b5b611494", "attempt_id": "79bb7ea12a20", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:28.721693Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.9617500482127, "ttft_ms": 13.83579196408391, "decode_ms": 13.449834077619016}, "total_wall_ms": 105.30866705812514, "ttft_ms": 13.83579196408391, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13044080172, "mlx_cache_bytes": 6047648428, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13044080172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8ae6470e1e049788e8f94293", "attempt_id": "0a6699089a1f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:28.842533Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 2102, "cache_tensor_bytes": null, "serialized_payload_bytes": 2102, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7421.2624579668045, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.60412502102554, "ttft_ms": 13.507207971997559, "decode_ms": 13.547207927331328}, "total_wall_ms": 105.76608392875642, "ttft_ms": 13.507207971997559, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 1904, "sender_output_tokens": 512, "sender_prefill_ms": 241.72287492547184, "sender_ttft_ms": 14.490875066258013, "sender_decode_ms": 7161.342666018754}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934182912, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13084565036, "mlx_cache_bytes": 6235916972, "process_rss_bytes": 934182912}, "peak_prefill_memory": null, "peak_decode_memory": 13084565036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e3d0e4a58afca6b791eebc35c3492b33041d694d0d686e769f16edc7d4893dc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3bee47c99d06befd3da8ab6f", "attempt_id": "c3bd228674e3", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:36.356871Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 395, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.62695804797113, "ttft_ms": 13.35545803885907, "decode_ms": 13.54120799805969}, "total_wall_ms": 83.65912502631545, "ttft_ms": 13.35545803885907, "input_usage": {"receiver_prompt_tokens": 395, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882762840, "mlx_cache_bytes": 6958164192, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12882762840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6cdc127a6ad4616791a1ae95", "attempt_id": "3ef44e356599", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:36.457466Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 387, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.40254202019423, "ttft_ms": 13.558874954469502, "decode_ms": 13.522833003662527}, "total_wall_ms": 81.26795792486519, "ttft_ms": 13.558874954469502, "input_usage": {"receiver_prompt_tokens": 387, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12878421080, "mlx_cache_bytes": 7174154464, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12878421080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1d20d5174821128a69a17a9d", "attempt_id": "9d2e2b8a2dcc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:36.555025Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 386, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.32433304283768, "ttft_ms": 13.807125040329993, "decode_ms": 27.121250052005053}, "total_wall_ms": 95.02408292610198, "ttft_ms": 13.807125040329993, "input_usage": {"receiver_prompt_tokens": 386, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12878421080, "mlx_cache_bytes": 7174154464, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12878421080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "97c0bdb9f263d049d611ebfa", "attempt_id": "447eaa789480", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:36.666150Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 403, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.18804201669991, "ttft_ms": 13.545791967771947, "decode_ms": 13.583290972746909}, "total_wall_ms": 81.10816602129489, "ttft_ms": 13.545791967771947, "input_usage": {"receiver_prompt_tokens": 403, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887399512, "mlx_cache_bytes": 7414130912, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12887399512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5da31fbeae18d7b4a7449f55", "attempt_id": "ab3f82c2fed4", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:36.763706Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 396, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.86874999385327, "ttft_ms": 13.395541929639876, "decode_ms": 13.77283304464072}, "total_wall_ms": 81.8529580719769, "ttft_ms": 13.395541929639876, "input_usage": {"receiver_prompt_tokens": 396, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12883844184, "mlx_cache_bytes": 7635691744, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12883844184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e6607304a7f995ee8278a69", "attempt_id": "eba304952c2f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:36.861339Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 404, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.93075006920844, "ttft_ms": 13.558208011090755, "decode_ms": 13.597583048976958}, "total_wall_ms": 80.87995799724013, "ttft_ms": 13.558208011090755, "input_usage": {"receiver_prompt_tokens": 404, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12888480856, "mlx_cache_bytes": 7861725408, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12888480856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b50c35311ead22e25f6c6686", "attempt_id": "c65f9f91cb82", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:36.958063Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 397, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.34037495777011, "ttft_ms": 13.407958904281259, "decode_ms": 67.68862495664507}, "total_wall_ms": 135.26629202533513, "ttft_ms": 13.407958904281259, "input_usage": {"receiver_prompt_tokens": 397, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12884024408, "mlx_cache_bytes": 7939582176, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12884024408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,247,196", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "40e869c2b62e27bc00d9598728026ccfc12fd1b97b0864921ab5373cfc6a82f7"} | ||||
| 1358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4cf78a7ef2f828bdc8949429", "attempt_id": "6c2172df3573", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.108945Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 394, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.24587505310774, "ttft_ms": 13.727332931011915, "decode_ms": 13.447167002595961}, "total_wall_ms": 81.22549997642636, "ttft_ms": 13.727332931011915, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882762840, "mlx_cache_bytes": 7939582176, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12882762840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd9421b7a4e555371ca10fd8", "attempt_id": "0525bcadc047", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.206149Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 398, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.4496670588851, "ttft_ms": 13.719915994443, "decode_ms": 13.573708944022655}, "total_wall_ms": 81.58075006213039, "ttft_ms": 13.719915994443, "input_usage": {"receiver_prompt_tokens": 398, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12884401240, "mlx_cache_bytes": 8056760544, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12884401240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d4d522edff6f67d79cb88a6", "attempt_id": "0025c449fbca", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.303345Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 399, "message_tokens": 273, "message_utf8_bytes": 770, "cache_tensor_bytes": null, "serialized_payload_bytes": 770, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7393.12558399979, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.0859170248732, "ttft_ms": 13.722750009037554, "decode_ms": 13.39708303567022}, "total_wall_ms": 80.97612508572638, "ttft_ms": 13.722750009037554, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 1934, "sender_output_tokens": 512, "sender_prefill_ms": 205.37895802408457, "sender_ttft_ms": 14.022500021383166, "sender_decode_ms": 7172.175790998153}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12905618520, "mlx_cache_bytes": 8159586528, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 12905618520, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "83b6295dce857975e218769ee7ed9d17694fb13c852bff7e29bf503d29db7b56", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c884beb9f9233bc3b471287", "attempt_id": "2267401b7ee6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.401968Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 615, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.83254103176296, "ttft_ms": 13.494707993231714, "decode_ms": 13.762291986495256}, "total_wall_ms": 105.09941610507667, "ttft_ms": 13.494707993231714, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083020, "mlx_cache_bytes": 8443046112, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13039083020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b6d576d866cfd9b774d95b42", "attempt_id": "c1c1b3815ba6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.522898Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 607, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.80862503871322, "ttft_ms": 13.620165991596878, "decode_ms": 27.070875046774745}, "total_wall_ms": 116.48862506262958, "ttft_ms": 13.620165991596878, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034151436, "mlx_cache_bytes": 8804804832, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13034151436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "76db0beb6596d645b1545e09", "attempt_id": "c214ae08a4d0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.655622Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 606, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.45625006221235, "ttft_ms": 13.77445796970278, "decode_ms": 28.043291997164488}, "total_wall_ms": 117.28837504051626, "ttft_ms": 13.77445796970278, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13063872012, "mlx_cache_bytes": 8841996512, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13063872012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c80fbb248d15463c6afd608b", "attempt_id": "e6b386eed480", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.790364Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 623, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.05408404581249, "ttft_ms": 13.733791070990264, "decode_ms": 68.4660408878699}, "total_wall_ms": 160.2977910079062, "ttft_ms": 13.733791070990264, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13055073836, "mlx_cache_bytes": 8841996512, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13055073836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,047,105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "45ed933586262d1470caf31c89c80a05759b79bd4e620737608286d4591bcde5"} | ||||
| 1365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d52c4b3570ca808702421423", "attempt_id": "e889bfa36c22", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:37.966634Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 616, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.41762506682426, "ttft_ms": 13.594417017884552, "decode_ms": 68.06874996982515}, "total_wall_ms": 159.05374998692423, "ttft_ms": 13.594417017884552, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039459852, "mlx_cache_bytes": 9023465696, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13039459852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,047,105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "45ed933586262d1470caf31c89c80a05759b79bd4e620737608286d4591bcde5"} | ||||
| 1366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d3295f327929fc07203dee2c", "attempt_id": "17d33d6bcefc", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:38.141629Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 624, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.90458302386105, "ttft_ms": 14.259541989304125, "decode_ms": 82.87037501577288}, "total_wall_ms": 175.08254200220108, "ttft_ms": 14.259541989304125, "input_usage": {"receiver_prompt_tokens": 624}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13055450668, "mlx_cache_bytes": 9023465696, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13055450668, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a1128460767fb5a9858a348", "attempt_id": "1503a9421859", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:38.332695Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 617, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.59833296202123, "ttft_ms": 13.984916964545846, "decode_ms": 68.15525004640222}, "total_wall_ms": 159.77241599466652, "ttft_ms": 13.984916964545846, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640076, "mlx_cache_bytes": 9144576224, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13039640076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,247,196", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "40e869c2b62e27bc00d9598728026ccfc12fd1b97b0864921ab5373cfc6a82f7"} | ||||
| 1368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6796a2a1b053d80fdbb19636", "attempt_id": "847a748dcf41", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:38.509121Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 614, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.92904199939221, "ttft_ms": 13.60445807222277, "decode_ms": 13.590665999799967}, "total_wall_ms": 105.17174995038658, "ttft_ms": 13.60445807222277, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198284, "mlx_cache_bytes": 9144576224, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13038198284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6e385884f65cf7013b8743c4", "attempt_id": "9ab42ca4d1b3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:38.630463Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 618, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.07870809827, "ttft_ms": 13.635375071316957, "decode_ms": 13.463125098496675}, "total_wall_ms": 105.21558404434472, "ttft_ms": 13.635375071316957, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071801868, "mlx_cache_bytes": 9364646112, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13071801868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6df1e1b9992ba94f34514501", "attempt_id": "d40efd5aade0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:38.751845Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 509, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 619, "message_tokens": 508, "message_utf8_bytes": 1581, "cache_tensor_bytes": null, "serialized_payload_bytes": 1581, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6489169793203473, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.5842089895159, "ttft_ms": 14.110708027146757, "decode_ms": 13.601624988950789}, "total_wall_ms": 105.36808299366385, "ttft_ms": 14.110708027146757, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 934412288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13079617036, "mlx_cache_bytes": 9486149856, "process_rss_bytes": 934412288}, "peak_prefill_memory": null, "peak_decode_memory": 13079617036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1d3563143e1c63763dfe05a0146f823bf4fce2fd6aa62a25cd6c535ce90679f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3d2d448b16f0aa0487aef13c", "attempt_id": "27dd000db847", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.090234Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 46, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.6567499842494726, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.021541996859014, "ttft_ms": 18.021541996859014, "decode_ms": 96.09508293215185}, "total_wall_ms": 117.12579103186727, "ttft_ms": 18.021541996859014, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1040187392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12993041648, "mlx_cache_bytes": 9712527953, "process_rss_bytes": 1040187392}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12993041648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 1372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a500f2bf27903b41f429f917", "attempt_id": "591d0324720c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.223630Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 38, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.6044159419834614, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.91533292271197, "ttft_ms": 17.91533292271197, "decode_ms": 13.734332984313369}, "total_wall_ms": 34.56029202789068, "ttft_ms": 17.91533292271197, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1040187392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12985111792, "mlx_cache_bytes": 9799920209, "process_rss_bytes": 1040187392}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12985111792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b37698e06adb1384b19c498d", "attempt_id": "365f7d20ebbc", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.273972Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 37, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 0.6693339673802257, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.548542004078627, "ttft_ms": 17.548542004078627, "decode_ms": 27.569208992645144}, "total_wall_ms": 47.09583299700171, "ttft_ms": 17.548542004078627, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1040187392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12986602736, "mlx_cache_bytes": 9828887121, "process_rss_bytes": 1040187392}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12986602736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a2cdb1c267ff332445b02175", "attempt_id": "edcea1a7708d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.337189Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 54, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.519499928690493, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.817833926528692, "ttft_ms": 17.817833926528692, "decode_ms": 27.93008298613131}, "total_wall_ms": 48.55283291544765, "ttft_ms": 17.817833926528692, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 54}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1040187392, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 12999431440, "mlx_cache_bytes": 9950508901, "process_rss_bytes": 1040187392}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12999431440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c50b2844a5e6b813dae87cb", "attempt_id": "e6886e4f8a22", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.401475Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 47, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.0813330300152302, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.77808298356831, "ttft_ms": 17.77808298356831, "decode_ms": 27.481582947075367}, "total_wall_ms": 47.6735420525074, "ttft_ms": 17.77808298356831, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1040203776, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12993516816, "mlx_cache_bytes": 9974265701, "process_rss_bytes": 1040203776}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12993516816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "589ab13872aef1f8f5e5ab4a", "attempt_id": "766b29316db0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.464703Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 55, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.5620420454069972, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.1243330007419, "ttft_ms": 18.1243330007419, "decode_ms": 82.64645794406533}, "total_wall_ms": 103.70962496381253, "ttft_ms": 18.1243330007419, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1040203776, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 13000840468, "mlx_cache_bytes": 10000090350, "process_rss_bytes": 1040203776}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13000840468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Koluntek-19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "cefa71c3350f53880f3dfdde8949de2182d8e5275946ac0f441e8068e4a6282a"} | ||||
| 1377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6fe0792fc6182bd7063b8025", "attempt_id": "023a5cc3a6ac", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.584143Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 48, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.6853749984875321, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.947667045518756, "ttft_ms": 17.947667045518756, "decode_ms": 68.93808394670486}, "total_wall_ms": 89.93404195643961, "ttft_ms": 17.947667045518756, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1040203776, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12994008336, "mlx_cache_bytes": 10024338670, "process_rss_bytes": 1040203776}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12994008336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,044,886", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "b83fd596bc2728bfa34d97d0ff2307c2b6f2ed5845a0c5233ebde45c7208edf5"} | ||||
| 1378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78e031fc72ece0f9cf6ddac1", "attempt_id": "bbaaa6c96830", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.690455Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 45, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.5806249575689435, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.910499940626323, "ttft_ms": 17.910499940626323, "decode_ms": 206.2829580390826}, "total_wall_ms": 227.16358304023743, "ttft_ms": 17.910499940626323, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 45}, "output_usage": {"output_tokens": 15}, "provider_cached_usage": null, "process_memory": 1040220160, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 12994958576, "mlx_cache_bytes": 10026763502, "process_rss_bytes": 1040220160}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12994958576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "There is no information about Eshgamgam-11 in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "fffb9399c67287cd52c04f69e802f1cb47351a5f5e31849a33f19b7d44f9fc4a"} | ||||
| 1379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2214db104d74bcf94c148610", "attempt_id": "27c51ffa1c48", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.934157Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 49, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.1254169512540102, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.833792022429407, "ttft_ms": 17.833792022429407, "decode_ms": 13.582790968939662}, "total_wall_ms": 33.87291601393372, "ttft_ms": 17.833792022429407, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1040220160, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12995761424, "mlx_cache_bytes": 10055828718, "process_rss_bytes": 1040220160}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12995761424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8d66745b9d7b8aef400433fc", "attempt_id": "6fb89f1283d1", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:39.984281Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1830, "keep": 458, "compress_ms": 6.763042067177594}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 50, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52539986, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 217.24966703914106, "doc_prefill_ms": 197.03287503216416, "compress_ms": 6.798499962314963, "serialize_ms": 10.820082970894873, "load_ms": 1.4854168985038996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.635166994296014, "ttft_ms": 17.635166994296014, "decode_ms": 13.765749987214804}, "total_wall_ms": 34.24624993931502, "ttft_ms": 17.635166994296014, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1040220160, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12996007184, "mlx_cache_bytes": 10068657390, "process_rss_bytes": 1040220160}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12996007184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "507afea496c125b8404985ad2c808c0da872062db8edb9b15bf03058c16c530b", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f12647840a28e7df9f63de93", "attempt_id": "60ff6297ced1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:40.035144Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 46, "compress_ms": 44.639458996243775}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 46, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540027, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.524916970171034, "doc_prefill_ms": 197.03287503216416, "compress_ms": 45.87633395567536, "serialize_ms": 9.46770899463445, "load_ms": 1.4778750482946634, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.55620795302093, "ttft_ms": 17.55620795302093, "decode_ms": 97.20829105935991}, "total_wall_ms": 173.19645802490413, "ttft_ms": 17.55620795302093, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1041858560, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12993041648, "mlx_cache_bytes": 10370336086, "process_rss_bytes": 1041858560}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12993041648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5907933544f257f57e41fadb2827662a780493ad8e442fa27efe35d6d32505f5", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 1382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3fd04b407294bad27eaa1162", "attempt_id": "8e5c7a66d2f9", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:40.225800Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 38, "compress_ms": 44.28329097572714}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 38, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540026, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.46920793130994, "doc_prefill_ms": 197.03287503216416, "compress_ms": 45.7085840171203, "serialize_ms": 9.586790925823152, "load_ms": 1.2996670557186007, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.178542097099125, "ttft_ms": 17.178542097099125, "decode_ms": 13.737041968852282}, "total_wall_ms": 89.08454200718552, "ttft_ms": 17.178542097099125, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1095073792, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12985095408, "mlx_cache_bytes": 10390029654, "process_rss_bytes": 1095073792}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12985095408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "849ae1bdc9500a670abacd6b21f1b06ecfb00a31b6a9b3ae190010b8984ef7cc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9b1ef26a75f7738d41993c69", "attempt_id": "26a38d344106", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:40.331827Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 37, "compress_ms": 43.646125006489456}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 37, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540027, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.12712490558624, "doc_prefill_ms": 197.03287503216416, "compress_ms": 44.90066599100828, "serialize_ms": 8.041583932936192, "load_ms": 1.547665917314589, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.43420900311321, "ttft_ms": 17.43420900311321, "decode_ms": 27.44870795868337}, "total_wall_ms": 101.01029195357114, "ttft_ms": 17.43420900311321, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1095090176, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12986651888, "mlx_cache_bytes": 10390029654, "process_rss_bytes": 1095090176}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12986651888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5907933544f257f57e41fadb2827662a780493ad8e442fa27efe35d6d32505f5", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0951b20eef3ab19d73c6189", "attempt_id": "0f07a92d4966", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:40.449816Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 54, "compress_ms": 44.3630829686299}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 54, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540025, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.14341599680483, "doc_prefill_ms": 197.03287503216416, "compress_ms": 45.67945806775242, "serialize_ms": 8.292916929349303, "load_ms": 1.3563339598476887, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.040333012118936, "ttft_ms": 17.040333012118936, "decode_ms": 68.59158305451274}, "total_wall_ms": 142.5847919890657, "ttft_ms": 17.040333012118936, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1095090176, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 12999431440, "mlx_cache_bytes": 10407675222, "process_rss_bytes": 1095090176}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12999431440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,047,105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2f31249241243be5e43ddcf8f9f0e99b2b22dbe4a57ae7ee9e464479e7bc126", "output_hash": "45ed933586262d1470caf31c89c80a05759b79bd4e620737608286d4591bcde5"} | ||||
| 1385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f693802fddb6174dba7dc2a4", "attempt_id": "bb9af38050f3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:40.609368Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 47, "compress_ms": 43.68870798498392}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 47, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540026, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.06445900350809, "doc_prefill_ms": 197.03287503216416, "compress_ms": 45.051957946270704, "serialize_ms": 7.831542054191232, "load_ms": 1.4792920555919409, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.8391250083223, "ttft_ms": 17.8391250083223, "decode_ms": 69.28295793477446}, "total_wall_ms": 143.07754090987146, "ttft_ms": 17.8391250083223, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1095090176, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12993516816, "mlx_cache_bytes": 10417440086, "process_rss_bytes": 1095090176}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12993516816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,227,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "849ae1bdc9500a670abacd6b21f1b06ecfb00a31b6a9b3ae190010b8984ef7cc", "output_hash": "c3aa599fbb00899728f00a77f6ec2d981fcc6387f12136cbb65878e6772f4889"} | ||||
| 1386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b4290803f27db6f321839f8a", "attempt_id": "a22968e15be6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:40.769310Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 55, "compress_ms": 43.865791987627745}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 55, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540027, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.93804209213704, "doc_prefill_ms": 197.03287503216416, "compress_ms": 45.13612494338304, "serialize_ms": 7.624458055943251, "load_ms": 1.5423749573528767, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.768582911230624, "ttft_ms": 17.768582911230624, "decode_ms": 82.46658300049603}, "total_wall_ms": 156.18545899633318, "ttft_ms": 17.768582911230624, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1095122944, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 13000840468, "mlx_cache_bytes": 10426877270, "process_rss_bytes": 1095122944}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13000840468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5907933544f257f57e41fadb2827662a780493ad8e442fa27efe35d6d32505f5", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3c3585b0087491798e35d1f7", "attempt_id": "e7fb6610e02e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:40.942355Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 48, "compress_ms": 42.558416025713086}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 48, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540027, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 51.63441691547632, "doc_prefill_ms": 197.03287503216416, "compress_ms": 43.79766690544784, "serialize_ms": 7.650749990716577, "load_ms": 1.4846250414848328, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.74108305107802, "ttft_ms": 17.74108305107802, "decode_ms": 69.85866697505116}, "total_wall_ms": 142.16716610826552, "ttft_ms": 17.74108305107802, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1095139328, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12994008336, "mlx_cache_bytes": 10436232534, "process_rss_bytes": 1095139328}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12994008336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13,678,337", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5907933544f257f57e41fadb2827662a780493ad8e442fa27efe35d6d32505f5", "output_hash": "c083b12daa55ca87b89b16a00860e05bddf23e271243dcbcbc9191a49086bf06"} | ||||
| 1388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "06374eef729227a2deb25298", "attempt_id": "08bcdeae4f83", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.101818Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 45, "compress_ms": 42.71395900286734}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 45, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540026, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 51.744958967901766, "doc_prefill_ms": 197.03287503216416, "compress_ms": 43.99395803920925, "serialize_ms": 7.574292016215622, "load_ms": 1.5814999351277947, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.689333064481616, "ttft_ms": 17.689333064481616, "decode_ms": 42.22191695589572}, "total_wall_ms": 114.6507499506697, "ttft_ms": 17.689333064481616, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1095155712, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12992042224, "mlx_cache_bytes": 10455287126, "process_rss_bytes": 1095155712}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12992042224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "849ae1bdc9500a670abacd6b21f1b06ecfb00a31b6a9b3ae190010b8984ef7cc", "output_hash": "32e91c1240d5f0df215a3d318b26dfb6755680982d5f6722a6aed0dae644c0b3"} | ||||
| 1389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7286953482c3894b4ddf5493", "attempt_id": "ef43433c42c4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.233072Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 49, "compress_ms": 44.13175000809133}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 49, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540026, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.18766599521041, "doc_prefill_ms": 197.03287503216416, "compress_ms": 45.34650000277907, "serialize_ms": 7.657333044335246, "load_ms": 1.5308329602703452, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.660249955952168, "ttft_ms": 17.660249955952168, "decode_ms": 13.720124959945679}, "total_wall_ms": 87.49262499623, "ttft_ms": 17.660249955952168, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1095172096, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12995761424, "mlx_cache_bytes": 10480092502, "process_rss_bytes": 1095172096}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12995761424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "849ae1bdc9500a670abacd6b21f1b06ecfb00a31b6a9b3ae190010b8984ef7cc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f978c6a86a7eef85bfb1fadc", "attempt_id": "183ca2107b6f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.336861Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1830, "keep": 458, "window_tokens": 50, "compress_ms": 43.1421659886837}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 50, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 52527104, "serialized_payload_bytes": 52540025, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.54583398345858, "doc_prefill_ms": 197.03287503216416, "compress_ms": 44.44720898754895, "serialize_ms": 7.920124917291105, "load_ms": 1.4324999647215009, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.475125030614436, "ttft_ms": 17.475125030614436, "decode_ms": 14.094082987867296}, "total_wall_ms": 86.98420797009021, "ttft_ms": 17.475125030614436, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1095172096, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12996007184, "mlx_cache_bytes": 10488890710, "process_rss_bytes": 1095172096}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 12996007184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2f31249241243be5e43ddcf8f9f0e99b2b22dbe4a57ae7ee9e464479e7bc126", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3e0f10b1fc4fc33ea1ec4cd5", "attempt_id": "5f4d8e5cc8c0", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.470528Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 46, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 3.1524579972028732, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.666791941039264, "ttft_ms": 20.666791941039264, "decode_ms": 106.65999993216246}, "total_wall_ms": 131.8384159822017, "ttft_ms": 20.666791941039264, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13150391960, "mlx_cache_bytes": 10769029398, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13150391960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NA-58Q-5913", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "a4952c0aa4af7f7a21616de82a1eb2bd97ee62e7fa53ca310442860a9bbc6d44"} | ||||
| 1392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d7b0d6d74d076f30fd6ed35", "attempt_id": "020f85f644be", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.618822Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 38, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 1.9473329884931445, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.308915991336107, "ttft_ms": 20.308915991336107, "decode_ms": 30.371707980521023}, "total_wall_ms": 54.01883297599852, "ttft_ms": 20.308915991336107, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13139295432, "mlx_cache_bytes": 10793626646, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13139295432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "00a09b533be66643a0da75e4", "attempt_id": "194919d4bec2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.689191Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 37, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 2.195082954131067, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.08675003889948, "ttft_ms": 20.08675003889948, "decode_ms": 30.229708063416183}, "total_wall_ms": 53.80658293142915, "ttft_ms": 20.08675003889948, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13142162792, "mlx_cache_bytes": 10816909494, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13142162792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e430a903c6270adf52437589", "attempt_id": "78c887d54270", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.759310Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 54, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 2.245292067527771, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.90933290310204, "ttft_ms": 20.90933290310204, "decode_ms": 75.69283293560147}, "total_wall_ms": 100.17745802178979, "ttft_ms": 20.90933290310204, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13061641224, "mlx_peak_bytes": 13147812304, "mlx_cache_bytes": 10955149942, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13147812304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,047,105", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "45ed933586262d1470caf31c89c80a05759b79bd4e620737608286d4591bcde5"} | ||||
| 1395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "031dc45b6a4b9a0a3e2fae52", "attempt_id": "4c735a0ac407", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.875831Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 47, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 2.079250058159232, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.4185409238562, "ttft_ms": 20.4185409238562, "decode_ms": 75.5951669998467}, "total_wall_ms": 99.47795898187906, "ttft_ms": 20.4185409238562, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13151506088, "mlx_cache_bytes": 10985779158, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13151506088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,227,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "c3aa599fbb00899728f00a77f6ec2d981fcc6387f12136cbb65878e6772f4889"} | ||||
| 1396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b124fd4efff961fb9ff3de0", "attempt_id": "4bdafac0b84a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:41.991374Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 55, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 2.1157090086489916, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.212334046140313, "ttft_ms": 21.212334046140313, "decode_ms": 91.87162504531443}, "total_wall_ms": 116.51474994141608, "ttft_ms": 21.212334046140313, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13061641224, "mlx_peak_bytes": 13148680788, "mlx_cache_bytes": 11045950006, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13148680788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Eshgamgam-11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "8c1313c53ab4dbffa5f336d721c810678133eecaa467241e53d8a92150601475"} | ||||
| 1397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93374d53e62ac4a07fda1ef9", "attempt_id": "5e19a6fc9256", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:42.123541Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 48, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 2.110125031322241, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.61804209370166, "ttft_ms": 20.61804209370166, "decode_ms": 705.5000410182402}, "total_wall_ms": 729.6134160133079, "ttft_ms": 20.61804209370166, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 48}, "output_usage": {"output_tokens": 47}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13063476232, "mlx_peak_bytes": 13152588712, "mlx_cache_bytes": 11358802486, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13152588712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,247,196 + 5,134,740 + 4,932,140 + 8,497,835 + 8,227,110 + 10,047,105 = 36,795,427", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "b30bb9e94bc1b810b104f709327b316328a9f1c02f839823949b692ec76f7db2"} | ||||
| 1398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b4c7ce999b896353f704f68e", "attempt_id": "73567c102014", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:42.869333Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 45, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 1.9914580043405294, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.449290983378887, "ttft_ms": 20.449290983378887, "decode_ms": 45.3037089901045}, "total_wall_ms": 69.13066701963544, "ttft_ms": 20.449290983378887, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13148877640, "mlx_cache_bytes": 11389997622, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13148877640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "32e91c1240d5f0df215a3d318b26dfb6755680982d5f6722a6aed0dae644c0b3"} | ||||
| 1399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3d48b346743bbe6b7a384498", "attempt_id": "223fde231241", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:42.954804Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 49, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 2.068042056635022, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.532708032988012, "ttft_ms": 20.532708032988012, "decode_ms": 15.207250020466745}, "total_wall_ms": 39.136665989644825, "ttft_ms": 20.532708032988012, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13155210152, "mlx_cache_bytes": 11421258294, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13155210152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5624692bd50f84193cd69aaa", "attempt_id": "b1484639d2dd", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:43.010020Z", "task_family": "synthetic", "document_id": "syn_03009_2000", "document_hash": "6ed94dcf728255bd7a7d11c97c362930728fb81a3e91f1906eb6eec86e0fedb7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03009_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1770, "source_tokens_receiver": 1770, "query_tokens": 50, "message_tokens": 1830, "message_utf8_bytes": 7378, "cache_tensor_bytes": 111498240, "serialized_payload_bytes": 111525358, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.822667012922466, "doc_prefill_ms": 197.03287503216416, "compress_ms": 10.169042041525245, "serialize_ms": 19.381957943551242, "load_ms": 2.133667003363371, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.67508304025978, "ttft_ms": 20.67508304025978, "decode_ms": 15.318916994147003}, "total_wall_ms": 39.45141693111509, "ttft_ms": 20.67508304025978, "input_usage": {"receiver_prefix_tokens": 1830, "dense_cache_bytes": 209879040, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1319485440, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13142665532, "mlx_cache_bytes": 11448390198, "process_rss_bytes": 1319485440}, "peak_prefill_memory": 13285323136, "peak_decode_memory": 13142665532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03009_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4afda180227015c30d9a7a1fe328eefb381ed41275e9c05c77a120d26ff07c70", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "16431bd17b09978913f5cd8e", "attempt_id": "1d7e038c4d29", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:43.130269Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5873, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 770.7374170422554, "ttft_ms": 14.813832938671112, "decode_ms": 142.5017500296235}, "total_wall_ms": 936.5386249264702, "ttft_ms": 14.813832938671112, "input_usage": {"receiver_prompt_tokens": 5873}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1174503424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 2340631992, "process_rss_bytes": 1174503424}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 1402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "153bda0104581430a4b31f77", "attempt_id": "be5ad9b9bba1", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:44.090918Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5861, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 828.4736659843475, "ttft_ms": 14.480500016361475, "decode_ms": 14.285916928201914}, "total_wall_ms": 865.7765829702839, "ttft_ms": 14.480500016361475, "input_usage": {"receiver_prompt_tokens": 5861}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174503424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3034346936, "process_rss_bytes": 1174503424}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "95b3a88a596f7e3dbde0fc1d", "attempt_id": "d345ff115fec", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:44.978849Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5863, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 814.2737499438226, "ttft_ms": 14.56395909190178, "decode_ms": 14.151290990412235}, "total_wall_ms": 851.5487079275772, "ttft_ms": 14.56395909190178, "input_usage": {"receiver_prompt_tokens": 5863}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174536192, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3729126840, "process_rss_bytes": 1174536192}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fc94f2abc65eec27efc070cb", "attempt_id": "e950cb509742", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:45.852748Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5877, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 789.9733330123127, "ttft_ms": 14.379875035956502, "decode_ms": 83.87383399531245}, "total_wall_ms": 896.8297090614215, "ttft_ms": 14.379875035956502, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1174568960, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 4429067704, "process_rss_bytes": 1174568960}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "931295", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "0291810ef629db45b8dd44dbd2ffb05f6ec39daa8fe059b1ab9f757164cabc41"} | ||||
| 1405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "795a5e98cd632150f8d7ce94", "attempt_id": "988ec5a9e5df", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:46.772126Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5870, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 766.4769169641659, "ttft_ms": 14.532958972267807, "decode_ms": 125.8154580136761}, "total_wall_ms": 915.5200420645997, "ttft_ms": 14.532958972267807, "input_usage": {"receiver_prompt_tokens": 5870}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1174601728, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 4915738040, "process_rss_bytes": 1174601728}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,875,883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "a8243b862e2d82445ca3c93eec5e829e5d41cfa4d9abfba7b18d922fdebba636"} | ||||
| 1406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "91e285292ae7024146bf08e5", "attempt_id": "2e8bbe95ee41", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:47.710081Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5880, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 766.99083391577, "ttft_ms": 14.584499993361533, "decode_ms": 84.7047499846667}, "total_wall_ms": 874.9227080261335, "ttft_ms": 14.584499993361533, "input_usage": {"receiver_prompt_tokens": 5880}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1174634496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5617006008, "process_rss_bytes": 1174634496}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b137b864f5fec72ab053f74", "attempt_id": "dc8e285a22d5", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:48.607114Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5873, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 778.3372080884874, "ttft_ms": 14.660667045973241, "decode_ms": 98.14312495291233}, "total_wall_ms": 899.7380830114707, "ttft_ms": 14.660667045973241, "input_usage": {"receiver_prompt_tokens": 5873}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1174683648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5617006008, "process_rss_bytes": 1174683648}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4049894", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "10e7c3d5f40baf39e3d264b595b5de0ba9362a8442a7c401cc2bca225451a6c2"} | ||||
| 1408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8e2b6d478868d536fe8c7aa5", "attempt_id": "1704c4bf252b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:49.528855Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5870, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 777.569834026508, "ttft_ms": 14.496832969598472, "decode_ms": 98.46654196735471}, "total_wall_ms": 899.0051670698449, "ttft_ms": 14.496832969598472, "input_usage": {"receiver_prompt_tokens": 5870}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1174716416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5617006008, "process_rss_bytes": 1174716416}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2791000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "0c575ff3e3bf3721bb70e765da5ab7edd6de912e4759657ea5350e4adb602b5a"} | ||||
| 1409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ca46b6cf28768e751533e14", "attempt_id": "6e69ff481c80", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:50.450269Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5873, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 808.5635420866311, "ttft_ms": 14.20762506313622, "decode_ms": 14.020875096321106}, "total_wall_ms": 845.2529580099508, "ttft_ms": 14.20762506313622, "input_usage": {"receiver_prompt_tokens": 5873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174749184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5617006008, "process_rss_bytes": 1174749184}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3e202f70a2b2afd57e7c8c48", "attempt_id": "0e92f96b4748", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:51.317913Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 5875, "message_tokens": 5787, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016750069335103035, "decode_payload_ms": 0.0, "receiver_prefill_ms": 797.3971670726314, "ttft_ms": 15.015000011771917, "decode_ms": 14.484334038570523}, "total_wall_ms": 835.3391670389101, "ttft_ms": 15.015000011771917, "input_usage": {"receiver_prompt_tokens": 5875}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174781952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 6105052600, "process_rss_bytes": 1174781952}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "09814af13829e53c38690aa5", "attempt_id": "9835ee1ecbdb", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:56.912758Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 374, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.138958984054625, "ttft_ms": 13.3382499916479, "decode_ms": 13.09074996970594}, "total_wall_ms": 75.96579100936651, "ttft_ms": 13.3382499916479, "input_usage": {"receiver_prompt_tokens": 374, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174978560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913662532, "mlx_cache_bytes": 7619890060, "process_rss_bytes": 1174978560}, "peak_prefill_memory": null, "peak_decode_memory": 12913662532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9bdc7ef4649ecf8eb22b947e", "attempt_id": "6b3d8f31f2aa", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.011719Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 362, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.188791959546506, "ttft_ms": 13.59262503683567, "decode_ms": 13.036124990321696}, "total_wall_ms": 75.75412502046674, "ttft_ms": 13.59262503683567, "input_usage": {"receiver_prompt_tokens": 362, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174978560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904602180, "mlx_cache_bytes": 7903316876, "process_rss_bytes": 1174978560}, "peak_prefill_memory": null, "peak_decode_memory": 12904602180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "60cc7eb442fff56f6129ea71", "attempt_id": "50f772c13add", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.110263Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 364, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.868542023934424, "ttft_ms": 13.461125083267689, "decode_ms": 13.321124948561192}, "total_wall_ms": 75.58083406183869, "ttft_ms": 13.461125083267689, "input_usage": {"receiver_prompt_tokens": 364, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174978560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12905519684, "mlx_cache_bytes": 8102677388, "process_rss_bytes": 1174978560}, "peak_prefill_memory": null, "peak_decode_memory": 12905519684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3edcb4fd16980871ce309960", "attempt_id": "17e808224edd", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.208464Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 378, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.334249993786216, "ttft_ms": 13.69295793119818, "decode_ms": 13.505749986506999}, "total_wall_ms": 76.50487497448921, "ttft_ms": 13.69295793119818, "input_usage": {"receiver_prompt_tokens": 378, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174978560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12916824660, "mlx_cache_bytes": 8411074928, "process_rss_bytes": 1174978560}, "peak_prefill_memory": null, "peak_decode_memory": 12916824660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9ff3a24267a5a266a4d77377", "attempt_id": "36ffaab38e3a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.306893Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 371, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.1230829609558, "ttft_ms": 13.376667047850788, "decode_ms": 13.469792087562382}, "total_wall_ms": 75.8894169703126, "ttft_ms": 13.376667047850788, "input_usage": {"receiver_prompt_tokens": 371, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174978560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12927146564, "mlx_cache_bytes": 8634175856, "process_rss_bytes": 1174978560}, "peak_prefill_memory": null, "peak_decode_memory": 12927146564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8521ed80c38a5501d3231fe1", "attempt_id": "35a4a5aef2ad", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.404837Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 381, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.163624946027994, "ttft_ms": 13.446916011162102, "decode_ms": 79.73779202438891}, "total_wall_ms": 142.35187496524304, "ttft_ms": 13.446916011162102, "input_usage": {"receiver_prompt_tokens": 381, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1174994944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12918659680, "mlx_cache_bytes": 8708888416, "process_rss_bytes": 1174994944}, "peak_prefill_memory": null, "peak_decode_memory": 12918659680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rukmelri-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "2e6780effd3ce64b936cdd7bf5b52ba071dcd639cc48639e8f72d04cc6978a32"} | ||||
| 1417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b0df2a843f45b627d697e6ca", "attempt_id": "68e8e336c7a8", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.569499Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 374, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 48.07583300862461, "ttft_ms": 13.281332910992205, "decode_ms": 13.275290955789387}, "total_wall_ms": 75.57312492281199, "ttft_ms": 13.281332910992205, "input_usage": {"receiver_prompt_tokens": 374, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174994944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913662532, "mlx_cache_bytes": 8708888416, "process_rss_bytes": 1174994944}, "peak_prefill_memory": null, "peak_decode_memory": 12913662532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f8bf941c278798efa5142085", "attempt_id": "dbb84fae3c0d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.667624Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 371, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.94483305886388, "ttft_ms": 12.999875005334616, "decode_ms": 13.333832961507142}, "total_wall_ms": 75.1849579392001, "ttft_ms": 12.999875005334616, "input_usage": {"receiver_prompt_tokens": 371, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174994944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12929260124, "mlx_cache_bytes": 8708888416, "process_rss_bytes": 1174994944}, "peak_prefill_memory": null, "peak_decode_memory": 12929260124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7b29671550380910f2097bc3", "attempt_id": "7eaf4b2ac716", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.765054Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 374, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.98987496178597, "ttft_ms": 13.978375005535781, "decode_ms": 13.48479196894914}, "total_wall_ms": 76.39637496322393, "ttft_ms": 13.978375005535781, "input_usage": {"receiver_prompt_tokens": 374, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174994944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913662532, "mlx_cache_bytes": 8708888416, "process_rss_bytes": 1174994944}, "peak_prefill_memory": null, "peak_decode_memory": 12913662532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28239eaa76817e9f1fb9d2b5", "attempt_id": "2e72982d8b61", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:55:57.863749Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 376, "message_tokens": 284, "message_utf8_bytes": 1542, "cache_tensor_bytes": null, "serialized_payload_bytes": 1542, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4736.841999925673, "decode_payload_ms": 0.0, "receiver_prefill_ms": 47.88349999580532, "ttft_ms": 13.103208038955927, "decode_ms": 13.76762508880347}, "total_wall_ms": 75.70679194759578, "ttft_ms": 13.103208038955927, "input_usage": {"receiver_prompt_tokens": 376, "sender_input_tokens": 5903, "sender_output_tokens": 284, "sender_prefill_ms": 810.316540999338, "sender_ttft_ms": 14.036666951142251, "sender_decode_ms": 3905.2616669796407}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1174994944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12914580052, "mlx_cache_bytes": 8914802528, "process_rss_bytes": 1174994944}, "peak_prefill_memory": null, "peak_decode_memory": 12914580052, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e8812c4e93a4bbac2c92f6189fd1876ac49f2da3f53687f1586fa3f269218da", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "103b4034569a95a15e05652b", "attempt_id": "b48d11397f1b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:05.684149Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 443, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.03808399569243, "ttft_ms": 13.67049990221858, "decode_ms": 13.40175000950694}, "total_wall_ms": 82.06208294723183, "ttft_ms": 13.67049990221858, "input_usage": {"receiver_prompt_tokens": 443, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12968237912, "mlx_cache_bytes": 10064535112, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12968237912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f24bd9fda629034450fc965", "attempt_id": "a4a1cf45c116", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:05.789508Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 431, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.748833015561104, "ttft_ms": 13.495041988790035, "decode_ms": 13.442125055007637}, "total_wall_ms": 81.55529201030731, "ttft_ms": 13.495041988790035, "input_usage": {"receiver_prompt_tokens": 431, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12958718808, "mlx_cache_bytes": 10415611464, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12958718808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0fab6a5940d06e1081f51386", "attempt_id": "f6f533322958", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:05.893548Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 433, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.8182919844985, "ttft_ms": 13.636999996379018, "decode_ms": 13.450791011564434}, "total_wall_ms": 81.80974994320422, "ttft_ms": 13.636999996379018, "input_usage": {"receiver_prompt_tokens": 433, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12959898456, "mlx_cache_bytes": 10652851784, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12959898456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28a48477f1ce07a21c00fd3d", "attempt_id": "5f1410e89f11", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:05.997519Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 447, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.90395806171, "ttft_ms": 13.542458065785468, "decode_ms": 13.20704200770706}, "total_wall_ms": 81.52287499979138, "ttft_ms": 13.542458065785468, "input_usage": {"receiver_prompt_tokens": 447, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971432808, "mlx_cache_bytes": 11002422592, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12971432808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0b5401f57efc7df4c258236f", "attempt_id": "168f69eb47e1", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.101485Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 440, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.35612501949072, "ttft_ms": 13.747083023190498, "decode_ms": 13.458832981996238}, "total_wall_ms": 81.38500002678484, "ttft_ms": 13.747083023190498, "input_usage": {"receiver_prompt_tokens": 440, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909861696, "mlx_cache_bytes": 11183203648, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12909861696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4be3a16bfa2370506f5aaff2", "attempt_id": "2217f7d05675", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.205240Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 450, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.28654099907726, "ttft_ms": 13.256457983516157, "decode_ms": 79.97229194734246}, "total_wall_ms": 149.4066669838503, "ttft_ms": 13.256457983516157, "input_usage": {"receiver_prompt_tokens": 450, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12974791540, "mlx_cache_bytes": 11541507140, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12974791540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9af17635f290d7b7c6cecbf0", "attempt_id": "1dd19bc2358c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.376493Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 443, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.76104195602238, "ttft_ms": 13.432000065222383, "decode_ms": 93.82320893928409}, "total_wall_ms": 161.85866703744978, "ttft_ms": 13.432000065222383, "input_usage": {"receiver_prompt_tokens": 443, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12968237912, "mlx_cache_bytes": 11541507140, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12968237912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6798825", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "af61ac2b37c8641b077cd408a1a30951c8ea10c3f897c063dda007aa650825ec"} | ||||
| 1428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da0c3957750d17f6bf183f3c", "attempt_id": "926856727692", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.560468Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 440, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.46491700038314, "ttft_ms": 13.22795799933374, "decode_ms": 13.415874913334846}, "total_wall_ms": 80.96366701647639, "ttft_ms": 13.22795799933374, "input_usage": {"receiver_prompt_tokens": 440, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909861696, "mlx_cache_bytes": 11541507140, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12909861696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1078b2784a58d399980ba427", "attempt_id": "a03c4d2487c2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.663556Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 443, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.19333402439952, "ttft_ms": 13.124124961905181, "decode_ms": 13.726625009439886}, "total_wall_ms": 80.91750007588416, "ttft_ms": 13.124124961905181, "input_usage": {"receiver_prompt_tokens": 443, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12968237912, "mlx_cache_bytes": 11541507140, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12968237912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb585eea7379e13123ec6ad9", "attempt_id": "ce85ae4d530a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.766550Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 445, "message_tokens": 341, "message_utf8_bytes": 827, "cache_tensor_bytes": null, "serialized_payload_bytes": 827, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7722.409583977424, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.5628329962492, "ttft_ms": 13.679208001121879, "decode_ms": 13.415833003818989}, "total_wall_ms": 81.51458308566362, "ttft_ms": 13.679208001121879, "input_usage": {"receiver_prompt_tokens": 445, "sender_input_tokens": 5931, "sender_output_tokens": 512, "sender_prefill_ms": 676.0437079938129, "sender_ttft_ms": 14.073667000047863, "sender_decode_ms": 7027.419541962445}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12969417576, "mlx_cache_bytes": 11785301060, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12969417576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4667a361bc2c9e509aeb9281e4c01f1f1aff52150d0ef89c131278b483205610", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "44bfcd09c4b12f37a7cf539b", "attempt_id": "194cfba617cb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.874714Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 596, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.21720800548792, "ttft_ms": 13.409208972007036, "decode_ms": 13.432374922558665}, "total_wall_ms": 98.02808403037488, "ttft_ms": 13.409208972007036, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992865368, "mlx_cache_bytes": 12180941892, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12992865368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4cf60139e406088422646417", "attempt_id": "2e0972e24402", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:06.994173Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 584, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.8306659469381, "ttft_ms": 13.224333059042692, "decode_ms": 13.54741700924933}, "total_wall_ms": 97.54612506367266, "ttft_ms": 13.224333059042692, "input_usage": {"receiver_prompt_tokens": 584}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12985492568, "mlx_cache_bytes": 12535917636, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12985492568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "66dd80c057da409fb999628e", "attempt_id": "04bf99a80188", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:07.114142Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 586, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.63266700040549, "ttft_ms": 13.474417035467923, "decode_ms": 13.372875051572919}, "total_wall_ms": 97.46170800644904, "ttft_ms": 13.474417035467923, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12987458648, "mlx_cache_bytes": 12878113860, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12987458648, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "728293886607bd485dc54d51", "attempt_id": "e77bf13dff9e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:07.233337Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 600, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.42554102372378, "ttft_ms": 13.209208031184971, "decode_ms": 81.73533307854086}, "total_wall_ms": 166.3362920517102, "ttft_ms": 13.209208031184971, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 13227977796, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "944615", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "1f65c4645ac7fef508d16ab6d39cfd09b825814c3666f6f9d728a649f8172d63"} | ||||
| 1435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "75a34e5cdfc7085f93ade92b", "attempt_id": "4b6d32c6d277", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:07.421767Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 593, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.64583392255008, "ttft_ms": 13.545625028200448, "decode_ms": 120.96024991478771}, "total_wall_ms": 205.15637495554984, "ttft_ms": 13.545625028200448, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12991587416, "mlx_cache_bytes": 13471771716, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12991587416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,418,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "0c81bdc5a7cd40d6d4b0c52dc5fc252e6a9579c7b15fd2d5c7cfa4590ccab621"} | ||||
| 1436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28b8cfb86e8459a1e8aba2d5", "attempt_id": "0b535d1c9253", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:07.649238Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 603, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.64920803532004, "ttft_ms": 14.051332953386009, "decode_ms": 80.65070898737758}, "total_wall_ms": 166.35783307719976, "ttft_ms": 14.051332953386009, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994716760, "mlx_cache_bytes": 13838445636, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12994716760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0591f1d3728a9761e63e8412", "attempt_id": "035f1343ed1b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:07.837800Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 596, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.6031249826774, "ttft_ms": 13.311707996763289, "decode_ms": 93.60912500414997}, "total_wall_ms": 177.5809999089688, "ttft_ms": 13.311707996763289, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992865368, "mlx_cache_bytes": 13838445636, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12992865368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3123456", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "b31bd433a24dfe957206fcc1adfbeebddf9e57c03f2541eba6577e7b4e9d7010"} | ||||
| 1438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5ea01c605ace164b849e79c3", "attempt_id": "87cb8fb6e2a9", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:08.038107Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 593, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.93495800998062, "ttft_ms": 13.291583047248423, "decode_ms": 93.40816596522927}, "total_wall_ms": 177.62641701847315, "ttft_ms": 13.291583047248423, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12991587416, "mlx_cache_bytes": 13838445636, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12991587416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1866305", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "d6efcd68c15f2ba21dbe2e919cba6f5eea163b488348ca5cc39d93bc34b4a6ab"} | ||||
| 1439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a74df48ca8144debf5cdf64", "attempt_id": "b41f2ddb7e6b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:08.237894Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 596, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.54691594000906, "ttft_ms": 13.3307920768857, "decode_ms": 13.698499999009073}, "total_wall_ms": 97.51687501557171, "ttft_ms": 13.3307920768857, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992865368, "mlx_cache_bytes": 13838445636, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12992865368, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "70fb06099a8eda45a61631a3", "attempt_id": "2e8b567d96fb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:08.357788Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 598, "message_tokens": 509, "message_utf8_bytes": 1266, "cache_tensor_bytes": null, "serialized_payload_bytes": 1266, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.285041010007262, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.61270899046212, "ttft_ms": 13.34833400323987, "decode_ms": 13.273416901938617}, "total_wall_ms": 97.23220800515264, "ttft_ms": 13.34833400323987, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1175126016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994438232, "mlx_cache_bytes": 14084402244, "process_rss_bytes": 1175126016}, "peak_prefill_memory": null, "peak_decode_memory": 12994438232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e005aec09248cd450e605f5e1ac28b736950058690bd47d940bb179055a0569", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a4f58fb5c8538abf02440bcd", "attempt_id": "d1a894ecfc20", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:09.169586Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.7612080555409193, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.873457986861467, "ttft_ms": 22.873457986861467, "decode_ms": 137.20395893324167}, "total_wall_ms": 165.99108302034438, "ttft_ms": 22.873457986861467, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12977280252, "mlx_cache_bytes": 14670605757, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977280252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 1442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae5d00d2141b8f0d8fedf419", "attempt_id": "55d6ae376974", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:09.357930Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.7629170324653387, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.69116700720042, "ttft_ms": 23.69116700720042, "decode_ms": 13.682916993275285}, "total_wall_ms": 43.34308300167322, "ttft_ms": 23.69116700720042, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12924670984, "mlx_peak_bytes": 12966614268, "mlx_cache_bytes": 14691462589, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12966614268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd5c1d5ba190a06210eec692", "attempt_id": "689de552cec2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:09.423308Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 37, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 0.7298750570043921, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.4314170666039, "ttft_ms": 23.4314170666039, "decode_ms": 13.824832974933088}, "total_wall_ms": 42.390584014356136, "ttft_ms": 23.4314170666039, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12924670984, "mlx_peak_bytes": 12968596732, "mlx_cache_bytes": 14727785917, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968596732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9b5a678415f3f007152d92f9", "attempt_id": "2f51500181bb", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:09.487569Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 51, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.7295830184593797, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.63449998665601, "ttft_ms": 23.63449998665601, "decode_ms": 96.92908299621195}, "total_wall_ms": 126.46737496834248, "ttft_ms": 23.63449998665601, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 51}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12982392076, "mlx_cache_bytes": 14772088661, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12982392076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3875883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "026ea66fa61b7546304a7751dc9ab6fda4ae71d56381e43583548b20e9e55cfb"} | ||||
| 1445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c87305923ed7efe4aab329b0", "attempt_id": "b77fb9f64b23", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:09.636088Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.733875018544495, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.00500008277595, "ttft_ms": 23.00500008277595, "decode_ms": 95.72391700930893}, "total_wall_ms": 124.90408297162503, "ttft_ms": 23.00500008277595, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12975068412, "mlx_cache_bytes": 14803171045, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975068412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3875883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "026ea66fa61b7546304a7751dc9ab6fda4ae71d56381e43583548b20e9e55cfb"} | ||||
| 1446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "74ce59dca03633da0af9bd3f", "attempt_id": "4087836776c6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:09.782974Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 54, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.750500057823956, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.979917052201927, "ttft_ms": 23.979917052201927, "decode_ms": 81.8784999428317}, "total_wall_ms": 111.79766699206084, "ttft_ms": 23.979917052201927, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12985029912, "mlx_cache_bytes": 14833416341, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12985029912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Rukmelri-6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "2e6780effd3ce64b936cdd7bf5b52ba071dcd639cc48639e8f72d04cc6978a32"} | ||||
| 1447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "87f4547506b789ec11319008", "attempt_id": "5e428e64b749", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:09.917579Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.866249949671328, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.6163329789415, "ttft_ms": 22.6163329789415, "decode_ms": 97.16429095715284}, "total_wall_ms": 125.88674994185567, "ttft_ms": 22.6163329789415, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12977018108, "mlx_cache_bytes": 14833416341, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977018108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2204883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "100033839d90cad42860b9d2bb2ffca0c05737d9b27068f090e2207a0a68154d"} | ||||
| 1448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e03f2a82d950afa4022c8429", "attempt_id": "487a20534409", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:10.066233Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.6494170995429158, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.82104198820889, "ttft_ms": 22.82104198820889, "decode_ms": 96.81024996098131}, "total_wall_ms": 125.70862495340407, "ttft_ms": 22.82104198820889, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1283112960, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12975068412, "mlx_cache_bytes": 14833416341, "process_rss_bytes": 1283112960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975068412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1200000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "0d9760fbd449ca8e13c614acdd941e77e4c0e795831b641763c361934463ade4"} | ||||
| 1449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38cafd5d7b4b7a6125c0dbb1", "attempt_id": "0ca9d9c68646", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:10.214656Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.7888749716803432, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.52033306285739, "ttft_ms": 22.52033306285739, "decode_ms": 13.659791904501617}, "total_wall_ms": 42.50733298249543, "ttft_ms": 22.52033306285739, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1283129344, "backend_memory": {"mlx_active_bytes": 12924670984, "mlx_peak_bytes": 12977018108, "mlx_cache_bytes": 14834333845, "process_rss_bytes": 1283129344}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977018108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1285c81e42b729ec6c28a4b4", "attempt_id": "a50faa5256be", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:10.279767Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868965384}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5826, "keep": 1456, "compress_ms": 8.835749933496118}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 49, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690172, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 692.589542013593, "doc_prefill_ms": 663.4379579918459, "compress_ms": 8.869790937751532, "serialize_ms": 11.120624956674874, "load_ms": 1.6260419506579638, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.72558298520744, "ttft_ms": 23.72558298520744, "decode_ms": 14.562750002369285}, "total_wall_ms": 44.16649998165667, "ttft_ms": 23.72558298520744, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1283129344, "backend_memory": {"mlx_active_bytes": 12925588488, "mlx_peak_bytes": 12981376268, "mlx_cache_bytes": 14867773589, "process_rss_bytes": 1283129344}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981376268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "808bece71d4a8d4d218c85671125ff35ae737cb8ed17d99e99c4c83ba7b456dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1fe1fd4bcf80f0b16b94242", "attempt_id": "3649384b372e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:10.346688Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 47, "compress_ms": 67.4016660777852}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690211, "side_information_bytes": 16227, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 80.26187506038696, "doc_prefill_ms": 663.4379579918459, "compress_ms": 71.50762504898012, "serialize_ms": 8.541833027265966, "load_ms": 0.5772500298917294, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.338334005326033, "ttft_ms": 22.338334005326033, "decode_ms": 123.85137507226318}, "total_wall_ms": 231.52870894409716, "ttft_ms": 22.338334005326033, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1283276800, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976755964, "mlx_cache_bytes": 15132906525, "process_rss_bytes": 1283276800}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976755964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43S-874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "596612fbca2614a3fbb4afb5998a5ab0361f474fbd7d3c9e71d11d9714812da8", "output_hash": "54e371a3d767b326f1124ec1c2d5696dbff41f0b3cae66e0c33799dfeff87373"} | ||||
| 1452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "469808a882e0346d2c1dd35a", "attempt_id": "475cc1f1b1c8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:10.600820Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 35, "compress_ms": 63.37562494445592}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.33962498605251, "doc_prefill_ms": 663.4379579918459, "compress_ms": 67.73550005163997, "serialize_ms": 9.390791994519532, "load_ms": 1.5310000162571669, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.246916942298412, "ttft_ms": 23.246916942298412, "decode_ms": 13.884250074625015}, "total_wall_ms": 120.41537498589605, "ttft_ms": 23.246916942298412, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1325481984, "backend_memory": {"mlx_active_bytes": 12924146696, "mlx_peak_bytes": 12966352124, "mlx_cache_bytes": 15161725981, "process_rss_bytes": 1325481984}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12966352124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "30f3297ae6afd45ae0a8f68f", "attempt_id": "f74e124100db", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:10.743921Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 37, "compress_ms": 61.89770810306072}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 37, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.08962506148964, "doc_prefill_ms": 663.4379579918459, "compress_ms": 66.17324997205287, "serialize_ms": 10.692834039218724, "load_ms": 0.5917920498177409, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.74604207277298, "ttft_ms": 26.74604207277298, "decode_ms": 13.817791012115777}, "total_wall_ms": 122.65725003089756, "ttft_ms": 26.74604207277298, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1325498368, "backend_memory": {"mlx_active_bytes": 12924146696, "mlx_peak_bytes": 12968334588, "mlx_cache_bytes": 15194084381, "process_rss_bytes": 1325498368}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968334588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8f67f32e0f21b28d8dee1d3", "attempt_id": "6cba48c16489", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:10.889179Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 51, "compress_ms": 64.10779093857855}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 51, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.15708296746016, "doc_prefill_ms": 663.4379579918459, "compress_ms": 68.19995900150388, "serialize_ms": 8.739333949051797, "load_ms": 1.4679160667583346, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.175292066298425, "ttft_ms": 23.175292066298425, "decode_ms": 82.95266597997397}, "total_wall_ms": 189.15933300741017, "ttft_ms": 23.175292066298425, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 51}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1325498368, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981310732, "mlx_cache_bytes": 15222363165, "process_rss_bytes": 1325498368}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981310732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "931295", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "0291810ef629db45b8dd44dbd2ffb05f6ec39daa8fe059b1ab9f757164cabc41"} | ||||
| 1455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6f0ead3013f3ac5a385507f4", "attempt_id": "be4eb132605b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:11.101704Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 44, "compress_ms": 63.51379200350493}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.52624999172986, "doc_prefill_ms": 663.4379579918459, "compress_ms": 67.84987507853657, "serialize_ms": 8.445832994766533, "load_ms": 1.3669999316334724, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.661458933725953, "ttft_ms": 22.661458933725953, "decode_ms": 124.6502089779824}, "total_wall_ms": 229.61837507318705, "ttft_ms": 22.661458933725953, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1325514752, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12974281980, "mlx_cache_bytes": 15230293021, "process_rss_bytes": 1325514752}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12974281980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,875,883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "a8243b862e2d82445ca3c93eec5e829e5d41cfa4d9abfba7b18d922fdebba636"} | ||||
| 1456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db22e1a616540efa127f34fe", "attempt_id": "166795803c6c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:11.354255Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 54, "compress_ms": 64.17641695588827}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 54, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.00287504121661, "doc_prefill_ms": 663.4379579918459, "compress_ms": 68.51975002791733, "serialize_ms": 8.273500017821789, "load_ms": 1.4122079592198133, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.656334029510617, "ttft_ms": 23.656334029510617, "decode_ms": 82.86075002979487}, "total_wall_ms": 189.47191699407995, "ttft_ms": 23.656334029510617, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1325514752, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12984128792, "mlx_cache_bytes": 15268074525, "process_rss_bytes": 1325514752}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12984128792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78c217e2e84363ba0fe5c230", "attempt_id": "ee943d43ac84", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:11.566350Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 47, "compress_ms": 63.22795804589987}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.62845898792148, "doc_prefill_ms": 663.4379579918459, "compress_ms": 67.35133402980864, "serialize_ms": 8.06016696151346, "load_ms": 1.4599170535802841, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.499082959257066, "ttft_ms": 22.499082959257066, "decode_ms": 96.02554200682789}, "total_wall_ms": 200.0804579583928, "ttft_ms": 22.499082959257066, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1325514752, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976755964, "mlx_cache_bytes": 15268074525, "process_rss_bytes": 1325514752}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976755964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4049898", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "c9aab9ce6873cd034920ad471f590c3d3a135d58f9fa52aaf8f56051155d1452"} | ||||
| 1458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa15da692317e52592da68e8", "attempt_id": "e4a964d381ed", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:11.789349Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 44, "compress_ms": 62.84345802851021}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.81850001588464, "doc_prefill_ms": 663.4379579918459, "compress_ms": 67.10116600152105, "serialize_ms": 8.495458983816206, "load_ms": 1.4667499344795942, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.62325002811849, "ttft_ms": 22.62325002811849, "decode_ms": 109.68975001014769}, "total_wall_ms": 214.0208340715617, "ttft_ms": 22.62325002811849, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 44}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1325514752, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12974281980, "mlx_cache_bytes": 15268074525, "process_rss_bytes": 1325514752}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12974281980, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27910000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "fb439adcaed5b8db5b5a20e7ff874643d112a267be98039efcf2c8c2838f1572"} | ||||
| 1459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e70834e320e649c345dd0c04", "attempt_id": "18d2110a6aba", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:12.026525Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 47, "compress_ms": 61.79529207292944}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.31145790219307, "doc_prefill_ms": 663.4379579918459, "compress_ms": 66.09466602094471, "serialize_ms": 9.986500022932887, "load_ms": 1.4003330143168569, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.61904103215784, "ttft_ms": 22.61904103215784, "decode_ms": 13.755666906945407}, "total_wall_ms": 118.53391688782722, "ttft_ms": 22.61904103215784, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1325514752, "backend_memory": {"mlx_active_bytes": 12924146696, "mlx_peak_bytes": 12976755964, "mlx_cache_bytes": 15269254173, "process_rss_bytes": 1325514752}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976755964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5320d3a78dabcc3830211068", "attempt_id": "5d1bd7cc9a87", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:12.167655Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5826, "keep": 1456, "window_tokens": 49, "compress_ms": 63.82920895703137}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 49, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 53673984, "serialized_payload_bytes": 53690212, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.10387499537319, "doc_prefill_ms": 663.4379579918459, "compress_ms": 68.3652920415625, "serialize_ms": 8.4661670261994, "load_ms": 1.4951250050216913, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.080665967427194, "ttft_ms": 23.080665967427194, "decode_ms": 13.61166697461158}, "total_wall_ms": 119.68812497798353, "ttft_ms": 23.080665967427194, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1325531136, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12979918092, "mlx_cache_bytes": 15286359069, "process_rss_bytes": 1325531136}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979918092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dec6a55a4ed4c7d8f7eaccfbcdc67701f6fd1739817816d60e1525fa0019b356", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0b94fa24fab7692e5ad1ff53", "attempt_id": "4435dbefc738", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:12.343583Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 2.52229196485132, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.333374997600913, "ttft_ms": 28.333374997600913, "decode_ms": 153.8904170738533}, "total_wall_ms": 188.92600003164262, "ttft_ms": 28.333374997600913, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13175953320, "mlx_cache_bytes": 15470697933, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13175953320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 1462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "350432fd7e39d73a73223339", "attempt_id": "f2bfb18831d8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:12.555054Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 35, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 2.2334579844027758, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.07437495701015, "ttft_ms": 27.07437495701015, "decode_ms": 15.4468750115484}, "total_wall_ms": 49.257999984547496, "ttft_ms": 27.07437495701015, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13149263016, "mlx_cache_bytes": 15523257805, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13149263016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dc8d99e0a83169326bdd96aa", "attempt_id": "96b959074aab", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:12.626893Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 37, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 1.840209006331861, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.325166971422732, "ttft_ms": 27.325166971422732, "decode_ms": 15.723583986982703}, "total_wall_ms": 49.218583037145436, "ttft_ms": 27.325166971422732, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13153997992, "mlx_cache_bytes": 15578832333, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13153997992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3023512d22955eefe47b4268", "attempt_id": "ad6f3b269b9c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:12.699068Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 51, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 1.8892500083893538, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.342332923784852, "ttft_ms": 28.342332923784852, "decode_ms": 92.82029198948294}, "total_wall_ms": 127.23033304791898, "ttft_ms": 28.342332923784852, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 51}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13184749944, "mlx_cache_bytes": 15655855133, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13184749944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "931295", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "0291810ef629db45b8dd44dbd2ffb05f6ec39daa8fe059b1ab9f757164cabc41"} | ||||
| 1465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "96c89d0492b05a9a54c44ebe", "attempt_id": "b10cfe012340", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:12.849692Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 2.058875048533082, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.00187503453344, "ttft_ms": 28.00187503453344, "decode_ms": 140.01537498552352}, "total_wall_ms": 174.53799990471452, "ttft_ms": 28.00187503453344, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13169332376, "mlx_cache_bytes": 15722046493, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13169332376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,418,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "0c81bdc5a7cd40d6d4b0c52dc5fc252e6a9579c7b15fd2d5c7cfa4590ccab621"} | ||||
| 1466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea6c9ac4a5c5c70f2de38221", "attempt_id": "253f18b67ca7", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:13.050862Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 54, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 2.12991691660136, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.38687493931502, "ttft_ms": 28.38687493931502, "decode_ms": 91.5876249782741}, "total_wall_ms": 126.61908392328769, "ttft_ms": 28.38687493931502, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13191707860, "mlx_cache_bytes": 15804324797, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13191707860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db971fad0b530b61d67b0e10", "attempt_id": "168f0f260200", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:13.200914Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 2.4169159587472677, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.043624944984913, "ttft_ms": 28.043624944984913, "decode_ms": 107.51954093575478}, "total_wall_ms": 142.31374999508262, "ttft_ms": 28.043624944984913, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13175951960, "mlx_cache_bytes": 15804324797, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13175951960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4049894", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "10e7c3d5f40baf39e3d264b595b5de0ba9362a8442a7c401cc2bca225451a6c2"} | ||||
| 1468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6105d4edd8d6988f46b63e79", "attempt_id": "2a63419913b8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:13.367602Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 44, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 1.9853750709444284, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.062625089660287, "ttft_ms": 28.062625089660287, "decode_ms": 107.05787490587682}, "total_wall_ms": 141.63033408112824, "ttft_ms": 28.062625089660287, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13169332056, "mlx_cache_bytes": 15804324797, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13169332056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2791000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "0c575ff3e3bf3721bb70e765da5ab7edd6de912e4759657ea5350e4adb602b5a"} | ||||
| 1469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f6a80a79f182c8b664181b3", "attempt_id": "03385aa2707e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:13.532089Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 47, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 2.3314589634537697, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.778708026744425, "ttft_ms": 27.778708026744425, "decode_ms": 15.400083037093282}, "total_wall_ms": 49.687416991218925, "ttft_ms": 27.778708026744425, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13175951960, "mlx_cache_bytes": 15804324797, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13175951960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a626b47c4406e9c0cf27cfef", "attempt_id": "a16a4879bbbb", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:13.604758Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12932092936}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5787, "source_tokens_receiver": 5787, "query_tokens": 49, "message_tokens": 5826, "message_utf8_bytes": 29147, "cache_tensor_bytes": 114096384, "serialized_payload_bytes": 114130709, "side_information_bytes": 34325, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.290833001956344, "doc_prefill_ms": 663.4379579918459, "compress_ms": 11.522041982971132, "serialize_ms": 21.414541057311, "load_ms": 2.3877499625086784, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.223916073329747, "ttft_ms": 28.223916073329747, "decode_ms": 15.273124910891056}, "total_wall_ms": 50.2586659276858, "ttft_ms": 28.223916073329747, "input_usage": {"receiver_prefix_tokens": 5826, "dense_cache_bytes": 214769664, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1555349504, "backend_memory": {"mlx_active_bytes": 13047698440, "mlx_peak_bytes": 13180718680, "mlx_cache_bytes": 15804324797, "process_rss_bytes": 1555349504}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13180718680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5357a175fc44a86cb5864ba0515bcec0159d43d2000509fd4b4393e7a88530a4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e1abfc9c92ec1f0e7d6db4cc", "attempt_id": "785fd20862e4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:13.759892Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5708, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 751.8442500149831, "ttft_ms": 16.13662496674806, "decode_ms": 108.61666698474437}, "total_wall_ms": 884.326666011475, "ttft_ms": 16.13662496674806, "input_usage": {"receiver_prompt_tokens": 5708}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1328578560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13743952948, "mlx_cache_bytes": 2687344984, "process_rss_bytes": 1328578560}, "peak_prefill_memory": null, "peak_decode_memory": 13743952948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 1472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7a6f2b81dcc7806d95942e7", "attempt_id": "72cff9af4e5d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:14.668947Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5698, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 821.2390419794247, "ttft_ms": 15.735915978439152, "decode_ms": 31.10275010112673}, "total_wall_ms": 875.8381669176742, "ttft_ms": 15.735915978439152, "input_usage": {"receiver_prompt_tokens": 5698}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1328578560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13741528116, "mlx_cache_bytes": 3061358936, "process_rss_bytes": 1328578560}, "peak_prefill_memory": null, "peak_decode_memory": 13741528116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "987a228f350964582291d9fa", "attempt_id": "779e65a065e1", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:15.566064Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5700, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 825.550000066869, "ttft_ms": 15.762916998937726, "decode_ms": 30.97466705366969}, "total_wall_ms": 879.9910839879885, "ttft_ms": 15.762916998937726, "input_usage": {"receiver_prompt_tokens": 5700}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1328578560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13742085172, "mlx_cache_bytes": 3435929944, "process_rss_bytes": 1328578560}, "peak_prefill_memory": null, "peak_decode_memory": 13742085172, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4f4609a8d8df6d094275d35a", "attempt_id": "00a8b89353e6", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:16.467610Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5714, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 782.263416913338, "ttft_ms": 15.756167005747557, "decode_ms": 46.16591695230454}, "total_wall_ms": 851.8769160145894, "ttft_ms": 15.756167005747557, "input_usage": {"receiver_prompt_tokens": 5714}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1328578560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13745411124, "mlx_cache_bytes": 3843613016, "process_rss_bytes": 1328578560}, "peak_prefill_memory": null, "peak_decode_memory": 13745411124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "908,840", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "5586148a639432471ebd7436ec7cac938df1c463b9028fee6e42104fbd084dbb"} | ||||
| 1475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "76d93206cbb2c5868639b66a", "attempt_id": "fb969bf65956", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:17.341080Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5707, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 782.3586669983342, "ttft_ms": 15.719834016636014, "decode_ms": 76.82533306069672}, "total_wall_ms": 882.8398749465123, "ttft_ms": 15.719834016636014, "input_usage": {"receiver_prompt_tokens": 5707}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1328578560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13783503924, "mlx_cache_bytes": 3902988632, "process_rss_bytes": 1328578560}, "peak_prefill_memory": null, "peak_decode_memory": 13783503924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,418,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "0c81bdc5a7cd40d6d4b0c52dc5fc252e6a9579c7b15fd2d5c7cfa4590ccab621"} | ||||
| 1476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "05c349abfd2e899634f361d9", "attempt_id": "0d198fbd0e10", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:18.245365Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5717, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 777.3976660100743, "ttft_ms": 15.825791982933879, "decode_ms": 92.50008303206414}, "total_wall_ms": 893.4100000187755, "ttft_ms": 15.825791982933879, "input_usage": {"receiver_prompt_tokens": 5717}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1328578560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746066484, "mlx_cache_bytes": 4281393496, "process_rss_bytes": 1328578560}, "peak_prefill_memory": null, "peak_decode_memory": 13746066484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27f1be2281c79a80f2093389", "attempt_id": "aced4ed66e6e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:19.160211Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5710, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 780.6984160561115, "ttft_ms": 15.766166965477169, "decode_ms": 77.0487500121817}, "total_wall_ms": 881.1147499363869, "ttft_ms": 15.766166965477169, "input_usage": {"receiver_prompt_tokens": 5710}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1328578560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13744149556, "mlx_cache_bytes": 4439957848, "process_rss_bytes": 1328578560}, "peak_prefill_memory": null, "peak_decode_memory": 13744149556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,911,305", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "09d381ac1a189f3b2f1c493defe63b9aef07e03f06cf7010beb3c3bccdc378ed"} | ||||
| 1478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c0bcc7aadd07ef214721166c", "attempt_id": "30eb9c4ae0d5", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:20.062262Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5707, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 788.8716249726713, "ttft_ms": 15.810208045877516, "decode_ms": 46.28954199142754}, "total_wall_ms": 859.0303750243038, "ttft_ms": 15.810208045877516, "input_usage": {"receiver_prompt_tokens": 5707}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1328594944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13793416244, "mlx_cache_bytes": 4439957848, "process_rss_bytes": 1328594944}, "peak_prefill_memory": null, "peak_decode_memory": 13793416244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27.91", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "9b43a35f7af535fe465a736e09bab6cc02fe773b9165f17d38f53e5a3257cbcc"} | ||||
| 1479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5f7d37d78853e40fd5ffe1ab", "attempt_id": "c5446b219691", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:20.942298Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5710, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 793.2393338996917, "ttft_ms": 15.676499926485121, "decode_ms": 15.523666981607676}, "total_wall_ms": 832.4323330307379, "ttft_ms": 15.676499926485121, "input_usage": {"receiver_prompt_tokens": 5710}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1328594944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13744149556, "mlx_cache_bytes": 4439957848, "process_rss_bytes": 1328594944}, "peak_prefill_memory": null, "peak_decode_memory": 13744149556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "377bde6348a93aebaa7f81aa", "attempt_id": "8791d929f3f4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:21.796200Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 5712, "message_tokens": 5602, "message_utf8_bytes": 29147, "cache_tensor_bytes": null, "serialized_payload_bytes": 29147, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009375042282044888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 820.651917019859, "ttft_ms": 15.775041072629392, "decode_ms": 15.153667074628174}, "total_wall_ms": 859.3277919571847, "ttft_ms": 15.775041072629392, "input_usage": {"receiver_prompt_tokens": 5712}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1328594944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13784749108, "mlx_cache_bytes": 4658291032, "process_rss_bytes": 1328594944}, "peak_prefill_memory": null, "peak_decode_memory": 13784749108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b439e49db458d8f56cfd2137", "attempt_id": "5dce7c1f7e64", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:31.073364Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.17895798850805, "ttft_ms": 13.603125000372529, "decode_ms": 13.577374978922307}, "total_wall_ms": 106.82162502780557, "ttft_ms": 13.603125000372529, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329070080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 6697976588, "process_rss_bytes": 1329070080}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b0562335976ed75a68dcd8fb", "attempt_id": "23c21b9b529f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:31.202498Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.36212510988116, "ttft_ms": 13.607083004899323, "decode_ms": 27.196542010642588}, "total_wall_ms": 118.23791696224362, "ttft_ms": 13.607083004899323, "input_usage": {"receiver_prompt_tokens": 612, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1329070080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037641228, "mlx_cache_bytes": 7040303884, "process_rss_bytes": 1329070080}, "peak_prefill_memory": null, "peak_decode_memory": 13037641228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db7a7e84770ea7e1ddb86210", "attempt_id": "85258d74663e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:31.342125Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.5828340081498, "ttft_ms": 13.762166956439614, "decode_ms": 26.906499988399446}, "total_wall_ms": 118.30333294346929, "ttft_ms": 13.762166956439614, "input_usage": {"receiver_prompt_tokens": 614, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1329070080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198284, "mlx_cache_bytes": 7221183244, "process_rss_bytes": 1329070080}, "peak_prefill_memory": null, "peak_decode_memory": 13038198284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce2c10d7ce6e77d20b1afcfc", "attempt_id": "ff9884c551ce", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:31.481605Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 628, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.26895797532052, "ttft_ms": 13.736790977418423, "decode_ms": 41.12629091832787}, "total_wall_ms": 133.2857080269605, "ttft_ms": 13.736790977418423, "input_usage": {"receiver_prompt_tokens": 628, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1329070080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046619684, "mlx_cache_bytes": 7595756760, "process_rss_bytes": 1329070080}, "peak_prefill_memory": null, "peak_decode_memory": 13046619684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "908,840", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "5586148a639432471ebd7436ec7cac938df1c463b9028fee6e42104fbd084dbb"} | ||||
| 1485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93d63d46809d88c5bf8f0d4d", "attempt_id": "fa436785b5b1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:31.635922Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.03033299185336, "ttft_ms": 13.715249951928854, "decode_ms": 14.048040960915387}, "total_wall_ms": 106.0125419171527, "ttft_ms": 13.715249951928854, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329070080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 7595756760, "process_rss_bytes": 1329070080}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "858d460960c1eebbacce2cae", "attempt_id": "a5586ba1fcc2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:31.763315Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.79687503352761, "ttft_ms": 13.69225000962615, "decode_ms": 13.568249996751547}, "total_wall_ms": 106.31420800928026, "ttft_ms": 13.69225000962615, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329070080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 7948523184, "process_rss_bytes": 1329070080}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "60a70e94f3d506e86ab41c28", "attempt_id": "6e52120f2311", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:31.891715Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.96887489873916, "ttft_ms": 13.651166926138103, "decode_ms": 398.48379197064787}, "total_wall_ms": 490.2585829840973, "ttft_ms": 13.651166926138103, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 29}, "provider_cached_usage": null, "process_memory": 1329070080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 8297207472, "process_rss_bytes": 1329070080}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,798,825 + 5,782,865 + 892,005 + 944,615 = 12,517,420", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "39a44e5d786ffe25defde9b99555a099bb52ff66161adceb7f7668147811bc50"} | ||||
| 1488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c136f449def1cd82119f8d66", "attempt_id": "23b851bf9df0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:32.403668Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.14562502223998, "ttft_ms": 13.573292060755193, "decode_ms": 13.846832909621298}, "total_wall_ms": 106.09550005756319, "ttft_ms": 13.573292060755193, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329086464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 8297207472, "process_rss_bytes": 1329086464}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7d5db55e3895244196a7ebe2", "attempt_id": "69850835c42b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:32.531589Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.7133750487119, "ttft_ms": 13.508083065971732, "decode_ms": 13.8092499691993}, "total_wall_ms": 105.16337491571903, "ttft_ms": 13.508083065971732, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329086464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 8297207472, "process_rss_bytes": 1329086464}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47f40f4c260354e90c91eed6", "attempt_id": "e5be202f39eb", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:32.658617Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 1898, "cache_tensor_bytes": null, "serialized_payload_bytes": 1898, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8396.409041015431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.60979095473886, "ttft_ms": 13.505707960575819, "decode_ms": 13.551041949540377}, "total_wall_ms": 105.78320792410523, "ttft_ms": 13.505707960575819, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 5736, "sender_output_tokens": 512, "sender_prefill_ms": 800.5984160117805, "sender_ttft_ms": 15.831834054552019, "sender_decode_ms": 7571.019875002094}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329086464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077028388, "mlx_cache_bytes": 8458589872, "process_rss_bytes": 1329086464}, "peak_prefill_memory": null, "peak_decode_memory": 13077028388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3de2d8697fa951fc20ce77d46f31f3258733f69abed8edc22f208a4fc8a6e7ce", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c595585fc00975f5126676ff", "attempt_id": "d58e6a59ff9a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.044202Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 421, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.272792047820985, "ttft_ms": 13.64641694817692, "decode_ms": 13.574459007941186}, "total_wall_ms": 87.45458396151662, "ttft_ms": 13.64641694817692, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12897934424, "mlx_cache_bytes": 9106593456, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12897934424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f83381344109c04057aede2", "attempt_id": "e7bb9cbd6840", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.153836Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 411, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.341083995997906, "ttft_ms": 13.462375034578145, "decode_ms": 27.130750007927418}, "total_wall_ms": 93.7600830802694, "ttft_ms": 13.462375034578145, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12892331096, "mlx_cache_bytes": 9305773744, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12892331096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed163d8ecfcab9fe11d727c2", "attempt_id": "565d18cd1c83", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.269935Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 413, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.60616703890264, "ttft_ms": 13.541041989810765, "decode_ms": 13.309333939105272}, "total_wall_ms": 80.33312496263534, "ttft_ms": 13.541041989810765, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12893592664, "mlx_cache_bytes": 9536476848, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12893592664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e574e8b944d16f28a2fca88d", "attempt_id": "040f5510236b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.371980Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 427, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.89137494098395, "ttft_ms": 13.720083050429821, "decode_ms": 13.482874957844615}, "total_wall_ms": 83.98012502584606, "ttft_ms": 13.720083050429821, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901309528, "mlx_cache_bytes": 9790756528, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12901309528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "12100d3f55259fb5039cc2e3", "attempt_id": "9f23efde5547", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.478008Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 420, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.35904206428677, "ttft_ms": 13.464750023558736, "decode_ms": 13.490375014953315}, "total_wall_ms": 84.16008297353983, "ttft_ms": 13.464750023558736, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12897934424, "mlx_cache_bytes": 9790756528, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12897934424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a02dedf71eace9537172cb15", "attempt_id": "6091f8c7f433", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.583623Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 430, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.00050005502999, "ttft_ms": 13.493208098225296, "decode_ms": 14.044916024431586}, "total_wall_ms": 83.36475002579391, "ttft_ms": 13.493208098225296, "input_usage": {"receiver_prompt_tokens": 430, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902947928, "mlx_cache_bytes": 10030798512, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12902947928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38ee225787438179c635d03f", "attempt_id": "4dfa70fd1f0c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.688320Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 423, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.9418749762699, "ttft_ms": 13.589249923825264, "decode_ms": 68.0438750423491}, "total_wall_ms": 138.41991708613932, "ttft_ms": 13.589249923825264, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12920708184, "mlx_cache_bytes": 10181301936, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12920708184, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,798,825", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "e7e36aab80fc1e7d17301aae114cf8ebbecbd383a78b049686bd60729f4bcfbd"} | ||||
| 1498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d5ed7a1b55f1b641a59c91e0", "attempt_id": "4a881138b06a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.847758Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 420, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.02404202707112, "ttft_ms": 13.57287506107241, "decode_ms": 13.888541958294809}, "total_wall_ms": 83.30462500452995, "ttft_ms": 13.57287506107241, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12897934424, "mlx_cache_bytes": 10181301936, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12897934424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8b319d1f104c65fbb571d35d", "attempt_id": "1500bf60bb6a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:41.952390Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 423, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.18983292859048, "ttft_ms": 13.396750087849796, "decode_ms": 13.496999978087842}, "total_wall_ms": 82.86950003821403, "ttft_ms": 13.396750087849796, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12925951064, "mlx_cache_bytes": 10181301936, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12925951064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "33c0da0e5a83f1e046d868cf", "attempt_id": "27eee1a759fb", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:42.056415Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 425, "message_tokens": 299, "message_utf8_bytes": 825, "cache_tensor_bytes": null, "serialized_payload_bytes": 825, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8258.060749969445, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.73020805604756, "ttft_ms": 13.435167027637362, "decode_ms": 13.704750104807317}, "total_wall_ms": 83.67958304006606, "ttft_ms": 13.435167027637362, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 5766, "sender_output_tokens": 512, "sender_prefill_ms": 672.1125829499215, "sender_ttft_ms": 14.85091692302376, "sender_decode_ms": 7566.564750042744}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12900490328, "mlx_cache_bytes": 10264663728, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 12900490328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5a548765a3a66444ac0174765731aaf0a4bbae8be2b12226f9b25004a5c0fa6b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2280dcc5e582208538be992c", "attempt_id": "84808e3454bb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:42.165854Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 618, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.98504091240466, "ttft_ms": 13.941125012934208, "decode_ms": 13.658792013302445}, "total_wall_ms": 105.78220908064395, "ttft_ms": 13.941125012934208, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071801868, "mlx_cache_bytes": 10484733616, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13071801868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "82668d1f5da431bb745f7c21", "attempt_id": "a7ee31b23f15", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:42.292111Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 608, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.74791700951755, "ttft_ms": 14.76704201195389, "decode_ms": 27.104167034849524}, "total_wall_ms": 117.66550003085285, "ttft_ms": 14.76704201195389, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034528268, "mlx_cache_bytes": 10727544496, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13034528268, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d12e119f4e5852294d05d788", "attempt_id": "ce53af6b9f71", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:42.430945Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 610, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.12099999096245, "ttft_ms": 13.768209028057754, "decode_ms": 27.575416024774313}, "total_wall_ms": 118.51716600358486, "ttft_ms": 13.768209028057754, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067263500, "mlx_cache_bytes": 10884798128, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13067263500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8c502cb1484922b02e185d7", "attempt_id": "6e7faacdfc62", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:42.570699Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 624, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.97554095648229, "ttft_ms": 13.579583028331399, "decode_ms": 41.11004201695323}, "total_wall_ms": 132.83825002145022, "ttft_ms": 13.579583028331399, "input_usage": {"receiver_prompt_tokens": 624}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 10884798128, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "908,840", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "5586148a639432471ebd7436ec7cac938df1c463b9028fee6e42104fbd084dbb"} | ||||
| 1505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "337ad681222d9dff5478a997", "attempt_id": "d52c674656e1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:42.724465Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 617, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.75154192838818, "ttft_ms": 13.612082926556468, "decode_ms": 67.92316597420722}, "total_wall_ms": 159.29487498942763, "ttft_ms": 13.612082926556468, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040180748, "mlx_cache_bytes": 11009693360, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13040180748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,418,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "0c81bdc5a7cd40d6d4b0c52dc5fc252e6a9579c7b15fd2d5c7cfa4590ccab621"} | ||||
| 1506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3df6d23a2170b9ffc19ad361", "attempt_id": "3ec082834fa8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:42.905131Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 627, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.67708296887577, "ttft_ms": 13.607917004264891, "decode_ms": 81.04745799209923}, "total_wall_ms": 173.399040941149, "ttft_ms": 13.607917004264891, "input_usage": {"receiver_prompt_tokens": 627}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13084941860, "mlx_cache_bytes": 11009693360, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13084941860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd31ada7f8fa22ebe0469695", "attempt_id": "8aa03ae84626", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:43.100510Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 620, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.88287505879998, "ttft_ms": 13.546000001952052, "decode_ms": 67.51249998342246}, "total_wall_ms": 158.9402499375865, "ttft_ms": 13.546000001952052, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042179596, "mlx_cache_bytes": 11131393712, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13042179596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,911,220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "30a1462e8af8da7f894acba4fe548dfdc29b3e32074ee66178e953d0325055b8"} | ||||
| 1508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2e26efd57eb4e32e8967fa77", "attempt_id": "575be1a35cb2", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:43.280574Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 617, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.38612505979836, "ttft_ms": 13.654583017341793, "decode_ms": 13.553707976825535}, "total_wall_ms": 104.58541696425527, "ttft_ms": 13.654583017341793, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040180748, "mlx_cache_bytes": 11131393712, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13040180748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5b522bd34e54e2499f0ded4e", "attempt_id": "c85344f49a68", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:43.406775Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 620, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.94904110394418, "ttft_ms": 13.499166001565754, "decode_ms": 13.730459031648934}, "total_wall_ms": 105.15762493014336, "ttft_ms": 13.499166001565754, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042179596, "mlx_cache_bytes": 11131393712, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13042179596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d699de0a6d825bca2aa6c6a5", "attempt_id": "da6383c6a2fc", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:43.532933Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 512, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 622, "message_tokens": 511, "message_utf8_bytes": 1563, "cache_tensor_bytes": null, "serialized_payload_bytes": 1563, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.236625041812658, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.815125066787, "ttft_ms": 13.51412502117455, "decode_ms": 13.66441696882248}, "total_wall_ms": 104.9932079622522, "ttft_ms": 13.51412502117455, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1329201152, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 11131393712, "process_rss_bytes": 1329201152}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "084515d3120282e0492c5de6402ef3334a9d3a4e54f3e9fa75a86b40a24c5aa6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d57e3baedba1138ac7c37cb5", "attempt_id": "07d8edb0582e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:44.366423Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 46, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 2.0065830321982503, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.72420795634389, "ttft_ms": 22.72420795634389, "decode_ms": 103.04725007154047}, "total_wall_ms": 131.85095798689872, "ttft_ms": 22.72420795634389, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13666505960, "mlx_cache_bytes": 10880020513, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13666505960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 1512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "92795e4831e28ae2154c0a01", "attempt_id": "1a5a456f3457", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:44.520268Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 36, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 1.9535840256139636, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.468582959845662, "ttft_ms": 22.468582959845662, "decode_ms": 14.654250000603497}, "total_wall_ms": 43.230250012129545, "ttft_ms": 22.468582959845662, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13602051080, "mlx_peak_bytes": 13657609448, "mlx_cache_bytes": 11116539937, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13657609448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7d644fb28f03efa5056533b6", "attempt_id": "04b0cf313e55", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:44.585410Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 38, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 1.975625054910779, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.385874995961785, "ttft_ms": 22.385874995961785, "decode_ms": 14.530416927300394}, "total_wall_ms": 42.738249991089106, "ttft_ms": 22.385874995961785, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13602051080, "mlx_peak_bytes": 13659149544, "mlx_cache_bytes": 11143835681, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13659149544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "08026ef3fcb3857b2978c53d", "attempt_id": "e1e57450c2fe", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:44.650302Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 52, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 2.000040956772864, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.820916910655797, "ttft_ms": 21.820916910655797, "decode_ms": 43.29220799263567}, "total_wall_ms": 71.16354198660702, "ttft_ms": 21.820916910655797, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 52}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13670929664, "mlx_cache_bytes": 11171183697, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13670929664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "469147b9096ca76595ba03d6e8e849959829de7be9f36bbb9e437b35a34af4c5"} | ||||
| 1515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7e67c3830ac850d39d53f81", "attempt_id": "15241f379777", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:44.743089Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 45, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 1.3554170727729797, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.34400005545467, "ttft_ms": 22.34400005545467, "decode_ms": 72.1209580078721}, "total_wall_ms": 99.63433293160051, "ttft_ms": 22.34400005545467, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13668472040, "mlx_cache_bytes": 11185519697, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13668472040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,261,755", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "acc393ce9c579e5c986bee8239ce29d18ef04f4d0850296ede5e6db2a591dbdb"} | ||||
| 1516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a625772f5fffa7dcc9ac7d1", "attempt_id": "10141af2af33", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:44.864254Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 55, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 1.8754159100353718, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.450082935392857, "ttft_ms": 22.450082935392857, "decode_ms": 87.98212499823421}, "total_wall_ms": 116.21325009036809, "ttft_ms": 22.450082935392857, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13672715532, "mlx_cache_bytes": 11436165594, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13672715532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e090a7a8b6032affd13886c9", "attempt_id": "53242f008900", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.002177Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 48, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 2.045166911557317, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.863500005565584, "ttft_ms": 21.863500005565584, "decode_ms": 72.52904202323407}, "total_wall_ms": 100.29670794028789, "ttft_ms": 21.863500005565584, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13667439872, "mlx_cache_bytes": 11458841050, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13667439872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,775,411", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "4f1d5fb9ed98f133732ca15c3a2eae409c73bacc05c72928bcc8a5f7e34ceac6"} | ||||
| 1518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6cd6810d26c413a494c3e9de", "attempt_id": "1efb7f345d8e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.123892Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 45, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 2.028374932706356, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.173666046001017, "ttft_ms": 22.173666046001017, "decode_ms": 28.806166956201196}, "total_wall_ms": 56.82912503834814, "ttft_ms": 22.173666046001017, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13668439272, "mlx_cache_bytes": 11458841050, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13668439272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5868d293b970e9852d00f891", "attempt_id": "dc4ca9b29fdc", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.202276Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 48, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 2.007792005315423, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.758166956715286, "ttft_ms": 21.758166956715286, "decode_ms": 28.776375111192465}, "total_wall_ms": 56.3595830462873, "ttft_ms": 21.758166956715286, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 48}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13667439872, "mlx_cache_bytes": 11458841050, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13667439872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 1520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27781fa3f8692b8acd210700", "attempt_id": "f84507446a1a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.280013Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435065352}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5662, "keep": 1416, "compress_ms": 9.646959020756185}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 50, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411318, "side_information_bytes": 13110, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 706.4333750167862, "doc_prefill_ms": 659.1745000332594, "compress_ms": 9.683832991868258, "serialize_ms": 29.151833965443075, "load_ms": 2.0423750393092632, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.680291905999184, "ttft_ms": 22.680291905999184, "decode_ms": 14.420958003029227}, "total_wall_ms": 43.20829198695719, "ttft_ms": 22.680291905999184, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1654030336, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13672305920, "mlx_cache_bytes": 11484613082, "process_rss_bytes": 1654030336}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13672305920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c7592042e2d5ad55dbe703289551276da5dbf9772febaa82f7c9f32bcd25a98f", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1521 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a8a7c2742abc4220d7dfa539", "attempt_id": "3643554e7d27", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.344938Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 46, "compress_ms": 86.48150006774813}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 46, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 120.6723329378292, "doc_prefill_ms": 659.1745000332594, "compress_ms": 90.24887497071177, "serialize_ms": 30.241083004511893, "load_ms": 1.7817498883232474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.48866606876254, "ttft_ms": 21.48866606876254, "decode_ms": 100.41770793031901}, "total_wall_ms": 248.46170900855213, "ttft_ms": 21.48866606876254, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1654947840, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13666505960, "mlx_cache_bytes": 12865079874, "process_rss_bytes": 1654947840}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13666505960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 1522 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e6dd749ba349f3e96b747596", "attempt_id": "66a62d7cdf23", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.615645Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 36, "compress_ms": 77.0877500763163}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 36, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411357, "side_information_bytes": 13149, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 108.36499999277294, "doc_prefill_ms": 659.1745000332594, "compress_ms": 81.10087504610419, "serialize_ms": 27.068583061918616, "load_ms": 1.8187499372288585, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.358167054131627, "ttft_ms": 21.358167054131627, "decode_ms": 29.20170803554356}, "total_wall_ms": 164.78716698475182, "ttft_ms": 21.358167054131627, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1817346048, "backend_memory": {"mlx_active_bytes": 13602051080, "mlx_peak_bytes": 13657609448, "mlx_cache_bytes": 12891982402, "process_rss_bytes": 1817346048}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13657609448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74785674185c0400d02a354ed9c8c206577b036cce5b20bbdeb8252072b28f95", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1523 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "60a580d2820bff67e42ddc4a", "attempt_id": "7d8eae3a5b2a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.803636Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 38, "compress_ms": 77.24854198750108}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 38, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.30504090618342, "doc_prefill_ms": 659.1745000332594, "compress_ms": 81.27433410845697, "serialize_ms": 22.836791933514178, "load_ms": 1.7361249774694443, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.786332971416414, "ttft_ms": 24.786332971416414, "decode_ms": 28.925416991114616}, "total_wall_ms": 163.82970800623298, "ttft_ms": 24.786332971416414, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1817378816, "backend_memory": {"mlx_active_bytes": 13602051080, "mlx_peak_bytes": 13659133160, "mlx_cache_bytes": 12927863362, "process_rss_bytes": 1817378816}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13659133160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1524 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5b8485f0a78eb70576253cd3", "attempt_id": "d38da18729b8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:45.989890Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 52, "compress_ms": 78.98020802531391}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 52, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.47770804259926, "doc_prefill_ms": 659.1745000332594, "compress_ms": 82.76899997144938, "serialize_ms": 22.5317080039531, "load_ms": 1.6485840314999223, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.136458031833172, "ttft_ms": 21.136458031833172, "decode_ms": 43.3201250853017}, "total_wall_ms": 175.64591707196087, "ttft_ms": 21.136458031833172, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 52}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1817395200, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13670929664, "mlx_cache_bytes": 12961827394, "process_rss_bytes": 1817395200}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13670929664, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "931,295", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "2a7fc9c11bafb9f078eeebdb6ef745c73bc462712e82c1adebdf9dc483e4d7ed"} | ||||
| 1525 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9895c2c3130eba5043b7f267", "attempt_id": "490651f664e1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:46.188596Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 45, "compress_ms": 78.35716707631946}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 45, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.21895794570446, "doc_prefill_ms": 659.1745000332594, "compress_ms": 82.18270807992667, "serialize_ms": 21.853458019904792, "load_ms": 0.9912910172715783, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.71224995981902, "ttft_ms": 21.71224995981902, "decode_ms": 72.20312498975545}, "total_wall_ms": 203.16420798189938, "ttft_ms": 21.71224995981902, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1817427968, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13668406504, "mlx_cache_bytes": 12987402818, "process_rss_bytes": 1817427968}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13668406504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,418,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "0c81bdc5a7cd40d6d4b0c52dc5fc252e6a9579c7b15fd2d5c7cfa4590ccab621"} | ||||
| 1526 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a4fc350b11357da31c77f5a7", "attempt_id": "05c1c6ea870b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:46.414995Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 55, "compress_ms": 79.61054192855954}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 55, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.93137494288385, "doc_prefill_ms": 659.1745000332594, "compress_ms": 83.43754103407264, "serialize_ms": 22.306500002741814, "load_ms": 1.4892499893903732, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.82245790027082, "ttft_ms": 21.82245790027082, "decode_ms": 86.65945800021291}, "total_wall_ms": 220.03641701303422, "ttft_ms": 21.82245790027082, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1817427968, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13672715532, "mlx_cache_bytes": 13037718082, "process_rss_bytes": 1817427968}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13672715532, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1527 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "786200ec532c4d2ee428a0ad", "attempt_id": "58d61c099b7c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:46.657836Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 48, "compress_ms": 78.64212500862777}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 48, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.37479196116328, "doc_prefill_ms": 659.1745000332594, "compress_ms": 82.44745794218034, "serialize_ms": 21.749042090959847, "load_ms": 1.7731670523062348, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.4105419581756, "ttft_ms": 21.4105419581756, "decode_ms": 73.25662509538233}, "total_wall_ms": 204.91720794234425, "ttft_ms": 21.4105419581756, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1817427968, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13667439872, "mlx_cache_bytes": 13064735298, "process_rss_bytes": 1817427968}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13667439872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,911,305", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "09d381ac1a189f3b2f1c493defe63b9aef07e03f06cf7010beb3c3bccdc378ed"} | ||||
| 1528 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e60589210f5e896817a63cc", "attempt_id": "78b64412f5ae", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:46.885835Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 45, "compress_ms": 77.61791604571044}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 45, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.82987500634044, "doc_prefill_ms": 659.1745000332594, "compress_ms": 81.40274998731911, "serialize_ms": 22.252042079344392, "load_ms": 1.8707079580053687, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.83583308942616, "ttft_ms": 21.83583308942616, "decode_ms": 43.15287503413856}, "total_wall_ms": 174.78862509597093, "ttft_ms": 21.83583308942616, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1817427968, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13668406504, "mlx_cache_bytes": 13064735298, "process_rss_bytes": 1817427968}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13668406504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27.91", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "9b43a35f7af535fe465a736e09bab6cc02fe773b9165f17d38f53e5a3257cbcc"} | ||||
| 1529 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f785a9ec190ac90e2fa4d302", "attempt_id": "3bf3bdd64d11", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:47.083869Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 48, "compress_ms": 77.83762505277991}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 48, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.99883310310543, "doc_prefill_ms": 659.1745000332594, "compress_ms": 81.91545901354402, "serialize_ms": 21.902458043769002, "load_ms": 1.8483750754967332, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.340916980989277, "ttft_ms": 21.340916980989277, "decode_ms": 14.323874958790839}, "total_wall_ms": 145.564749953337, "ttft_ms": 21.340916980989277, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1817427968, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13667439872, "mlx_cache_bytes": 13064735298, "process_rss_bytes": 1817427968}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13667439872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1530 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "89d09cf1c91c2f720e355c84", "attempt_id": "f71ab7cc38fb", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:47.252596Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5662, "keep": 1416, "window_tokens": 50, "compress_ms": 79.26633395254612}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 50, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 162398208, "serialized_payload_bytes": 162411358, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.83158298302442, "doc_prefill_ms": 659.1745000332594, "compress_ms": 83.35216692648828, "serialize_ms": 21.298083011060953, "load_ms": 1.9197919173166156, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.916166064329445, "ttft_ms": 21.916166064329445, "decode_ms": 14.519582968205214}, "total_wall_ms": 147.27337507065386, "ttft_ms": 21.916166064329445, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1817427968, "backend_memory": {"mlx_active_bytes": 13603886088, "mlx_peak_bytes": 13669192960, "mlx_cache_bytes": 13102500418, "process_rss_bytes": 1817427968}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 13669192960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3e97f873e472ec359bc40d17b3445efeccba3b6ee18431f3d45e7da1b78b6fa1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1531 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3e3b90fde7e192f91896ffd0", "attempt_id": "eed4702c2347", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:47.505134Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 46, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 6.431334069930017, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.473707963712513, "ttft_ms": 28.473707963712513, "decode_ms": 116.8558329809457}, "total_wall_ms": 155.61687503941357, "ttft_ms": 28.473707963712513, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2161000448, "backend_memory": {"mlx_active_bytes": 13969970184, "mlx_peak_bytes": 14144883936, "mlx_cache_bytes": 14306871234, "process_rss_bytes": 2161000448}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14144883936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "XX-43W-9874", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "0ab6d0ab000bed72bda142906dbe114882d3e55d9e45808c6f2ae838a7201194"} | ||||
| 1532 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4dc0a1a62437f845efab569f", "attempt_id": "561c94257a2d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:47.683578Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 36, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 3.1442909967154264, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.9166249781847, "ttft_ms": 26.9166249781847, "decode_ms": 33.08958397246897}, "total_wall_ms": 66.99874997138977, "ttft_ms": 26.9166249781847, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2161000448, "backend_memory": {"mlx_active_bytes": 13969052680, "mlx_peak_bytes": 14123071880, "mlx_cache_bytes": 14308202946, "process_rss_bytes": 2161000448}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14123071880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1533 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd70f2e7f262f363ad0b6a59", "attempt_id": "90aea10f168a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:47.772556Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 38, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 3.1160409562289715, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.228375081904233, "ttft_ms": 27.228375081904233, "decode_ms": 33.00579194910824}, "total_wall_ms": 67.20783293712884, "ttft_ms": 27.228375081904233, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2161000448, "backend_memory": {"mlx_active_bytes": 13969052680, "mlx_peak_bytes": 14127561352, "mlx_cache_bytes": 14370630850, "process_rss_bytes": 2161000448}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14127561352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1534 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ca501a6f74feab14d9d10c9", "attempt_id": "5baa35f0cf09", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:47.861606Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 52, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 3.0342499958351254, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.22120802011341, "ttft_ms": 28.22120802011341, "decode_ms": 49.380708020180464}, "total_wall_ms": 84.41233297344297, "ttft_ms": 28.22120802011341, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 52}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2161000448, "backend_memory": {"mlx_active_bytes": 13969970184, "mlx_peak_bytes": 14159091080, "mlx_cache_bytes": 14456032578, "process_rss_bytes": 2161000448}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14159091080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "908,840", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "5586148a639432471ebd7436ec7cac938df1c463b9028fee6e42104fbd084dbb"} | ||||
| 1535 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ddd3e5128a32ce2b9d9a4a30", "attempt_id": "8fd6a0635292", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:47.967687Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 45, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 2.9015420004725456, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.12495909165591, "ttft_ms": 28.12495909165591, "decode_ms": 82.27700006682426}, "total_wall_ms": 117.16391600202769, "ttft_ms": 28.12495909165591, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2161000448, "backend_memory": {"mlx_active_bytes": 13969052680, "mlx_peak_bytes": 14146535468, "mlx_cache_bytes": 14530972994, "process_rss_bytes": 2161000448}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14146535468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,418,930", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "0c81bdc5a7cd40d6d4b0c52dc5fc252e6a9579c7b15fd2d5c7cfa4590ccab621"} | ||||
| 1536 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1591b1b8017f877407f011d", "attempt_id": "0a3bd33e91b2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:48.106783Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 55, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 3.0942499870434403, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.783416957594454, "ttft_ms": 28.783416957594454, "decode_ms": 98.65916706621647}, "total_wall_ms": 134.42333391867578, "ttft_ms": 28.783416957594454, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2161115136, "backend_memory": {"mlx_active_bytes": 13969970184, "mlx_peak_bytes": 14165268340, "mlx_cache_bytes": 14620700578, "process_rss_bytes": 2161115136}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14165268340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Talrukzen-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "9041e679e0dc555d4dca7cbc8cb2fe87a4a6c585d285d3f25d893d4426665c0b"} | ||||
| 1537 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9f4b3d4e6a3de5468ac96aa0", "attempt_id": "95a5937c3398", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:48.263573Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 48, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 2.9459999641403556, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.094833018258214, "ttft_ms": 28.094833018258214, "decode_ms": 81.98633301071823}, "total_wall_ms": 116.94499989971519, "ttft_ms": 28.094833018258214, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2161115136, "backend_memory": {"mlx_active_bytes": 13969970184, "mlx_peak_bytes": 14148487168, "mlx_cache_bytes": 14699638690, "process_rss_bytes": 2161115136}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14148487168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,911,305", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "09d381ac1a189f3b2f1c493defe63b9aef07e03f06cf7010beb3c3bccdc378ed"} | ||||
| 1538 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c588b80801fa9c090f1dc9b6", "attempt_id": "e2125d0a02c0", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:48.402553Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 45, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 2.732624998316169, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.554167085327208, "ttft_ms": 27.554167085327208, "decode_ms": 49.57608296535909}, "total_wall_ms": 83.99874996393919, "ttft_ms": 27.554167085327208, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2161115136, "backend_memory": {"mlx_active_bytes": 13969052680, "mlx_peak_bytes": 14146534028, "mlx_cache_bytes": 14700556194, "process_rss_bytes": 2161115136}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14146534028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27.91", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "9b43a35f7af535fe465a736e09bab6cc02fe773b9165f17d38f53e5a3257cbcc"} | ||||
| 1539 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b8f2b6013c171d677e29a85", "attempt_id": "aa15f6006cbb", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:48.508646Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 48, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 3.0000420520082116, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.807250036858022, "ttft_ms": 27.807250036858022, "decode_ms": 16.515374998562038}, "total_wall_ms": 51.12462490797043, "ttft_ms": 27.807250036858022, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2161115136, "backend_memory": {"mlx_active_bytes": 13969052680, "mlx_peak_bytes": 14148487168, "mlx_cache_bytes": 14700556194, "process_rss_bytes": 2161115136}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14148487168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1540 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "81c8d0be47addd0ae67da7fa", "attempt_id": "d1b8926544f3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:48.581195Z", "task_family": "synthetic", "document_id": "syn_03010_8000", "document_hash": "8beb6214b362911c46f5db753e36cc61c5444a7d8ea3c267dd1346c90c9d36f7", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03010_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13619483656}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5602, "source_tokens_receiver": 5602, "query_tokens": 50, "message_tokens": 5662, "message_utf8_bytes": 29147, "cache_tensor_bytes": 344974336, "serialized_payload_bytes": 345001672, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 81.44495903979987, "doc_prefill_ms": 659.1745000332594, "compress_ms": 17.620750004425645, "serialize_ms": 63.54875001125038, "load_ms": 3.1385000329464674, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.202750021591783, "ttft_ms": 28.202750021591783, "decode_ms": 16.514375107362866}, "total_wall_ms": 51.69445893261582, "ttft_ms": 28.202750021591783, "input_usage": {"receiver_prefix_tokens": 5662, "dense_cache_bytes": 649363456, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2161115136, "backend_memory": {"mlx_active_bytes": 13969970184, "mlx_peak_bytes": 14153877504, "mlx_cache_bytes": 14781919138, "process_rss_bytes": 2161115136}, "peak_prefill_memory": 13732516916, "peak_decode_memory": 14153877504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03010_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bc766f78646f7b5b19e5c0b210cd155fe3be48b9e083998aa6c02d80455d9564", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1541 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8350c7900b83722ca724dfde", "attempt_id": "3e9b6ed50fdf", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:48.731543Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11053, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1443.8420829828829, "ttft_ms": 14.723000000230968, "decode_ms": 158.24649995192885}, "total_wall_ms": 1633.3481250330806, "ttft_ms": 14.723000000230968, "input_usage": {"receiver_prompt_tokens": 11053}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 3909165496, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1542 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ffeeebebc8cb733bc58cd192", "attempt_id": "dbf2e56701f4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:50.395718Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11043, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1445.9899589419365, "ttft_ms": 14.731917064636946, "decode_ms": 14.345832983963192}, "total_wall_ms": 1491.0064169671386, "ttft_ms": 14.731917064636946, "input_usage": {"receiver_prompt_tokens": 11043}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4380975544, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1543 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c507d336fd22982ccc200a9b", "attempt_id": "7224f1b66228", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:51.916830Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11043, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1505.185083951801, "ttft_ms": 14.813457964919508, "decode_ms": 14.876791974529624}, "total_wall_ms": 1551.7876249505207, "ttft_ms": 14.813457964919508, "input_usage": {"receiver_prompt_tokens": 11043}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4380975544, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1544 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd61edec6e77e55dfed5d08e", "attempt_id": "2d2309cf2748", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:53.498709Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11060, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1607.7754169236869, "ttft_ms": 14.847041922621429, "decode_ms": 102.28875000029802}, "total_wall_ms": 1741.014042054303, "ttft_ms": 14.847041922621429, "input_usage": {"receiver_prompt_tokens": 11060}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4882932152, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1503470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "e3df67b3104b1329eab2ba218a7372145e48d640dad2dce1e2137901d213aace"} | ||||
| 1545 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fd2530d9e937af62a4d8d2ea", "attempt_id": "9537b2979a70", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:55.270287Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11052, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1656.2732079764828, "ttft_ms": 15.162458992563188, "decode_ms": 102.76762500870973}, "total_wall_ms": 1790.2917079627514, "ttft_ms": 15.162458992563188, "input_usage": {"receiver_prompt_tokens": 11052}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5097234872, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6170900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "1dfef964379de3fc3976241f833cc930541f8e7a286e4748ca57742014803c42"} | ||||
| 1546 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "088392077e512dfaa8d646d2", "attempt_id": "a606c34d3776", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:57.090990Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11059, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1692.69016594626, "ttft_ms": 15.127499937079847, "decode_ms": 59.23229199834168}, "total_wall_ms": 1783.4399580024183, "ttft_ms": 15.127499937079847, "input_usage": {"receiver_prompt_tokens": 11059}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5217853880, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Volpra-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "4650fe7263e3dc5e8cde393bc0bc3966e7981ebef5bb2ad746643be133a118cc"} | ||||
| 1547 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52f5d4a67fabffb452597733", "attempt_id": "f914c8d4eb0d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:56:58.904225Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11055, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1679.1227910434827, "ttft_ms": 14.931875048205256, "decode_ms": 102.44179202709347}, "total_wall_ms": 1812.6033749431372, "ttft_ms": 14.931875048205256, "input_usage": {"receiver_prompt_tokens": 11055}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5586395576, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4148575", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "4f3d39afe645a97a94dd0018496cd550e5dfb4ecfa8785b1292ba2197ffbdaa0"} | ||||
| 1548 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "94c1e849311e42a7d9a18175", "attempt_id": "0f10e056a433", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:00.747070Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11050, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1718.586041009985, "ttft_ms": 14.980000094510615, "decode_ms": 73.45083297695965}, "total_wall_ms": 1823.547000065446, "ttft_ms": 14.980000094510615, "input_usage": {"receiver_prompt_tokens": 11050}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5919646136, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "7809c66195b3c8c85f1934a9da49128692bb2fddc1545bb947af900c6d8cbd72"} | ||||
| 1549 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "60bb44530bb3fe1c5e50a1ff", "attempt_id": "7afd4b183a00", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:02.600349Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11055, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1725.0862499931827, "ttft_ms": 14.83475009445101, "decode_ms": 14.847832964733243}, "total_wall_ms": 1770.8635000744835, "ttft_ms": 14.83475009445101, "input_usage": {"receiver_prompt_tokens": 11055}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5919646136, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1550 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "331b9258cd03bbec01ed930a", "attempt_id": "6537ebc3940a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:04.400908Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11057, "message_tokens": 10969, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.021958956494927406, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1722.1509580267593, "ttft_ms": 15.016332967206836, "decode_ms": 15.267916023731232}, "total_wall_ms": 1768.5507499845698, "ttft_ms": 15.016332967206836, "input_usage": {"receiver_prompt_tokens": 11057}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739276288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6255649208, "process_rss_bytes": 1739276288}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1551 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b378a3e25a1a90e113883830", "attempt_id": "f4b786de79ba", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:15.261123Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.56633301544935, "ttft_ms": 13.072874979116023, "decode_ms": 145.87866701185703}, "total_wall_ms": 230.69145798217505, "ttft_ms": 13.072874979116023, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 8040072632, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1552 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8e74692facee182a0d3fdecc", "attempt_id": "82a72222c671", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:15.522937Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.83058305922896, "ttft_ms": 13.140707975253463, "decode_ms": 13.448084006085992}, "total_wall_ms": 97.4783330457285, "ttft_ms": 13.140707975253463, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990014552, "mlx_cache_bytes": 8384824760, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12990014552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1553 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cc80d15879cc70692ab88a9f", "attempt_id": "a3faa6c8feaa", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:15.650852Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 591, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.4683330366388, "ttft_ms": 13.283209060318768, "decode_ms": 13.296541990712285}, "total_wall_ms": 97.2020000917837, "ttft_ms": 13.283209060318768, "input_usage": {"receiver_prompt_tokens": 591, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990014552, "mlx_cache_bytes": 8384824760, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12990014552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1554 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "527b2e95046a39e52e51e64e", "attempt_id": "568f74f4de95", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:15.778225Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.7967079943046, "ttft_ms": 13.466125004924834, "decode_ms": 13.23649997357279}, "total_wall_ms": 98.63241703715175, "ttft_ms": 13.466125004924834, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997551192, "mlx_cache_bytes": 8754349496, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12997551192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1555 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "089887ab90d36b6c8e9d1035", "attempt_id": "108688a12bf0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:15.907304Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.23462490178645, "ttft_ms": 13.292708899825811, "decode_ms": 106.8752920255065}, "total_wall_ms": 191.5152920410037, "ttft_ms": 13.292708899825811, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992767064, "mlx_cache_bytes": 8912618936, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12992767064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "30860000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "e75fc1e2955c6255581d1e8e2f95513a8edafcf9fef52c11a57f03563f422d0c"} | ||||
| 1556 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "95ec6f149dc7fdf506c5c6cc", "attempt_id": "863d1d216dec", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:16.128723Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.09554200340062, "ttft_ms": 13.411917025223374, "decode_ms": 52.62487498112023}, "total_wall_ms": 137.2529590735212, "ttft_ms": 13.411917025223374, "input_usage": {"receiver_prompt_tokens": 607, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997354584, "mlx_cache_bytes": 9001977272, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12997354584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Volpra-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "4650fe7263e3dc5e8cde393bc0bc3966e7981ebef5bb2ad746643be133a118cc"} | ||||
| 1557 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "986063e0ca5c5ad1ee0d6584", "attempt_id": "01c9d56a19cf", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:16.296283Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.17408299725503, "ttft_ms": 13.191583915613592, "decode_ms": 92.52970793750137}, "total_wall_ms": 177.0830419845879, "ttft_ms": 13.191583915613592, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010183256, "mlx_cache_bytes": 9272067512, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 13010183256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1472400", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "7bee48316d4a71f8a9f002996417a9f3ae318b2645c6160932748026b51546a5"} | ||||
| 1558 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8f3b51915b33dd3a52812fe0", "attempt_id": "bbabedfa5abf", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:16.503966Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 598, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.9785000178963, "ttft_ms": 13.302415958605707, "decode_ms": 79.91704100277275}, "total_wall_ms": 164.35266693588346, "ttft_ms": 13.302415958605707, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994438232, "mlx_cache_bytes": 9518024120, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12994438232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27330 kW", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 0.6666666666666666}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "0daffa3b6fed06b59a96d99c16e06d9c8bbd12889b84e498ebbb65ad119abc46"} | ||||
| 1559 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1bb0e6e70e2002c707c79cf5", "attempt_id": "54856c2cca38", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:16.699249Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.03154198173434, "ttft_ms": 13.365083956159651, "decode_ms": 13.151374994777143}, "total_wall_ms": 97.69808396231383, "ttft_ms": 13.365083956159651, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 9518024120, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1560 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38e1db0fe1be5f08089cfdc7", "attempt_id": "771fcb2caf00", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:16.827384Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1625, "cache_tensor_bytes": null, "serialized_payload_bytes": 1625, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9061.744875041768, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.3379170736298, "ttft_ms": 13.418167014606297, "decode_ms": 13.316917000338435}, "total_wall_ms": 98.20916689932346, "ttft_ms": 13.418167014606297, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1727.8639159630984, "sender_ttft_ms": 14.884999953210354, "sender_decode_ms": 7310.97154202871}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739292672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996125784, "mlx_cache_bytes": 9766733240, "process_rss_bytes": 1739292672}, "peak_prefill_memory": null, "peak_decode_memory": 12996125784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "074fe81e49533a11fb095dfff660d39c12b70c43beb0da2bcdc8d592c1485526", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1561 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4e701bd41ece73219e4a4eae", "attempt_id": "b5c78d5df98e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:25.842556Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 409, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.395832957699895, "ttft_ms": 13.150207931175828, "decode_ms": 13.763165916316211}, "total_wall_ms": 80.28033399023116, "ttft_ms": 13.150207931175828, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12940909264, "mlx_cache_bytes": 10625649688, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12940909264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1562 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3bcf21123db8a222344dd02", "attempt_id": "3e984db66b05", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:25.954378Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 399, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.99095804709941, "ttft_ms": 13.197749969549477, "decode_ms": 13.910042005591094}, "total_wall_ms": 79.94137506466359, "ttft_ms": 13.197749969549477, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12933438160, "mlx_cache_bytes": 10937535512, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12933438160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1563 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "492363ca624b2f902773dd33", "attempt_id": "dd62c1d7c660", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.064851Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 399, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.93279206287116, "ttft_ms": 13.123542070388794, "decode_ms": 13.223582995124161}, "total_wall_ms": 79.09291610121727, "ttft_ms": 13.123542070388794, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12933438160, "mlx_cache_bytes": 10937535512, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12933438160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1564 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c4a020725bf9bde7ce1dc101", "attempt_id": "777ef235f46d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.174576Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 416, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.32058302499354, "ttft_ms": 13.042874983511865, "decode_ms": 13.685915968380868}, "total_wall_ms": 79.9907500622794, "ttft_ms": 13.042874983511865, "input_usage": {"receiver_prompt_tokens": 416, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12946447084, "mlx_cache_bytes": 11276227220, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12946447084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1565 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f4902572e2299954d8c31e2a", "attempt_id": "d87ff7212ec2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.285478Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 408, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.074290928430855, "ttft_ms": 13.029791065491736, "decode_ms": 13.204165967181325}, "total_wall_ms": 79.27745906636119, "ttft_ms": 13.029791065491736, "input_usage": {"receiver_prompt_tokens": 408, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12945431248, "mlx_cache_bytes": 11424633492, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12945431248, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1566 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35cf5dcc5a4f9541547e2bad", "attempt_id": "d790b3fb975d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.394768Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 415, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.11612500716001, "ttft_ms": 13.604208012111485, "decode_ms": 13.12995795160532}, "total_wall_ms": 79.68841609545052, "ttft_ms": 13.604208012111485, "input_usage": {"receiver_prompt_tokens": 415, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12946184940, "mlx_cache_bytes": 11506029204, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12946184940, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1567 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b92ff770089f67f5ac52cb39", "attempt_id": "d2148d8f9e35", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.504679Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 411, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.33658303041011, "ttft_ms": 13.264124980196357, "decode_ms": 13.216792023740709}, "total_wall_ms": 79.68800002709031, "ttft_ms": 13.264124980196357, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12962831108, "mlx_cache_bytes": 11732767380, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12962831108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1568 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "18574168855f3f111b07510e", "attempt_id": "111d0e53ec62", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.614782Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 406, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.01591597869992, "ttft_ms": 13.400666997767985, "decode_ms": 13.835499994456768}, "total_wall_ms": 80.1312499679625, "ttft_ms": 13.400666997767985, "input_usage": {"receiver_prompt_tokens": 406, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12942678736, "mlx_cache_bytes": 11955327636, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12942678736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1569 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2ff7478af5754e70ea40d26b", "attempt_id": "8d91af80a5af", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.725837Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 411, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.95404205005616, "ttft_ms": 13.209917000494897, "decode_ms": 13.415957917459309}, "total_wall_ms": 79.42037505563349, "ttft_ms": 13.209917000494897, "input_usage": {"receiver_prompt_tokens": 411, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12962831108, "mlx_cache_bytes": 11955327636, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12962831108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1570 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "de3442665eb78064d7947488", "attempt_id": "77752c810ef8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.835228Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 413, "message_tokens": 309, "message_utf8_bytes": 777, "cache_tensor_bytes": null, "serialized_payload_bytes": 777, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8886.207000003196, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.356791915372014, "ttft_ms": 13.443665928207338, "decode_ms": 13.178624911233783}, "total_wall_ms": 79.8064999980852, "ttft_ms": 13.443665928207338, "input_usage": {"receiver_prompt_tokens": 413, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1562.9029580159113, "sender_ttft_ms": 14.752708957530558, "sender_decode_ms": 7299.617625074461}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739358208, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12944530156, "mlx_cache_bytes": 12181557908, "process_rss_bytes": 1739358208}, "peak_prefill_memory": null, "peak_decode_memory": 12944530156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e84b146b28f827ccfb9f72797e708d9b27528225836d37fdb932d1abfb0073d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1571 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f5764a5c375452fc2c80f64c", "attempt_id": "c131625910f6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:26.952724Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 592, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.18920802511275, "ttft_ms": 13.620208948850632, "decode_ms": 13.139292015694082}, "total_wall_ms": 97.94449992477894, "ttft_ms": 13.620208948850632, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990604376, "mlx_cache_bytes": 12425056916, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 12990604376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1572 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8b887d16f9bbe22f55594c7a", "attempt_id": "633e603edfac", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:27.080772Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 582, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.67916595749557, "ttft_ms": 14.08779202029109, "decode_ms": 13.567832997068763}, "total_wall_ms": 98.32533297594637, "ttft_ms": 14.08779202029109, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12984607832, "mlx_cache_bytes": 12779147924, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 12984607832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1573 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1e3fbed6070f1ad9e94521b5", "attempt_id": "5e3030dc9328", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:27.209120Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 582, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.46679099928588, "ttft_ms": 13.40995798818767, "decode_ms": 13.085291953757405}, "total_wall_ms": 96.95720893796533, "ttft_ms": 13.40995798818767, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12984607832, "mlx_cache_bytes": 12779147924, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 12984607832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1574 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "48498bec4239c3304e402ffd", "attempt_id": "8244b461519f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:27.336638Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 599, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.15445898286998, "ttft_ms": 13.691625092178583, "decode_ms": 94.12033297121525}, "total_wall_ms": 178.9783340645954, "ttft_ms": 13.691625092178583, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994929752, "mlx_cache_bytes": 12867326612, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 12994929752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1503470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "e3df67b3104b1329eab2ba218a7372145e48d640dad2dce1e2137901d213aace"} | ||||
| 1575 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "afc7e26faf5f87ab4333778e", "attempt_id": "cb204fd5c4c8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:27.545610Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 591, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.529291940853, "ttft_ms": 13.411874999292195, "decode_ms": 92.23349997773767}, "total_wall_ms": 176.20612494647503, "ttft_ms": 13.411874999292195, "input_usage": {"receiver_prompt_tokens": 591}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990014552, "mlx_cache_bytes": 12867326612, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 12990014552, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6170900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "1dfef964379de3fc3976241f833cc930541f8e7a286e4748ca57742014803c42"} | ||||
| 1576 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6da0464befcf80846dabec9b", "attempt_id": "5c91e87c824f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:27.752036Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 598, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.51654201839119, "ttft_ms": 13.553666067309678, "decode_ms": 53.130249958485365}, "total_wall_ms": 137.22258294001222, "ttft_ms": 13.553666067309678, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994438232, "mlx_cache_bytes": 12867326612, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 12994438232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-4", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "38c5908aee7f4a12514df8a23189a4aadf570c62345067fae24a44f51824ea73"} | ||||
| 1577 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7dc07326615f5ff9926b8676", "attempt_id": "5fa584872e5c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:27.918984Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 594, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.2534590382129, "ttft_ms": 13.660582946613431, "decode_ms": 132.73441698402166}, "total_wall_ms": 217.6757080014795, "ttft_ms": 13.660582946613431, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012182104, "mlx_cache_bytes": 13133484692, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 13012182104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "17,118,195", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "14df4c8ff75bf1b6c8298ab086a95687206b02b585c179d5e8563ffc7bccddaa"} | ||||
| 1578 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3028001f1f3e5bd77df054ec", "attempt_id": "620c7f594716", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:28.167330Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 589, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.90412494633347, "ttft_ms": 13.087375089526176, "decode_ms": 13.408166938461363}, "total_wall_ms": 97.40299999248236, "ttft_ms": 13.087375089526176, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989326424, "mlx_cache_bytes": 13375705748, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 12989326424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1579 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d8967e7b051558c83359e567", "attempt_id": "647d2a3dc302", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:28.295556Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 594, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.85795800574124, "ttft_ms": 13.144167023710907, "decode_ms": 13.261209009215236}, "total_wall_ms": 97.22841600887477, "ttft_ms": 13.144167023710907, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009724504, "mlx_cache_bytes": 13375705748, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 13009724504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1580 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff8da777484f2381a4df9db7", "attempt_id": "161bb0a49a23", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:28.423093Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 507, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 596, "message_tokens": 507, "message_utf8_bytes": 1224, "cache_tensor_bytes": null, "serialized_payload_bytes": 1224, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.848167093470693, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.8637500172481, "ttft_ms": 13.245792011730373, "decode_ms": 13.299791957251728}, "total_wall_ms": 97.35745808575302, "ttft_ms": 13.245792011730373, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1739374592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010609240, "mlx_cache_bytes": 13620777620, "process_rss_bytes": 1739374592}, "peak_prefill_memory": null, "peak_decode_memory": 13010609240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc1cedb36990fbf153662fdee2abe27cdad2873eddd42bf00bbb41d8fdadf934", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1581 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3dee889e0876872497a32501", "attempt_id": "585971472187", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:30.102117Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 45, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.753083080984652, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.736374996602535, "ttft_ms": 32.736374996602535, "decode_ms": 155.33087495714426}, "total_wall_ms": 198.24945798609406, "ttft_ms": 32.736374996602535, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 45}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268899060, "mlx_cache_bytes": 14115314662, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268899060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1582 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "965545cfe014b6191988012f", "attempt_id": "e11a3caf5dc0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:30.330357Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 35, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.8978749867528677, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.57004197034985, "ttft_ms": 30.57004197034985, "decode_ms": 14.298707945272326}, "total_wall_ms": 55.241334019228816, "ttft_ms": 30.57004197034985, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13259871476, "mlx_cache_bytes": 14149458918, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13259871476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1583 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "77ca564afffd3817110aeda7", "attempt_id": "259e98c99f5f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:30.416433Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 35, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.953125, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.55337502155453, "ttft_ms": 30.55337502155453, "decode_ms": 14.894000021740794}, "total_wall_ms": 55.34645798616111, "ttft_ms": 30.55337502155453, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13259871476, "mlx_cache_bytes": 14149458918, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13259871476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 1584 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "95e20a20d9d05463e1574242", "attempt_id": "542cd38d01ac", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:30.502288Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 52, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.687082927674055, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.62679194752127, "ttft_ms": 29.62679194752127, "decode_ms": 83.91516597475857}, "total_wall_ms": 123.25116607826203, "ttft_ms": 29.62679194752127, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 52}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13274256656, "mlx_cache_bytes": 14194007430, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274256656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "152000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "0c11920e20235b504309386bb50e33a7479686e3e59099cf0012fc2b1d76475a"} | ||||
| 1585 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c37230ce8090b47cca33cd69", "attempt_id": "ae8876029367", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:30.655884Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 44, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.8980000168085098, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.67879199422896, "ttft_ms": 29.67879199422896, "decode_ms": 70.3243330353871}, "total_wall_ms": 110.35200010519475, "ttft_ms": 29.67879199422896, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268604148, "mlx_cache_bytes": 14207393158, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268604148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "50000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "60734f174b2035e5b2ba85fef8c648cc0cb18c5995b419d3cd1c025c5b09d0c7"} | ||||
| 1586 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8a4bcec53a37e523a315b9a", "attempt_id": "49d3d5a6e04f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:30.796498Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 51, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.8960420275107026, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.56699996907264, "ttft_ms": 31.56699996907264, "decode_ms": 56.25137500464916}, "total_wall_ms": 97.60420804377645, "ttft_ms": 31.56699996907264, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 51}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13273945360, "mlx_cache_bytes": 14222892422, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273945360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Volpra-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "4650fe7263e3dc5e8cde393bc0bc3966e7981ebef5bb2ad746643be133a118cc"} | ||||
| 1587 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28e570a7ae919a2d1eedc546", "attempt_id": "3d440e873684", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:30.924427Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.9815419800579548, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.969624989666045, "ttft_ms": 30.969624989666045, "decode_ms": 98.61279197502881}, "total_wall_ms": 139.52979096211493, "ttft_ms": 30.969624989666045, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270308112, "mlx_cache_bytes": 14222892422, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270308112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1472400", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "7bee48316d4a71f8a9f002996417a9f3ae318b2645c6160932748026b51546a5"} | ||||
| 1588 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4f2c624af75600081a9bf8be", "attempt_id": "b987d5d15457", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:31.095789Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 42, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.9962080987170339, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.54962505120784, "ttft_ms": 30.54962505120784, "decode_ms": 56.33649998344481}, "total_wall_ms": 96.84737492352724, "ttft_ms": 30.54962505120784, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 42}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13269882100, "mlx_cache_bytes": 14252465542, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13269882100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1200", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "15197cf7214b58e67cae565e573ffd9aa44bcb81f8ee5d7185dfe8da0a16ef43"} | ||||
| 1589 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2db4be63b073c28c70114e86", "attempt_id": "b87f5909dbba", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:31.223316Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 2.0372499711811543, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.57812508288771, "ttft_ms": 31.57812508288771, "decode_ms": 14.530000044032931}, "total_wall_ms": 56.128540891222656, "ttft_ms": 31.57812508288771, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270308112, "mlx_cache_bytes": 14252465542, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270308112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1590 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7bf667cb3e50fc0b95780c24", "attempt_id": "c831bb095623", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:31.309126Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.494082980789244}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 49, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466008, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1551.515582948923, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 11.534375022165477, "serialize_ms": 22.332874941639602, "load_ms": 1.9290000200271606, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.192958005703986, "ttft_ms": 31.192958005703986, "decode_ms": 14.368333970196545}, "total_wall_ms": 55.351334041915834, "ttft_ms": 31.192958005703986, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1837727744, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13272290576, "mlx_cache_bytes": 14271929734, "process_rss_bytes": 1837727744}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272290576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "02c1e2afde0d415f136a728695a7be90f8f30b23162f4392b28a9219cd72ded9", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1591 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "06d7dda160eda053a8534b61", "attempt_id": "6da8cef85369", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:31.395045Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 45, "compress_ms": 102.57087496574968}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 45, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466048, "side_information_bytes": 16320, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 133.5720829665661, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 110.94991711433977, "serialize_ms": 22.4972500000149, "load_ms": 1.8804999999701977, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.157916946336627, "ttft_ms": 30.157916946336627, "decode_ms": 153.9725000038743}, "total_wall_ms": 327.7772089932114, "ttft_ms": 30.157916946336627, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 45}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1838940160, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268899060, "mlx_cache_bytes": 14723522062, "process_rss_bytes": 1838940160}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268899060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59027a476508a59c83089ffe8263c9ca9c0adb45e47ea3ed61dc194f393fc2aa", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1592 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0ace68ae5946e31a6f478add", "attempt_id": "c7b9ed8e4ec5", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:31.753419Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 35, "compress_ms": 88.57424999587238}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 35, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 117.05650005023926, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 97.13050001300871, "serialize_ms": 19.80508305132389, "load_ms": 1.292250002734363, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.817332979291677, "ttft_ms": 29.817332979291677, "decode_ms": 14.312500017695129}, "total_wall_ms": 170.6905000610277, "ttft_ms": 29.817332979291677, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1940389888, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13259871476, "mlx_cache_bytes": 14759386638, "process_rss_bytes": 1940389888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13259871476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1593 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f0c0fed7f3b931bc5a5f8b8b", "attempt_id": "254fa3fbb5a5", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:31.955035Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 35, "compress_ms": 88.29266694374382}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 35, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 111.06179200578481, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 96.65224992204458, "serialize_ms": 14.28249990567565, "load_ms": 1.7295409925282001, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.971124953590333, "ttft_ms": 29.971124953590333, "decode_ms": 13.987166923470795}, "total_wall_ms": 164.89575000014156, "ttft_ms": 29.971124953590333, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1940389888, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13259871476, "mlx_cache_bytes": 14759386638, "process_rss_bytes": 1940389888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13259871476, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1594 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cfa1f2a8bc2c6723692ab5c0", "attempt_id": "9ac6d5d36a5e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:32.151270Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 52, "compress_ms": 91.08033298980445}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 52, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.56191702745855, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 99.01304100640118, "serialize_ms": 15.420999960042536, "load_ms": 1.578250085003674, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.43254099227488, "ttft_ms": 29.43254099227488, "decode_ms": 97.99933305475861}, "total_wall_ms": 252.22170900087804, "ttft_ms": 29.43254099227488, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1940389888, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13274256656, "mlx_cache_bytes": 14812208654, "process_rss_bytes": 1940389888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274256656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1503470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "e3df67b3104b1329eab2ba218a7372145e48d640dad2dce1e2137901d213aace"} | ||||
| 1595 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3bd58ce183febe98326b12fd", "attempt_id": "e08ca4f137a4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:32.434841Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 44, "compress_ms": 89.58874992094934}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 44, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 112.45112505275756, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 97.58604201488197, "serialize_ms": 14.739083009772003, "load_ms": 1.230665948241949, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.066332965157926, "ttft_ms": 29.066332965157926, "decode_ms": 98.03983301389962}, "total_wall_ms": 248.98825003765523, "ttft_ms": 29.066332965157926, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1940389888, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268292852, "mlx_cache_bytes": 14848253454, "process_rss_bytes": 1940389888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268292852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6170225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "2192c7f50802ab7d9f26614d4c7c0565a8faa2ec8e5073b661e14434ef3e8f46"} | ||||
| 1596 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "93c4cff8a6658ce48dc7f77f", "attempt_id": "b945cc209426", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:32.714890Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 51, "compress_ms": 91.58766700420529}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 51, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.17491599079221, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 99.80095794890076, "serialize_ms": 15.25299996137619, "load_ms": 1.546291052363813, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.347124953754246, "ttft_ms": 31.347124953754246, "decode_ms": 56.1971670249477}, "total_wall_ms": 212.46750000864267, "ttft_ms": 31.347124953754246, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 51}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1940389888, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13273945360, "mlx_cache_bytes": 14884183566, "process_rss_bytes": 1940389888}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13273945360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Volpra-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "4650fe7263e3dc5e8cde393bc0bc3966e7981ebef5bb2ad746643be133a118cc"} | ||||
| 1597 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "16c58129c9994d20074e859e", "attempt_id": "f036d6b1577f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:32.958256Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 47, "compress_ms": 90.76854097656906}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.24633301794529, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 99.19691702816635, "serialize_ms": 14.93379205930978, "load_ms": 0.7597499061375856, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.504790949635208, "ttft_ms": 30.504790949635208, "decode_ms": 98.18645904306322}, "total_wall_ms": 251.8978751031682, "ttft_ms": 30.504790949635208, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1940422656, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270308112, "mlx_cache_bytes": 14917295630, "process_rss_bytes": 1940422656}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270308112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4078575", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "3a8cda294c9176def6e2b7719efc9892a9e62e2ad966a1fe4a4d75cc241a1112"} | ||||
| 1598 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8f02f2ce903a4d18532fc9f8", "attempt_id": "415e68c56984", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:33.241896Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 42, "compress_ms": 89.76225007791072}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 42, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 112.7216670429334, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 97.7877089753747, "serialize_ms": 14.807707979343832, "load_ms": 1.7391250003129244, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.871458071283996, "ttft_ms": 29.871458071283996, "decode_ms": 83.87654204852879}, "total_wall_ms": 236.4202500320971, "ttft_ms": 29.871458071283996, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 42}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1940422656, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13267703028, "mlx_cache_bytes": 14947966478, "process_rss_bytes": 1940422656}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13267703028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5432.3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "f440ad05d7e8c40cfa4ffc68c6a55522a37e98f0277004409a245d5c476b09c7"} | ||||
| 1599 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b362bdd8770dd6782cff34e3", "attempt_id": "6c15936849ef", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:33.509970Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 47, "compress_ms": 89.57574993837625}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 112.49733297154307, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 97.53074997570366, "serialize_ms": 14.841958065517247, "load_ms": 1.444249995984137, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.2916249493137, "ttft_ms": 30.2916249493137, "decode_ms": 14.626874937675893}, "total_wall_ms": 167.03054204117507, "ttft_ms": 30.2916249493137, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1940422656, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270308112, "mlx_cache_bytes": 14947966478, "process_rss_bytes": 1940422656}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270308112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1600 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8e0bf7b34c003785061fd2a", "attempt_id": "d848ebf21304", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:33.707706Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 49, "compress_ms": 90.5078750802204}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 49, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466046, "side_information_bytes": 16318, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 113.9329590369016, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 98.34799997042865, "serialize_ms": 15.45954099856317, "load_ms": 1.6018749447539449, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.465333024039865, "ttft_ms": 30.465333024039865, "decode_ms": 13.928749947808683}, "total_wall_ms": 168.62562508322299, "ttft_ms": 30.465333024039865, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1940422656, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13272290576, "mlx_cache_bytes": 14982487566, "process_rss_bytes": 1940422656}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272290576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf1065956912614db2febe5c01f5d64af72dfb61cfacc8b6b3fc8dbc0c547032", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1601 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d4cb88bdac560a5899a12b3d", "attempt_id": "e315ea0cc342", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:33.961462Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 45, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 4.916333011351526, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.14083298109472, "ttft_ms": 37.14083298109472, "decode_ms": 178.51687502115965}, "total_wall_ms": 228.80733397323638, "ttft_ms": 37.14083298109472, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 45}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13643159226, "mlx_cache_bytes": 15572645598, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13643159226, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1602 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f571384b495c59e20b45a62b", "attempt_id": "0d6ff4e11be2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:34.221980Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 35, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.5901669869199395, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.14158399775624, "ttft_ms": 35.14158399775624, "decode_ms": 16.309458063915372}, "total_wall_ms": 62.176749925129116, "ttft_ms": 35.14158399775624, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13608113457, "mlx_cache_bytes": 15671604958, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13608113457, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1603 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28485bc2c35297735abfefae", "attempt_id": "4b82d31cc10c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:34.315312Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 35, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.3417079355567694, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.64575007092208, "ttft_ms": 34.64575007092208, "decode_ms": 16.250459011644125}, "total_wall_ms": 61.73858407419175, "ttft_ms": 34.64575007092208, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13608113457, "mlx_cache_bytes": 15671604958, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13608113457, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1604 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e20ee0a1f3feafd0f50cf59", "attempt_id": "2fef4c3aaef4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:34.407392Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 52, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.627417095936835, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.14520903304219, "ttft_ms": 37.14520903304219, "decode_ms": 113.2161250570789}, "total_wall_ms": 161.1510410439223, "ttft_ms": 37.14520903304219, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13666460185, "mlx_cache_bytes": 15820098974, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13666460185, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1503470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "e3df67b3104b1329eab2ba218a7372145e48d640dad2dce1e2137901d213aace"} | ||||
| 1605 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f0d1fc16f82849c83a0b4a35", "attempt_id": "db2494c40a6a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:34.598779Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 44, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.7717910706996918, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.13983292598277, "ttft_ms": 36.13983292598277, "decode_ms": 113.6767080752179}, "total_wall_ms": 160.66637495532632, "ttft_ms": 36.13983292598277, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13639684474, "mlx_cache_bytes": 15945600414, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13639684474, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6170900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "1dfef964379de3fc3976241f833cc930541f8e7a286e4748ca57742014803c42"} | ||||
| 1606 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7ddbf05fda8642bb3d758d26", "attempt_id": "157e4bcb9f27", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:34.789589Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 51, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.7077909326180816, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.360417074523866, "ttft_ms": 37.360417074523866, "decode_ms": 64.99366706702858}, "total_wall_ms": 113.26187499798834, "ttft_ms": 37.360417074523866, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 51}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13663576601, "mlx_cache_bytes": 16090041758, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13663576601, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Volpra-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "4650fe7263e3dc5e8cde393bc0bc3966e7981ebef5bb2ad746643be133a118cc"} | ||||
| 1607 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8bca367296b8e357c59ffbaf", "attempt_id": "1ac2bcddfb15", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:34.934611Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.754500019364059, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.00895805377513, "ttft_ms": 37.00895805377513, "decode_ms": 114.10729098133743}, "total_wall_ms": 162.2974999481812, "ttft_ms": 37.00895805377513, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13649535513, "mlx_cache_bytes": 16223079838, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13649535513, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4448575", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "a6336c926de27c0ad01112ea48a577d12becf54276aae5f9a2209a6e5f1a6c5a"} | ||||
| 1608 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4b0fde7b996cf2fb5d23aa10", "attempt_id": "d9f2e4731340", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:35.127386Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 42, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.744792029261589, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.08287498354912, "ttft_ms": 36.08287498354912, "decode_ms": 81.05195907410234}, "total_wall_ms": 127.98958399798721, "ttft_ms": 36.08287498354912, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 42}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13635424634, "mlx_cache_bytes": 16341962142, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13635424634, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27330", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "7809c66195b3c8c85f1934a9da49128692bb2fddc1545bb947af900c6d8cbd72"} | ||||
| 1609 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4f83aeeadc06399f9eb51072", "attempt_id": "fec8d9baa4be", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:35.286501Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 2.726334030739963, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.948791006579995, "ttft_ms": 36.948791006579995, "decode_ms": 16.108499956317246}, "total_wall_ms": 63.76237503718585, "ttft_ms": 36.948791006579995, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13649535513, "mlx_cache_bytes": 16341962142, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13649535513, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1610 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf461debd66532609d5dfa86", "attempt_id": "4ae596f47156", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:35.380847Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 49, "message_tokens": 11008, "message_utf8_bytes": 58856, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.932457929477096, "doc_prefill_ms": 1500.4276660038158, "compress_ms": 12.926041963510215, "serialize_ms": 40.723833022639155, "load_ms": 1.8560419557616115, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.258166004903615, "ttft_ms": 37.258166004903615, "decode_ms": 16.278708935715258}, "total_wall_ms": 63.24858299922198, "ttft_ms": 37.258166004903615, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2154807296, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13656908313, "mlx_cache_bytes": 16481308062, "process_rss_bytes": 2154807296}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13656908313, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1611 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1fc1b3482f608861893a3749", "attempt_id": "e67c88cb3871", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:35.555053Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10889, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1497.1917090006173, "ttft_ms": 16.29208296071738, "decode_ms": 127.12241697590798}, "total_wall_ms": 1655.439042020589, "ttft_ms": 16.29208296071738, "input_usage": {"receiver_prompt_tokens": 10889}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1604550656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14285296704, "mlx_cache_bytes": 6174105944, "process_rss_bytes": 1604550656}, "peak_prefill_memory": null, "peak_decode_memory": 14285296704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1612 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ffb8b26ca4665c1937f88eb2", "attempt_id": "5713a0142e20", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:37.242673Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10881, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1550.797167001292, "ttft_ms": 16.72670803964138, "decode_ms": 32.762874965555966}, "total_wall_ms": 1615.3923330130056, "ttft_ms": 16.72670803964138, "input_usage": {"receiver_prompt_tokens": 10881}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1604550656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14282429504, "mlx_cache_bytes": 6413967704, "process_rss_bytes": 1604550656}, "peak_prefill_memory": null, "peak_decode_memory": 14282429504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1613 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c591c6049f469039c96d67c4", "attempt_id": "fb36fedf001d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:38.888292Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10881, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1667.9222909733653, "ttft_ms": 16.60695904865861, "decode_ms": 33.408749965019524}, "total_wall_ms": 1732.4508329620585, "ttft_ms": 16.60695904865861, "input_usage": {"receiver_prompt_tokens": 10881}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1604550656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14282429504, "mlx_cache_bytes": 6413967704, "process_rss_bytes": 1604550656}, "peak_prefill_memory": null, "peak_decode_memory": 14282429504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1614 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3360b5bfa2d47075d35c2804", "attempt_id": "841b78543d07", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:40.649233Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10897, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1727.6072499807924, "ttft_ms": 16.777416924014688, "decode_ms": 83.47808301914483}, "total_wall_ms": 1842.479583923705, "ttft_ms": 16.777416924014688, "input_usage": {"receiver_prompt_tokens": 10897}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604550656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14288360512, "mlx_cache_bytes": 6675947864, "process_rss_bytes": 1604550656}, "peak_prefill_memory": null, "peak_decode_memory": 14288360512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,773,345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "f9f095b26c516c2f6760e8c3cc19b8c785ab7fd7c1724dd894635f88d93c205a"} | ||||
| 1615 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9d19b1a5eec395d6b1301256", "attempt_id": "a31df30a8be0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:42.521203Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10890, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1798.8920420175418, "ttft_ms": 16.8217500904575, "decode_ms": 83.5330419940874}, "total_wall_ms": 1918.7644160119817, "ttft_ms": 16.8217500904575, "input_usage": {"receiver_prompt_tokens": 10890}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604567040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14286214208, "mlx_cache_bytes": 6919545176, "process_rss_bytes": 1604567040}, "peak_prefill_memory": null, "peak_decode_memory": 14286214208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,170,900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "2e16556aa0c4e9bbbb98d5742bc624de2d05f6c31920d18e9500e60aeeb84c74"} | ||||
| 1616 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "696e83e0410590c73cffd3d1", "attempt_id": "c33e870fa757", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:44.468929Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10897, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1774.8089579399675, "ttft_ms": 16.96145802270621, "decode_ms": 66.51858298573643}, "total_wall_ms": 1872.9917919263244, "ttft_ms": 16.96145802270621, "input_usage": {"receiver_prompt_tokens": 10897}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1604583424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14288360512, "mlx_cache_bytes": 6919545176, "process_rss_bytes": 1604583424}, "peak_prefill_memory": null, "peak_decode_memory": 14288360512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-4", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "38c5908aee7f4a12514df8a23189a4aadf570c62345067fae24a44f51824ea73"} | ||||
| 1617 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86f3d9a5a1e989625b0c976a", "attempt_id": "79bbd13b2200", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:46.371029Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10893, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1839.5182500826195, "ttft_ms": 16.860875068232417, "decode_ms": 83.34262506105006}, "total_wall_ms": 1954.3542920146137, "ttft_ms": 16.860875068232417, "input_usage": {"receiver_prompt_tokens": 10893}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604599808, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14311691328, "mlx_cache_bytes": 7079846232, "process_rss_bytes": 1604599808}, "peak_prefill_memory": null, "peak_decode_memory": 14311691328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,458,045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "60a0580de4e60f1ad54b268aa246ed638835b6084853f77493d94e2bfa83d013"} | ||||
| 1618 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "43531b16e4693361367754b4", "attempt_id": "7248d46fc1f0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:48.353780Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10888, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1811.2892908975482, "ttft_ms": 16.798250027932227, "decode_ms": 49.897875054739416}, "total_wall_ms": 1892.7810830064118, "ttft_ms": 16.798250027932227, "input_usage": {"receiver_prompt_tokens": 10888}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1604599808, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14285296704, "mlx_cache_bytes": 7079846232, "process_rss_bytes": 1604599808}, "peak_prefill_memory": null, "peak_decode_memory": 14285296704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27.33", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "112b5e142e51e73c92589563ed886e9c0d15430a8c6ac9e9b02d4138d73e2f7a"} | ||||
| 1619 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "554ef7b70fded2be397f3054", "attempt_id": "6d6433cb2a5a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:50.275147Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10893, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1808.4812499582767, "ttft_ms": 16.771000111475587, "decode_ms": 16.737458063289523}, "total_wall_ms": 1856.7044999217615, "ttft_ms": 16.771000111475587, "input_usage": {"receiver_prompt_tokens": 10893}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604599808, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14311691328, "mlx_cache_bytes": 7079846232, "process_rss_bytes": 1604599808}, "peak_prefill_memory": null, "peak_decode_memory": 14311691328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1620 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e6e89d79aa0301a126ae25b", "attempt_id": "861598098ab3", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:57:52.160414Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 10895, "message_tokens": 10785, "message_utf8_bytes": 58856, "cache_tensor_bytes": null, "serialized_payload_bytes": 58856, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009124982170760632, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1826.1402089847252, "ttft_ms": 16.819957992993295, "decode_ms": 16.750499955378473}, "total_wall_ms": 1874.715083045885, "ttft_ms": 16.819957992993295, "input_usage": {"receiver_prompt_tokens": 10895}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604599808, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14288131136, "mlx_cache_bytes": 7165567320, "process_rss_bytes": 1604599808}, "peak_prefill_memory": null, "peak_decode_memory": 14288131136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1621 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "619880b5efc6d39df41ad992", "attempt_id": "1bcfa03a3a59", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:04.091813Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.24916702136397, "ttft_ms": 13.731583952903748, "decode_ms": 13.524208101443946}, "total_wall_ms": 105.67141696810722, "ttft_ms": 13.731583952903748, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 10378396424, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1622 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2ba5c9b1fd0b9adf63550866", "attempt_id": "9b40e25eaab5", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:04.227210Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.54745900072157, "ttft_ms": 13.505834038369358, "decode_ms": 28.63495796918869}, "total_wall_ms": 119.8204590473324, "ttft_ms": 13.505834038369358, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821448, "mlx_cache_bytes": 10720920328, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13037821448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1623 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "131fe29458c766ef6d2c73e1", "attempt_id": "899a7020f3c9", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:04.375645Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.71995903365314, "ttft_ms": 13.613999937660992, "decode_ms": 26.94229199551046}, "total_wall_ms": 118.36691701319069, "ttft_ms": 13.613999937660992, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821448, "mlx_cache_bytes": 10720920328, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13037821448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1624 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6ac4597fd47e49b728870452", "attempt_id": "38ddb053bd8e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:04.522958Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 629, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.63033302035183, "ttft_ms": 13.63933295942843, "decode_ms": 13.869707938283682}, "total_wall_ms": 106.25166608951986, "ttft_ms": 13.63933295942843, "input_usage": {"receiver_prompt_tokens": 629, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046799912, "mlx_cache_bytes": 11095690456, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13046799912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1625 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5e3d99ebba8396c22afdc51b", "attempt_id": "1b71f5fc5edc", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:04.657610Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.03958405181766, "ttft_ms": 14.644292066805065, "decode_ms": 68.8207499915734}, "total_wall_ms": 161.7056659888476, "ttft_ms": 14.644292066805065, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540072, "mlx_cache_bytes": 11278929112, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13042540072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,170,900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "2e16556aa0c4e9bbbb98d5742bc624de2d05f6c31920d18e9500e60aeeb84c74"} | ||||
| 1626 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "185ba8786cd16cc19ccb0930", "attempt_id": "9fac69c8176f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:04.848252Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 629, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.45545799843967, "ttft_ms": 13.809166965074837, "decode_ms": 13.658000039868057}, "total_wall_ms": 106.14862502552569, "ttft_ms": 13.809166965074837, "input_usage": {"receiver_prompt_tokens": 629, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046799912, "mlx_cache_bytes": 11278929112, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13046799912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1627 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0e822f68c077f4faef6504d", "attempt_id": "1ea35f85657b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:04.984476Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.76937494054437, "ttft_ms": 13.864333974197507, "decode_ms": 69.0388330258429}, "total_wall_ms": 161.8700830731541, "ttft_ms": 13.864333974197507, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981864, "mlx_cache_bytes": 11627810008, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13043981864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,973,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "7004847b46e393d90b40d12b5b11207c84778d1c035bc322d96f9f0393bc80af"} | ||||
| 1628 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b508fb6bafac288631386b1c", "attempt_id": "79b8e8162b81", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:05.177163Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.68641701154411, "ttft_ms": 13.492000056430697, "decode_ms": 13.426000019535422}, "total_wall_ms": 107.66766709275544, "ttft_ms": 13.492000056430697, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 11627810008, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1629 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c325e739bf10e85e1d1a2b09", "attempt_id": "fa8c43517e8f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:05.313830Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.34387496020645, "ttft_ms": 13.619374949485064, "decode_ms": 13.466582982800901}, "total_wall_ms": 105.45670799911022, "ttft_ms": 13.619374949485064, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981864, "mlx_cache_bytes": 11627810008, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13043981864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1630 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1d3138ba128602709f13ac5d", "attempt_id": "6c411aa1e43a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:05.447807Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10027.917208964936, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.37391702923924, "ttft_ms": 13.641124940477312, "decode_ms": 13.368415995500982}, "total_wall_ms": 106.46029096096754, "ttft_ms": 13.641124940477312, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 10919, "sender_output_tokens": 512, "sender_prefill_ms": 1837.5857919454575, "sender_ttft_ms": 16.862999997101724, "sender_decode_ms": 8165.817209053785}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077208616, "mlx_cache_bytes": 11789389016, "process_rss_bytes": 1604730880}, "peak_prefill_memory": null, "peak_decode_memory": 13077208616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "48f3cf13dc92935b386abf7793a1a8a8f9a6827319b21850a96df4128741e8e7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1631 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db46c453266827a3cd371df6", "attempt_id": "5f7a6f5dc1c9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:15.661112Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 524, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.14099995326251, "ttft_ms": 13.579332968220115, "decode_ms": 13.700374984182417}, "total_wall_ms": 100.61383398715407, "ttft_ms": 13.579332968220115, "input_usage": {"receiver_prompt_tokens": 524, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12986342920, "mlx_cache_bytes": 12385062104, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12986342920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1632 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "58c459904485a54d3c281a85", "attempt_id": "93b4549e6c76", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:15.791574Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 516, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.47887505218387, "ttft_ms": 13.491083052940667, "decode_ms": 14.092499972321093}, "total_wall_ms": 101.11795796547085, "ttft_ms": 13.491083052940667, "input_usage": {"receiver_prompt_tokens": 516, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982001160, "mlx_cache_bytes": 12673715416, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12982001160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1633 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "234c2d9ea0b68c487c870485", "attempt_id": "8e9120bf6884", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:15.922400Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 516, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.94583292584866, "ttft_ms": 13.575542019680142, "decode_ms": 13.394791982136667}, "total_wall_ms": 99.89433293230832, "ttft_ms": 13.575542019680142, "input_usage": {"receiver_prompt_tokens": 516, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982001160, "mlx_cache_bytes": 12673715416, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12982001160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1634 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3638e51aea7549f1f3f63130", "attempt_id": "e10f1bba6030", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:16.051392Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 532, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.00929103419185, "ttft_ms": 13.5902080219239, "decode_ms": 13.46045802347362}, "total_wall_ms": 100.02024995628744, "ttft_ms": 13.5902080219239, "input_usage": {"receiver_prompt_tokens": 532, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990979592, "mlx_cache_bytes": 12938775768, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12990979592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1635 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "198a7c8a3e9f740955314409", "attempt_id": "e96dfaaeacad", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:16.180649Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 525, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.92187500186265, "ttft_ms": 13.993249973282218, "decode_ms": 13.49833293352276}, "total_wall_ms": 100.39245802909136, "ttft_ms": 13.993249973282218, "input_usage": {"receiver_prompt_tokens": 525, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12986523144, "mlx_cache_bytes": 13041798360, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12986523144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1636 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b3bdade480ad1280ebf58bea", "attempt_id": "50332a70015f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:16.309026Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 532, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.36633398476988, "ttft_ms": 13.70345801115036, "decode_ms": 13.472083956003189}, "total_wall_ms": 99.45199999492615, "ttft_ms": 13.70345801115036, "input_usage": {"receiver_prompt_tokens": 532, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990979592, "mlx_cache_bytes": 13041798360, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12990979592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1637 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f16426e4b130d91f47345884", "attempt_id": "b9984d0cc358", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:16.437511Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 528, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.27879199106246, "ttft_ms": 13.50366696715355, "decode_ms": 67.3510420601815}, "total_wall_ms": 153.13150000292808, "ttft_ms": 13.50366696715355, "input_usage": {"receiver_prompt_tokens": 528, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12988161544, "mlx_cache_bytes": 13336808664, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12988161544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,973,260", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "7004847b46e393d90b40d12b5b11207c84778d1c035bc322d96f9f0393bc80af"} | ||||
| 1638 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a4b703d024a75d43b37745b", "attempt_id": "69fb3e0c5657", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:16.619376Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 523, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.65141706354916, "ttft_ms": 13.574625016190112, "decode_ms": 13.623000006191432}, "total_wall_ms": 99.84354092739522, "ttft_ms": 13.574625016190112, "input_usage": {"receiver_prompt_tokens": 523, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012000264, "mlx_cache_bytes": 13368921304, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13012000264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1639 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6638654fbd504ad492b02fc1", "attempt_id": "482b7b955044", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:16.747588Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 528, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.86929194722325, "ttft_ms": 13.83020798675716, "decode_ms": 13.52625002618879}, "total_wall_ms": 100.23925011046231, "ttft_ms": 13.83020798675716, "input_usage": {"receiver_prompt_tokens": 528, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12988161544, "mlx_cache_bytes": 13368921304, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 12988161544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1640 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ec4f3b49881e6148b2167e1e", "attempt_id": "2c09c526e93f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:16.876257Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 530, "message_tokens": 405, "message_utf8_bytes": 1162, "cache_tensor_bytes": null, "serialized_payload_bytes": 1162, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10078.155290917493, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.62420894019306, "ttft_ms": 13.810458010993898, "decode_ms": 13.547040987759829}, "total_wall_ms": 99.91487499792129, "ttft_ms": 13.810458010993898, "input_usage": {"receiver_prompt_tokens": 530, "sender_input_tokens": 10949, "sender_output_tokens": 512, "sender_prefill_ms": 1886.0006249742582, "sender_ttft_ms": 17.39595807157457, "sender_decode_ms": 8164.225832908414}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13016669704, "mlx_cache_bytes": 13505531096, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13016669704, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 10, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "27939c61aa92a7b859736f7bb1a9cd204c3976502e71c0f376c9ab6e4214ab5c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1641 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d411249eedc65d190174ea18", "attempt_id": "9857abbb591e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:17.012434Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 602, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.11683304235339, "ttft_ms": 13.784875045530498, "decode_ms": 13.539999956265092}, "total_wall_ms": 102.4934999877587, "ttft_ms": 13.784875045530498, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031448072, "mlx_cache_bytes": 13864504536, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13031448072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1642 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1a531e0a6577f9e86b251f2d", "attempt_id": "0a9fef64a6ea", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:17.143973Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.83233301900327, "ttft_ms": 13.852208969183266, "decode_ms": 27.11220900528133}, "total_wall_ms": 116.83850002009422, "ttft_ms": 13.852208969183266, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13027106312, "mlx_cache_bytes": 14196591832, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13027106312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1643 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f6433ffe013aa7386b55f003", "attempt_id": "efae13362c97", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:17.288874Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 594, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.3923339759931, "ttft_ms": 13.658667099662125, "decode_ms": 27.12004107888788}, "total_wall_ms": 116.30879098083824, "ttft_ms": 13.658667099662125, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13027106312, "mlx_cache_bytes": 14196591832, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13027106312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1644 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "af9e6989cf6f5d0f06a5f5b7", "attempt_id": "7f0aa561330c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:17.435525Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 610, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.57662499696016, "ttft_ms": 13.958375086076558, "decode_ms": 68.4213750064373}, "total_wall_ms": 160.06620810367167, "ttft_ms": 13.958375086076558, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067263496, "mlx_cache_bytes": 14353845464, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13067263496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,503,470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "ebf96e8b478874f3439e3debf74b45468a39555264b923cdabe02b39a5afbd72"} | ||||
| 1645 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "24d494cb0c928fd9575083ff", "attempt_id": "b2ac6fe5be1a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:17.624856Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 603, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.04125004541129, "ttft_ms": 13.66833399515599, "decode_ms": 67.420709063299}, "total_wall_ms": 156.261834083125, "ttft_ms": 13.66833399515599, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628296, "mlx_cache_bytes": 14472203480, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13031628296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,170,900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "2e16556aa0c4e9bbbb98d5742bc624de2d05f6c31920d18e9500e60aeeb84c74"} | ||||
| 1646 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3c16dcb90308204059e286a6", "attempt_id": "19e2d065442e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:17.810778Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 610, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.54258294496685, "ttft_ms": 13.871375005692244, "decode_ms": 53.989583044312894}, "total_wall_ms": 145.44937491882592, "ttft_ms": 13.871375005692244, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13074800136, "mlx_cache_bytes": 14472203480, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13074800136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Volpra-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "4650fe7263e3dc5e8cde393bc0bc3966e7981ebef5bb2ad746643be133a118cc"} | ||||
| 1647 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7509a0e0eebf5f38f819e0f5", "attempt_id": "455d2faa6b4f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:17.985218Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 606, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.07062493823469, "ttft_ms": 13.60745809506625, "decode_ms": 67.80491699464619}, "total_wall_ms": 157.62191696558148, "ttft_ms": 13.60745809506625, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033266696, "mlx_cache_bytes": 14810647768, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13033266696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,973,260", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "7004847b46e393d90b40d12b5b11207c84778d1c035bc322d96f9f0393bc80af"} | ||||
| 1648 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "693954dd97d7bc1b763498f1", "attempt_id": "4efa8e488f60", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:18.171806Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 601, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.30945802479982, "ttft_ms": 13.656417024321854, "decode_ms": 13.720792019739747}, "total_wall_ms": 103.07266691233963, "ttft_ms": 13.656417024321854, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031448072, "mlx_cache_bytes": 14810647768, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13031448072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1649 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "43e2bfcbc9c3a6d3d2e28ffe", "attempt_id": "66e212a1a30f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:18.306223Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 606, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.11670794337988, "ttft_ms": 13.943459023721516, "decode_ms": 13.585541979409754}, "total_wall_ms": 103.67687500547618, "ttft_ms": 13.943459023721516, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033266696, "mlx_cache_bytes": 14810647768, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13033266696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1650 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "32bf7bbd5a302a5074f8a273", "attempt_id": "560275bf1c01", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:18.439799Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 498, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 608, "message_tokens": 497, "message_utf8_bytes": 1521, "cache_tensor_bytes": null, "serialized_payload_bytes": 1521, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.839333964511752, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.60791703872383, "ttft_ms": 14.11845802795142, "decode_ms": 13.548083952628076}, "total_wall_ms": 104.33000000193715, "ttft_ms": 14.11845802795142, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1604894720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13045898760, "mlx_cache_bytes": 15124237528, "process_rss_bytes": 1604894720}, "peak_prefill_memory": null, "peak_decode_memory": 13045898760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a2a5ebd4aedc90e8545ac0dccffa47aed7d28982f7b855601ea1d484e710c477", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1651 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a291500f27f5574ce7c503cf", "attempt_id": "24d60bcdb366", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:20.553604Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 44, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.676249947398901, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.723375035449862, "ttft_ms": 30.723375035449862, "decode_ms": 126.85833405703306}, "total_wall_ms": 167.86704096011817, "ttft_ms": 30.723375035449862, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 44}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1912619008, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 14612647481, "process_rss_bytes": 1912619008}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1652 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "58523bb3463183e7c5368ab4", "attempt_id": "77d4d6aad4ad", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:20.751966Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 36, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.4848750326782465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.734250063076615, "ttft_ms": 27.734250063076615, "decode_ms": 15.469042002223432}, "total_wall_ms": 53.037417004816234, "ttft_ms": 27.734250063076615, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1912619008, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571197672, "mlx_cache_bytes": 14640434745, "process_rss_bytes": 1912619008}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571197672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1653 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "133e23a17be3889b660f595b", "attempt_id": "41d348f0ae50", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:20.834376Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 36, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.582416986115277, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.11091602779925, "ttft_ms": 28.11091602779925, "decode_ms": 15.425209072418511}, "total_wall_ms": 53.79462498240173, "ttft_ms": 28.11091602779925, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1912619008, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571197672, "mlx_cache_bytes": 14640434745, "process_rss_bytes": 1912619008}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571197672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 1654 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "354ed5d3255dbc07854c1520", "attempt_id": "1e8fea52c5f6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:20.918219Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 52, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 1.582833006978035, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.602832928299904, "ttft_ms": 28.602832928299904, "decode_ms": 31.180583988316357}, "total_wall_ms": 68.78829095512629, "ttft_ms": 28.602832928299904, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 52}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1912619008, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 14678071913, "process_rss_bytes": 1912619008}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1655 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aca83726c7028a2457f84505", "attempt_id": "f09153c3881c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:21.015684Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 45, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.584833069704473, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.214708039537072, "ttft_ms": 27.214708039537072, "decode_ms": 77.35779089853168}, "total_wall_ms": 114.52766694128513, "ttft_ms": 27.214708039537072, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1912619008, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575801608, "mlx_cache_bytes": 14698469993, "process_rss_bytes": 1912619008}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575801608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,500,000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "6e1a91a1fac8ac7c6ee86174018471d8749ede48bfb38c2824d93fe872db1453"} | ||||
| 1656 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "45a5225a06eabe28b2aa2347", "attempt_id": "da1e24ab1071", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:21.159122Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 52, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.5190829765051603, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.95529195666313, "ttft_ms": 28.95529195666313, "decode_ms": 62.34633398707956}, "total_wall_ms": 101.12258396111429, "ttft_ms": 28.95529195666313, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 52}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1912619008, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 14698469993, "process_rss_bytes": 1912619008}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-4", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "38c5908aee7f4a12514df8a23189a4aadf570c62345067fae24a44f51824ea73"} | ||||
| 1657 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "087286e39129dc93c4190127", "attempt_id": "37635518bd8a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:21.289163Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 48, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.4148329393938184, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.731999918818474, "ttft_ms": 28.731999918818474, "decode_ms": 77.71641702856869}, "total_wall_ms": 116.74795800354332, "ttft_ms": 28.731999918818474, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1912635392, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 14732614249, "process_rss_bytes": 1912635392}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,821,400", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "4794a6ba790d529aeebdec52cc075f6ebe9c1896c5a2d7b0f1ff80bb297d5c39"} | ||||
| 1658 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3775b4a613c9f1c996f11766", "attempt_id": "be5a14f4557f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:21.434642Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 43, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.628459013067186, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.77829102706164, "ttft_ms": 27.77829102706164, "decode_ms": 93.83825003169477}, "total_wall_ms": 132.07666599191725, "ttft_ms": 27.77829102706164, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 43}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1912651776, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 14744574569, "process_rss_bytes": 1912651776}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "515db3b6e2b56162addd24d49fcbd650a5f5ccca0ced2425925d4ebea56fef6a"} | ||||
| 1659 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86f73334ae1f268f5cbf0ca6", "attempt_id": "447108d00a33", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:21.596114Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 48, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.533624996431172, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.56895898003131, "ttft_ms": 28.56895898003131, "decode_ms": 15.452541061677039}, "total_wall_ms": 53.85741696227342, "ttft_ms": 28.56895898003131, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1912651776, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 14744574569, "process_rss_bytes": 1912651776}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1660 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5a429ea2e5fa1324b90a767a", "attempt_id": "8c85a90aaa55", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:21.678482Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10845, "keep": 2711, "compress_ms": 15.139374998398125}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 50, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932373, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1980.1640000659972, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 15.183250070549548, "serialize_ms": 57.44191608391702, "load_ms": 2.615957986563444, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.59262505080551, "ttft_ms": 28.59262505080551, "decode_ms": 15.589207992888987}, "total_wall_ms": 54.137084051035345, "ttft_ms": 28.59262505080551, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1912651776, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14583403776, "mlx_cache_bytes": 14769429097, "process_rss_bytes": 1912651776}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14583403776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "abc6fefe8bdd1e8cb81adc7932b83f83fa6ed82d3f576c8c71798cb304945d2d", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1661 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2c04c55fd2b9a5d2014c1f9c", "attempt_id": "9505dd694ef9", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:21.762005Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 44, "compress_ms": 518.0951670045033}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 44, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932412, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1510.4595409939066, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 525.3984170267358, "serialize_ms": 984.8566249711439, "load_ms": 3.0602499609813094, "receiver_prefill_ms": 0.0, "query_prefill_ms": 91.12258290406317, "ttft_ms": 91.12258290406317, "decode_ms": 125.20654103718698}, "total_wall_ms": 1739.817832945846, "ttft_ms": 91.12258290406317, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 44}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1282211840, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 17358805713, "process_rss_bytes": 1282211840}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "242488cf25d3bd9f16e0d6912a105dea8c99ecacffd701bce53b5b89bbb2b533", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1662 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "71073de30fb7f563e13dc9ae", "attempt_id": "fcec18ce0331", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:23.532695Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 36, "compress_ms": 133.55304207652807}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 36, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932413, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 313.20216704625636, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 140.86562499869615, "serialize_ms": 172.1251249546185, "load_ms": 2.069790964014828, "receiver_prefill_ms": 0.0, "query_prefill_ms": 41.449207928963006, "ttft_ms": 41.449207928963006, "decode_ms": 38.084124913439155}, "total_wall_ms": 403.0577909434214, "ttft_ms": 41.449207928963006, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1593327616, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571181288, "mlx_cache_bytes": 17410955985, "process_rss_bytes": 1593327616}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571181288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fc743471883e95f6def7ad1d5d49aaec4e844b3864093a39ae4197b4ac5deca4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1663 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a81ff3b48f0b751ad737854", "attempt_id": "268eb30f4f14", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:23.967480Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 36, "compress_ms": 124.6238750172779}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 36, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932412, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 178.3451250521466, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 132.0326249115169, "serialize_ms": 46.12249997444451, "load_ms": 2.4840000551193953, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.010541991330683, "ttft_ms": 27.010541991330683, "decode_ms": 31.079959007911384}, "total_wall_ms": 246.42983393277973, "ttft_ms": 27.010541991330683, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1593344000, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571181288, "mlx_cache_bytes": 17410955985, "process_rss_bytes": 1593344000}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14571181288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "242488cf25d3bd9f16e0d6912a105dea8c99ecacffd701bce53b5b89bbb2b533", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1664 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "887713b0d3c1fa07843210bb", "attempt_id": "bc8094560b67", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:24.245676Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 52, "compress_ms": 132.1708329487592}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 52, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932412, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.48133300989866, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 139.75258404389024, "serialize_ms": 44.5433339336887, "load_ms": 2.260417095385492, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.360791970044374, "ttft_ms": 28.360791970044374, "decode_ms": 78.28054099809378}, "total_wall_ms": 301.14504194352776, "ttft_ms": 28.360791970044374, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1593311232, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 17481603793, "process_rss_bytes": 1593311232}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,773,345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "242488cf25d3bd9f16e0d6912a105dea8c99ecacffd701bce53b5b89bbb2b533", "output_hash": "f9f095b26c516c2f6760e8c3cc19b8c785ab7fd7c1724dd894635f88d93c205a"} | ||||
| 1665 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8435a523ddd2e6903919f215", "attempt_id": "5a96496a9813", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:24.578021Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 45, "compress_ms": 127.9162080027163}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 45, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932412, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 178.68391599040478, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 135.17754105851054, "serialize_ms": 43.31533296499401, "load_ms": 2.326957997865975, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.707124896347523, "ttft_ms": 26.707124896347523, "decode_ms": 78.13395897392184}, "total_wall_ms": 293.337416020222, "ttft_ms": 26.707124896347523, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1593376768, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575801608, "mlx_cache_bytes": 17529019089, "process_rss_bytes": 1593376768}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575801608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,170,900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "242488cf25d3bd9f16e0d6912a105dea8c99ecacffd701bce53b5b89bbb2b533", "output_hash": "2e16556aa0c4e9bbbb98d5742bc624de2d05f6c31920d18e9500e60aeeb84c74"} | ||||
| 1666 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9c26c1586b773509d9b63601", "attempt_id": "de8a8275b130", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:24.903068Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 52, "compress_ms": 129.9305830616504}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 52, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932412, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 180.23112509399652, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 137.22170796245337, "serialize_ms": 42.82620805315673, "load_ms": 1.457915990613401, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.305499930866063, "ttft_ms": 28.305499930866063, "decode_ms": 62.60004092473537}, "total_wall_ms": 280.1334169926122, "ttft_ms": 28.305499930866063, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 52}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1593425920, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 17529019089, "process_rss_bytes": 1593425920}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-4", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "242488cf25d3bd9f16e0d6912a105dea8c99ecacffd701bce53b5b89bbb2b533", "output_hash": "38c5908aee7f4a12514df8a23189a4aadf570c62345067fae24a44f51824ea73"} | ||||
| 1667 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4d624f585d01d10c3b675144", "attempt_id": "4beaa4379953", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:25.214827Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 48, "compress_ms": 128.61112505197525}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 48, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932413, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 211.68337494600564, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 136.04354206472635, "serialize_ms": 75.4459589952603, "load_ms": 1.9504999509081244, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.582417056895792, "ttft_ms": 28.582417056895792, "decode_ms": 367.4060000339523}, "total_wall_ms": 617.4784579779953, "ttft_ms": 28.582417056895792, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 48}, "output_usage": {"output_tokens": 19}, "provider_cached_usage": null, "process_memory": 1593425920, "backend_memory": {"mlx_active_bytes": 14490194952, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 18364455633, "process_rss_bytes": 1593425920}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,995,575 + 2,973,260 + 1,472,400", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fc743471883e95f6def7ad1d5d49aaec4e844b3864093a39ae4197b4ac5deca4", "output_hash": "aad8d7ebf1efb2c85d9b20bf4d5da0055a650d9b16e7028ea6c178e34d076407"} | ||||
| 1668 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "72dd46264c61b50c6d1be880", "attempt_id": "e043fa18c36d", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:25.864448Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 43, "compress_ms": 127.1024999441579}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 43, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932412, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 190.93754200730473, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 134.80395800434053, "serialize_ms": 55.92287494800985, "load_ms": 1.9472920102998614, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.521916897967458, "ttft_ms": 27.521916897967458, "decode_ms": 47.57937497925013}, "total_wall_ms": 275.796249974519, "ttft_ms": 27.521916897967458, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1593507840, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 18411985617, "process_rss_bytes": 1593507840}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27.33", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "242488cf25d3bd9f16e0d6912a105dea8c99ecacffd701bce53b5b89bbb2b533", "output_hash": "112b5e142e51e73c92589563ed886e9c0d15430a8c6ac9e9b02d4138d73e2f7a"} | ||||
| 1669 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "358dc52c7de6fd92ac67f188", "attempt_id": "f64ceb9b326b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:26.178834Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 48, "compress_ms": 128.16479103639722}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 48, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932413, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 186.27175001893193, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 135.82429196685553, "serialize_ms": 50.249457941390574, "load_ms": 2.37875001039356, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.58133299741894, "ttft_ms": 28.58133299741894, "decode_ms": 15.616707969456911}, "total_wall_ms": 240.47766695730388, "ttft_ms": 28.58133299741894, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1593475072, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 18411985617, "process_rss_bytes": 1593475072}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fc743471883e95f6def7ad1d5d49aaec4e844b3864093a39ae4197b4ac5deca4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1670 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "81f0b52d4bedd37759a32645", "attempt_id": "17ff6961f044", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:26.455918Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10845, "keep": 2711, "window_tokens": 50, "compress_ms": 131.05254096444696}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 50, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 310919168, "serialized_payload_bytes": 310932413, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 187.9084169631824, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 138.39795894455165, "serialize_ms": 49.31662499438971, "load_ms": 2.5131249567493796, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.540375038981438, "ttft_ms": 30.540375038981438, "decode_ms": 15.67087508738041}, "total_wall_ms": 244.21016592532396, "ttft_ms": 30.540375038981438, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1593573376, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14583371008, "mlx_cache_bytes": 18463136465, "process_rss_bytes": 1593573376}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 14583371008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "fc743471883e95f6def7ad1d5d49aaec4e844b3864093a39ae4197b4ac5deca4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1671 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f62f73f3f2e5bcae1bc6f12c", "attempt_id": "7d345d41c16b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:27.039626Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 44, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 18.181542051024735, "receiver_prefill_ms": 0.0, "query_prefill_ms": 67.96066707465798, "ttft_ms": 67.96066707465798, "decode_ms": 196.81612495332956}, "total_wall_ms": 291.6375829372555, "ttft_ms": 67.96066707465798, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 44}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 2011873280, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15492253440, "mlx_cache_bytes": 20532566097, "process_rss_bytes": 2011873280}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15492253440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "QV-63D-9430", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "f13e886fabf5fbc015752c2bf5d630e71ced043e7340ade755eb51c63f638098"} | ||||
| 1672 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "418538d0d1760fdce65c604c", "attempt_id": "879b386da309", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:27.365398Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 36, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 4.020166001282632, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.07854193635285, "ttft_ms": 37.07854193635285, "decode_ms": 37.7793749794364}, "total_wall_ms": 87.84308400936425, "ttft_ms": 37.07854193635285, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1946746880, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15463184640, "mlx_cache_bytes": 20646340049, "process_rss_bytes": 1946746880}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15463184640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1673 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4dc88512de17cb991e806344", "attempt_id": "7433f1e053a4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:27.490814Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 36, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 3.7677090149372816, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.128709092736244, "ttft_ms": 36.128709092736244, "decode_ms": 37.435000063851476}, "total_wall_ms": 85.03329195082188, "ttft_ms": 36.128709092736244, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1946746880, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15463184640, "mlx_cache_bytes": 20646340049, "process_rss_bytes": 1946746880}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15463184640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1674 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "23d06cbb1d14cfcbed93e03d", "attempt_id": "208b657173fc", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:27.606600Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 52, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 3.7369579076766968, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.30033307895064, "ttft_ms": 38.30033307895064, "decode_ms": 93.95795804448426}, "total_wall_ms": 143.75862502492964, "ttft_ms": 38.30033307895064, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1946746880, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15522434592, "mlx_cache_bytes": 20944278353, "process_rss_bytes": 1946746880}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15522434592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,773,345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "f9f095b26c516c2f6760e8c3cc19b8c785ab7fd7c1724dd894635f88d93c205a"} | ||||
| 1675 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d08c9ebfc0472bca38406fc9", "attempt_id": "3d66dd227b42", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:27.781348Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 45, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 3.76287498511374, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.785500055179, "ttft_ms": 37.785500055179, "decode_ms": 91.6535829892382}, "total_wall_ms": 140.81466698553413, "ttft_ms": 37.785500055179, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1946796032, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15495581216, "mlx_cache_bytes": 21086360401, "process_rss_bytes": 1946796032}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15495581216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,170,900", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "2e16556aa0c4e9bbbb98d5742bc624de2d05f6c31920d18e9500e60aeeb84c74"} | ||||
| 1676 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a69a9da3cb34da3932509b6", "attempt_id": "74ccbbd5fd3c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:27.957059Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 52, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 3.4865830093622208, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.36445808317512, "ttft_ms": 37.36445808317512, "decode_ms": 72.64091703109443}, "total_wall_ms": 120.96891703549773, "ttft_ms": 37.36445808317512, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 52}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1946812416, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15522434592, "mlx_cache_bytes": 21085442897, "process_rss_bytes": 1946812416}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15522434592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Quital-4", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "38c5908aee7f4a12514df8a23189a4aadf570c62345067fae24a44f51824ea73"} | ||||
| 1677 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c56377da5fabf54fe07dc3d8", "attempt_id": "ff4e696eda57", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:28.107854Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 48, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 4.175374982878566, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.38758398685604, "ttft_ms": 37.38758398685604, "decode_ms": 90.95670899841934}, "total_wall_ms": 140.1500420179218, "ttft_ms": 37.38758398685604, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1946845184, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15506378272, "mlx_cache_bytes": 21236044625, "process_rss_bytes": 1946845184}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15506378272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,458,045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "60a0580de4e60f1ad54b268aa246ed638835b6084853f77493d94e2bfa83d013"} | ||||
| 1678 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dc9bcca0743479b2b0f14d84", "attempt_id": "cd1540507d55", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:28.278105Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 43, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 4.287832998670638, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.374583025462925, "ttft_ms": 36.374583025462925, "decode_ms": 54.52754197176546}, "total_wall_ms": 102.59308409877121, "ttft_ms": 36.374583025462925, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1946845184, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15489104128, "mlx_cache_bytes": 21371835217, "process_rss_bytes": 1946845184}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15489104128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "27.33", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "112b5e142e51e73c92589563ed886e9c0d15430a8c6ac9e9b02d4138d73e2f7a"} | ||||
| 1679 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4857ea93b2eee624da753fa3", "attempt_id": "c71ff0c18c98", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:28.409994Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 48, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 4.083832958713174, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.81379102636129, "ttft_ms": 36.81379102636129, "decode_ms": 18.23325001168996}, "total_wall_ms": 66.5958330500871, "ttft_ms": 36.81379102636129, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1946845184, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15506378272, "mlx_cache_bytes": 21371835217, "process_rss_bytes": 1946845184}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15506378272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1680 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fcd6cde065461b17c01be9ac", "attempt_id": "d262ce0e9896", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:28.505999Z", "task_family": "synthetic", "document_id": "syn_03011_16000", "document_hash": "0ce25962881b11bafcb6d30b9983813393db816da7e585a40e39d3d8d85c27ab", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03011_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14522307592}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10785, "source_tokens_receiver": 10785, "query_tokens": 50, "message_tokens": 10845, "message_utf8_bytes": 58856, "cache_tensor_bytes": 660764160, "serialized_payload_bytes": 660792001, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.76141602452844, "doc_prefill_ms": 1891.4724589558318, "compress_ms": 36.474833032116294, "serialize_ms": 269.9992919806391, "load_ms": 4.2827920988202095, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.94045897666365, "ttft_ms": 37.94045897666365, "decode_ms": 18.237457959912717}, "total_wall_ms": 67.81079096253961, "ttft_ms": 37.94045897666365, "input_usage": {"receiver_prefix_tokens": 10845, "dense_cache_bytes": 1243791360, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1946845184, "backend_memory": {"mlx_active_bytes": 15187497992, "mlx_peak_bytes": 15519387204, "mlx_cache_bytes": 21529285457, "process_rss_bytes": 1946845184}, "peak_prefill_memory": 14275154984, "peak_decode_memory": 15519387204, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03011_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "756125cbe24f511c4de2d622b8b6f73eae9ae93f8ba84aa0cf31059a19ca93dd", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1681 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "83b53767d6b386026b157083", "attempt_id": "dc39a0d83efc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:29.217631Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2011, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 6436.313916929066, "ttft_ms": 45.12354196049273, "decode_ms": 138.26104102190584}, "total_wall_ms": 6623.488957993686, "ttft_ms": 45.12354196049273, "input_usage": {"receiver_prompt_tokens": 2011}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1315045376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13473788840, "mlx_cache_bytes": 2809730336, "process_rss_bytes": 1315045376}, "peak_prefill_memory": null, "peak_decode_memory": 13473788840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 1682 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "925eca6c5749cab56456a646", "attempt_id": "0081b7520edc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:35.866101Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.86883307341486, "ttft_ms": 13.520624954253435, "decode_ms": 13.680166099220514}, "total_wall_ms": 239.80862507596612, "ttft_ms": 13.520624954253435, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315045376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13470741416, "mlx_cache_bytes": 3597292832, "process_rss_bytes": 1315045376}, "peak_prefill_memory": null, "peak_decode_memory": 13470741416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1683 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0d606248adc10b431b187666", "attempt_id": "439e23f493c2", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:36.122262Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2003, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.16787500027567, "ttft_ms": 14.033875078894198, "decode_ms": 13.800042099319398}, "total_wall_ms": 239.75516704376787, "ttft_ms": 14.033875078894198, "input_usage": {"receiver_prompt_tokens": 2003}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315045376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13470741416, "mlx_cache_bytes": 3597292832, "process_rss_bytes": 1315045376}, "peak_prefill_memory": null, "peak_decode_memory": 13470741416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1684 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e411ee585783ecf164dbd3f1", "attempt_id": "47f538ba2f6a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:36.377594Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2018, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 263.5366669856012, "ttft_ms": 14.315792010165751, "decode_ms": 97.28887502569705}, "total_wall_ms": 378.0065829632804, "ttft_ms": 14.315792010165751, "input_usage": {"receiver_prompt_tokens": 2018}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1315045376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13476967488, "mlx_cache_bytes": 4403467552, "process_rss_bytes": 1315045376}, "peak_prefill_memory": null, "peak_decode_memory": 13476967488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6602245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "d117fa8197988f8d1e4fabc6c4cdaab9516018e54553b57c63b875b3de82b16f"} | ||||
| 1685 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a457cc461e7f93984dbc494e", "attempt_id": "8efc921067df", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:36.771474Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2011, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 257.0377920055762, "ttft_ms": 14.134166995063424, "decode_ms": 97.0297500025481}, "total_wall_ms": 370.9675408899784, "ttft_ms": 14.134166995063424, "input_usage": {"receiver_prompt_tokens": 2011}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1315045376, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13473788840, "mlx_cache_bytes": 4403467552, "process_rss_bytes": 1315045376}, "peak_prefill_memory": null, "peak_decode_memory": 13473788840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "466,045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "4a66e3c0960c26d2429d36e0c7f9d4c2192499734aa4ec831aea9100579be90f"} | ||||
| 1686 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "568dfad1b362e0713b82b7c8", "attempt_id": "0417089cb574", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:37.161611Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2021, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 254.08049998804927, "ttft_ms": 13.688791077584028, "decode_ms": 82.3636669665575}, "total_wall_ms": 352.9484999598935, "ttft_ms": 13.688791077584028, "input_usage": {"receiver_prompt_tokens": 2021}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1315078144, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13477753920, "mlx_cache_bytes": 4957902112, "process_rss_bytes": 1315078144}, "peak_prefill_memory": null, "peak_decode_memory": 13477753920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1687 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2db17ab108dfe7ef952e2985", "attempt_id": "aecdcd52a935", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:37.530740Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2013, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 254.60687500890344, "ttft_ms": 14.27187502849847, "decode_ms": 97.09612501319498}, "total_wall_ms": 368.74825006816536, "ttft_ms": 14.27187502849847, "input_usage": {"receiver_prompt_tokens": 2013}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1315078144, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13474378816, "mlx_cache_bytes": 5510108448, "process_rss_bytes": 1315078144}, "peak_prefill_memory": null, "peak_decode_memory": 13474378816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4444448", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "1c24abe24e5f942bcedfb48caab948a2b73673e40b17a07d12c99b76636cc33d"} | ||||
| 1688 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1f470a5a82a119fdcce4ff2", "attempt_id": "9c165281a5cc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:37.915302Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2010, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 249.00904204696417, "ttft_ms": 14.189040986821055, "decode_ms": 69.25508298445493}, "total_wall_ms": 335.2310420013964, "ttft_ms": 14.189040986821055, "input_usage": {"receiver_prompt_tokens": 2010}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1315078144, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13473788840, "mlx_cache_bytes": 5510108448, "process_rss_bytes": 1315078144}, "peak_prefill_memory": null, "peak_decode_memory": 13473788840, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44620", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "2bd125847727be7e7c0a656ee4c81f3bc6d0fef11f536f50ce7bc83688907075"} | ||||
| 1689 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8d4cfc59dd088db7462f2d74", "attempt_id": "ff1d9ebc02c6", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:38.266752Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2015, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 253.61270795110613, "ttft_ms": 14.103249995969236, "decode_ms": 14.06129205133766}, "total_wall_ms": 284.49595789425075, "ttft_ms": 14.103249995969236, "input_usage": {"receiver_prompt_tokens": 2015}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315078144, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13517173824, "mlx_cache_bytes": 6120707360, "process_rss_bytes": 1315078144}, "peak_prefill_memory": null, "peak_decode_memory": 13517173824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1690 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc366ae38150e1aaabdae9a3", "attempt_id": "4b9b73adfc39", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:38.567096Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 2015, "message_tokens": 1927, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01391698606312275, "decode_payload_ms": 0.0, "receiver_prefill_ms": 270.38124995306134, "ttft_ms": 14.012958039529622, "decode_ms": 13.836874975822866}, "total_wall_ms": 300.9602500824258, "ttft_ms": 14.012958039529622, "input_usage": {"receiver_prompt_tokens": 2015}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315078144, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13525447744, "mlx_cache_bytes": 6120707360, "process_rss_bytes": 1315078144}, "peak_prefill_memory": null, "peak_decode_memory": 13525447744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1691 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "09c98555474a55eb5495b16b", "attempt_id": "089ffa914663", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:46.122512Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.50545793026686, "ttft_ms": 13.394540990702808, "decode_ms": 133.56895896140486}, "total_wall_ms": 219.75691698025912, "ttft_ms": 13.394540990702808, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 7503959328, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 1692 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "be72c5c01a46f735ed1121d8", "attempt_id": "f100f6162ff1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:46.359968Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.74633398931473, "ttft_ms": 13.5980419581756, "decode_ms": 13.29954108223319}, "total_wall_ms": 97.67725004348904, "ttft_ms": 13.5980419581756, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 7849596192, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1693 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "227deda60ec47f6832556d0a", "attempt_id": "eeeafd96deae", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:46.473495Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.83183301053941, "ttft_ms": 13.187999953515828, "decode_ms": 13.15795793198049}, "total_wall_ms": 97.21024997998029, "ttft_ms": 13.187999953515828, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 7849596192, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1694 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b141972c36ca936300b5075e", "attempt_id": "cd76d88e8f5f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:46.586705Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.0942919831723, "ttft_ms": 13.316957978531718, "decode_ms": 93.05208292789757}, "total_wall_ms": 178.5076669184491, "ttft_ms": 13.316957978531718, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997551192, "mlx_cache_bytes": 8219120928, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12997551192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6602245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "d117fa8197988f8d1e4fabc6c4cdaab9516018e54553b57c63b875b3de82b16f"} | ||||
| 1695 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c516e18e505ebf7dfd8b0c76", "attempt_id": "e558007a23b4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:46.781099Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.89454105496407, "ttft_ms": 13.260207953862846, "decode_ms": 13.514625024981797}, "total_wall_ms": 97.66333305742592, "ttft_ms": 13.260207953862846, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 8219120928, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1696 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a05bdbc588a86870c5495f6", "attempt_id": "073686ebaa23", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:46.895042Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 611, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.65033403038979, "ttft_ms": 13.335208059288561, "decode_ms": 79.90266603883356}, "total_wall_ms": 167.86466701887548, "ttft_ms": 13.335208059288561, "input_usage": {"receiver_prompt_tokens": 611, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12999894104, "mlx_cache_bytes": 8596608288, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12999894104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1697 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8122c1bb10f94aacd6661e14", "attempt_id": "471f9ad7ef54", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:47.078761Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.86720801796764, "ttft_ms": 13.280333019793034, "decode_ms": 133.5502089932561}, "total_wall_ms": 217.7229579538107, "ttft_ms": 13.280333019793034, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010183256, "mlx_cache_bytes": 8866698528, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 13010183256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "14,071.825", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "b2baf15006413ce391546f503234d5473150243c97169fdc9d6593fdb22178bc"} | ||||
| 1698 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "be4265d87adf7a832fb4d555", "attempt_id": "27c2cd5d1665", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:47.312620Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.11241698637605, "ttft_ms": 13.329749926924706, "decode_ms": 66.67345797177404}, "total_wall_ms": 151.20579104404896, "ttft_ms": 13.329749926924706, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992767064, "mlx_cache_bytes": 9024967968, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12992767064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44620", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "2bd125847727be7e7c0a656ee4c81f3bc6d0fef11f536f50ce7bc83688907075"} | ||||
| 1699 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ede7a9d68d89a566fdfc32e8", "attempt_id": "47faff438c75", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:47.480163Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.23991702590138, "ttft_ms": 13.567750109359622, "decode_ms": 13.358165975660086}, "total_wall_ms": 98.16162497736514, "ttft_ms": 13.567750109359622, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996125784, "mlx_cache_bytes": 9273677088, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12996125784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1700 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae62ebb9f1fcecc347558967", "attempt_id": "ca5af9a52ca3", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:47.594665Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1207, "cache_tensor_bytes": null, "serialized_payload_bytes": 1207, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7238.329416024499, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.57316706050187, "ttft_ms": 13.42137495521456, "decode_ms": 13.256584061309695}, "total_wall_ms": 98.19995798170567, "ttft_ms": 13.42137495521456, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 2043, "sender_output_tokens": 512, "sender_prefill_ms": 274.2088339291513, "sender_ttft_ms": 14.09437507390976, "sender_decode_ms": 6943.479417008348}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315274752, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996125784, "mlx_cache_bytes": 9273677088, "process_rss_bytes": 1315274752}, "peak_prefill_memory": null, "peak_decode_memory": 12996125784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bd4e1202c1c6bfd0ac5e89fb974f932c80f782d1f8469a5c302ebff02058e7f5", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1701 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8f0e85bafe4dd7d5e21248f9", "attempt_id": "6765beb1ae7f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:54.892644Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 448, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.157541948370636, "ttft_ms": 13.379834010265768, "decode_ms": 13.353209011256695}, "total_wall_ms": 81.76716696470976, "ttft_ms": 13.379834010265768, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971957100, "mlx_cache_bytes": 10587299956, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12971957100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1702 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "faeda74f11646c13d62347d6", "attempt_id": "a6d65d4b9c30", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:54.991221Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 440, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.74112504068762, "ttft_ms": 13.208999997004867, "decode_ms": 13.545249938033521}, "total_wall_ms": 81.34279202204198, "ttft_ms": 13.208999997004867, "input_usage": {"receiver_prompt_tokens": 440, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12965829484, "mlx_cache_bytes": 10931069044, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12965829484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1703 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "196c1983d39a81ffdb37a2dd", "attempt_id": "02161ca325af", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.088330Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 440, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.60237509012222, "ttft_ms": 13.197625055909157, "decode_ms": 13.119791983626783}, "total_wall_ms": 80.72204107884318, "ttft_ms": 13.197625055909157, "input_usage": {"receiver_prompt_tokens": 440, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12965829484, "mlx_cache_bytes": 10931069044, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12965829484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1704 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a7f9beb054838a407e978c58", "attempt_id": "ff1b543e263d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.185102Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 455, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.68024993408471, "ttft_ms": 13.480207999236882, "decode_ms": 13.193624909035861}, "total_wall_ms": 83.18612503353506, "ttft_ms": 13.480207999236882, "input_usage": {"receiver_prompt_tokens": 455, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978314120, "mlx_cache_bytes": 11308001164, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12978314120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1705 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cde181cc983fbab4c254bca2", "attempt_id": "147e03679771", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.284939Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 448, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.911374998278916, "ttft_ms": 13.149291975423694, "decode_ms": 13.564915978349745}, "total_wall_ms": 81.42379194032401, "ttft_ms": 13.149291975423694, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971957100, "mlx_cache_bytes": 11308001164, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12971957100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1706 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ccc5be8c89e280601f6cde10", "attempt_id": "c1fe26987c7b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.383074Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 458, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.506041971966624, "ttft_ms": 13.184624956920743, "decode_ms": 13.304542051628232}, "total_wall_ms": 82.85041700582951, "ttft_ms": 13.184624956920743, "input_usage": {"receiver_prompt_tokens": 458, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12981099412, "mlx_cache_bytes": 11681738416, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12981099412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1707 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25dcdb14ea27f5bef7f0dcab", "attempt_id": "cb22131ca6e1", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.482388Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 450, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.76116598583758, "ttft_ms": 13.122292002663016, "decode_ms": 13.393667060881853}, "total_wall_ms": 82.07279199268669, "ttft_ms": 13.122292002663016, "input_usage": {"receiver_prompt_tokens": 450, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12917332848, "mlx_cache_bytes": 11866746544, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12917332848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1708 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a73be386fcf2f7d7a50807da", "attempt_id": "f89900be0a71", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.580652Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 447, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.71895805001259, "ttft_ms": 13.278583064675331, "decode_ms": 66.4082090370357}, "total_wall_ms": 134.24729206599295, "ttft_ms": 13.278583064675331, "input_usage": {"receiver_prompt_tokens": 447, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12971694956, "mlx_cache_bytes": 11954433712, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12971694956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44620", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "2bd125847727be7e7c0a656ee4c81f3bc6d0fef11f536f50ce7bc83688907075"} | ||||
| 1709 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0ac0eb79232e1d838c9f499d", "attempt_id": "d3bbee5349dc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.730827Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 452, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.36349997762591, "ttft_ms": 13.3339170133695, "decode_ms": 13.509000069461763}, "total_wall_ms": 82.07550004590303, "ttft_ms": 13.3339170133695, "input_usage": {"receiver_prompt_tokens": 452, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12918315888, "mlx_cache_bytes": 12073774768, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12918315888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1710 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6766f0a31d9cd2578443486a", "attempt_id": "6dd14ad38e9d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.828502Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 452, "message_tokens": 348, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7183.76658402849, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.756666999310255, "ttft_ms": 13.218209031037986, "decode_ms": 13.299957965500653}, "total_wall_ms": 82.12091692257673, "ttft_ms": 13.218209031037986, "input_usage": {"receiver_prompt_tokens": 452, "sender_input_tokens": 2071, "sender_output_tokens": 512, "sender_prefill_ms": 231.16016702260822, "sender_ttft_ms": 13.696999987587333, "sender_decode_ms": 6936.842292081565}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12918315888, "mlx_cache_bytes": 12073774768, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12918315888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20bc87115e530b37a0671454dbbb91e0d096d4b8c35afd7e669e035ca6ce3d3b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1711 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2c685b24efa3e999b64ec048", "attempt_id": "17638362b4d4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:55.928551Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 590, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.78429201990366, "ttft_ms": 13.432666077278554, "decode_ms": 13.147792080417275}, "total_wall_ms": 97.30099991429597, "ttft_ms": 13.432666077278554, "input_usage": {"receiver_prompt_tokens": 590}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989719640, "mlx_cache_bytes": 12316389040, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12989719640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1712 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d64d7faf5eb93d0e29188895", "attempt_id": "a93b9ad33068", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:56.041713Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 582, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.82312502805144, "ttft_ms": 13.304208987392485, "decode_ms": 13.39579198975116}, "total_wall_ms": 97.55504201166332, "ttft_ms": 13.304208987392485, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12984607832, "mlx_cache_bytes": 12670480048, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12984607832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1713 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff865ab48e1806aa9a1a5b77", "attempt_id": "717f46789da3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:56.156346Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 582, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.33099997695535, "ttft_ms": 13.396749971434474, "decode_ms": 13.265207991935313}, "total_wall_ms": 96.9139999942854, "ttft_ms": 13.396749971434474, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12984607832, "mlx_cache_bytes": 12670480048, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12984607832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1714 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7202d9f73f90970e8e98364d", "attempt_id": "3b923a77ceb6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:56.269195Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 597, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.72662503924221, "ttft_ms": 13.230749987997115, "decode_ms": 93.52375008165836}, "total_wall_ms": 178.44600009266287, "ttft_ms": 13.230749987997115, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993848408, "mlx_cache_bytes": 12915846832, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12993848408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6602245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "d117fa8197988f8d1e4fabc6c4cdaab9516018e54553b57c63b875b3de82b16f"} | ||||
| 1715 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b9973c3fc6700e4f4d282f1f", "attempt_id": "77e3e58c2f8e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:56.463806Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 590, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.74295794498175, "ttft_ms": 13.450625003315508, "decode_ms": 80.49574994947761}, "total_wall_ms": 164.66825001407415, "ttft_ms": 13.450625003315508, "input_usage": {"receiver_prompt_tokens": 590}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1315389440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989719640, "mlx_cache_bytes": 12915846832, "process_rss_bytes": 1315389440}, "peak_prefill_memory": null, "peak_decode_memory": 12989719640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "466045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "b87a05c1686ed24576a21ca1da9c3967d1980c731d8c73962a30d77a67087945"} | ||||
| 1716 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cd230440e39765cda4b6963b", "attempt_id": "43671a6af5bd", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:56.649604Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 600, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.1686249813065, "ttft_ms": 13.339165947400033, "decode_ms": 81.0067499987781}, "total_wall_ms": 165.5202079564333, "ttft_ms": 13.339165947400033, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1315405824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992767064, "mlx_cache_bytes": 12915846832, "process_rss_bytes": 1315405824}, "peak_prefill_memory": null, "peak_decode_memory": 12992767064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1717 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8ea2c0c8e87182be8c6a6515", "attempt_id": "591293a7179f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:56.831580Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 592, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.63662500493228, "ttft_ms": 13.49820801988244, "decode_ms": 133.15179094206542}, "total_wall_ms": 217.30387501884252, "ttft_ms": 13.49820801988244, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1315405824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 12915846832, "process_rss_bytes": 1315405824}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "23,944,982", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "cff082cb587493b6ce8ea63c7fa7d17d817f702d949afd03f0a1d64a84e127ff"} | ||||
| 1718 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b28a13be6a4ff67f8c3d1344", "attempt_id": "528269d59164", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:57.065377Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 589, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.40458295866847, "ttft_ms": 13.400666997767985, "decode_ms": 13.668540981598198}, "total_wall_ms": 97.4188749678433, "ttft_ms": 13.400666997767985, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315405824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989523032, "mlx_cache_bytes": 13002550960, "process_rss_bytes": 1315405824}, "peak_prefill_memory": null, "peak_decode_memory": 12989523032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1719 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ee756c027a95c727fe7950fb", "attempt_id": "97c2f9f8fbf2", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:57.179679Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 594, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.86741698347032, "ttft_ms": 13.277290971018374, "decode_ms": 13.504415983334184}, "total_wall_ms": 97.65687491744757, "ttft_ms": 13.277290971018374, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315405824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012182104, "mlx_cache_bytes": 13268709040, "process_rss_bytes": 1315405824}, "peak_prefill_memory": null, "peak_decode_memory": 13012182104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1720 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49ad5a98dd64aadbe00d40bc", "attempt_id": "39558f7a4ed4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:57.293822Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 505, "n_sentences": 15}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 594, "message_tokens": 505, "message_utf8_bytes": 1314, "cache_tensor_bytes": null, "serialized_payload_bytes": 1314, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6317080007866025, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.6753750089556, "ttft_ms": 13.446707976981997, "decode_ms": 13.518958003260195}, "total_wall_ms": 97.59141597896814, "ttft_ms": 13.446707976981997, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1315405824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009724504, "mlx_cache_bytes": 13268709040, "process_rss_bytes": 1315405824}, "peak_prefill_memory": null, "peak_decode_memory": 13009724504, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0009772af9b2817243e3ead99293c2239a6f225cf6e895717a0815f87defc06c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1721 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc0355a8126f3ad7c5be41c8", "attempt_id": "dcad0b0426cf", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:57.633373Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.514500007033348, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.043165957555175, "ttft_ms": 19.043165957555175, "decode_ms": 147.98941602930427}, "total_wall_ms": 170.1051250565797, "ttft_ms": 19.043165957555175, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 45}, "output_usage": {"output_tokens": 11}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 14032553826, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WZ-45N-2700", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "550a95da05c6834346b0b443cf52beaccf8e1b652451eafa9ad1039a5783db15"} | ||||
| 1722 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85a34cece09c44068d0c0b46", "attempt_id": "897d4107c849", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:57.819991Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.5634169103577733, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.55995797086507, "ttft_ms": 18.55995797086507, "decode_ms": 13.147333986125886}, "total_wall_ms": 34.67866708524525, "ttft_ms": 18.55995797086507, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 14070351714, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1723 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8f5878e0f9802b6fa3fd2258", "attempt_id": "9669e515fb2a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:57.870620Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 0.5716669838875532, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.72029190417379, "ttft_ms": 18.72029190417379, "decode_ms": 13.355499948374927}, "total_wall_ms": 34.05787504743785, "ttft_ms": 18.72029190417379, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 14070384482, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1724 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0e89774a9a542fba2a96319", "attempt_id": "a4ef440477de", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:57.920693Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 52, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.460291096009314, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.185249995440245, "ttft_ms": 18.185249995440245, "decode_ms": 80.13533300254494}, "total_wall_ms": 101.19674995075911, "ttft_ms": 18.185249995440245, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 52}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12712989704, "mlx_peak_bytes": 12761683216, "mlx_cache_bytes": 14113966338, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12761683216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "537000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "a228a8518e679894dd01ee157055431826a0561bb6e5ca878cfc217107fc62c4"} | ||||
| 1725 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8ab747df8d8ed8dde1374db", "attempt_id": "543225783a98", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.037828Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.4449999434873462, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.483957974240184, "ttft_ms": 18.483957974240184, "decode_ms": 79.79774998966604}, "total_wall_ms": 101.10400000121444, "ttft_ms": 18.483957974240184, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 45}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 14115145986, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "120000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "4f9f73b34c5b89879aad65a48025f3187dd9ce6dc3d4e88eecb2fc79227350f1"} | ||||
| 1726 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7170baeff59aa25f02b611f0", "attempt_id": "446a24f5436d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.155280Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 55, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.3775420375168324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.719332991167903, "ttft_ms": 18.719332991167903, "decode_ms": 94.8105410207063}, "total_wall_ms": 116.34491698350757, "ttft_ms": 18.719332991167903, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 55}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12766713116, "mlx_cache_bytes": 14144555706, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12766713116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Nakquidra-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "58206efd6d0d4326e7c418c52ca147f6bf7dbe690ccffe91ea0f6515fb715c8f"} | ||||
| 1727 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c4451b4ab5b03c4617375371", "attempt_id": "ac236d81b908", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.288107Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 47, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.410915981978178, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.4926250949502, "ttft_ms": 18.4926250949502, "decode_ms": 93.19058409892023}, "total_wall_ms": 114.53062505461276, "ttft_ms": 18.4926250949502, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12757488912, "mlx_cache_bytes": 14150847162, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12757488912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1120854", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "1c8d566b2dcd91b6d45441dbc7d7da4a0bd56d6267dd093377aaada6f5835d86"} | ||||
| 1728 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c0112ec2cc87e7f1dafd59c4", "attempt_id": "4eac26fe00ea", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.419554Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 44, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.4565830351784825, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.050040933303535, "ttft_ms": 18.050040933303535, "decode_ms": 80.20662504713982}, "total_wall_ms": 101.14908299874514, "ttft_ms": 18.050040933303535, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 44}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12755801332, "mlx_cache_bytes": 14165707450, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12755801332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "120000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "4f9f73b34c5b89879aad65a48025f3187dd9ce6dc3d4e88eecb2fc79227350f1"} | ||||
| 1729 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7abbe8fff19de53ab4456a82", "attempt_id": "2a8149a0718d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.536988Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 49, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.5670830616727471, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.556541996076703, "ttft_ms": 18.556541996076703, "decode_ms": 13.473958009853959}, "total_wall_ms": 35.04545893520117, "ttft_ms": 18.556541996076703, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12761224464, "mlx_cache_bytes": 14200064698, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12761224464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1730 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "51ca2a9b00ff0a7f41292eb5", "attempt_id": "5751076b1fca", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.587972Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1966, "keep": 492, "compress_ms": 9.079750045202672}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 49, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153003, "side_information_bytes": 15915, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 225.58641608338803, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.119166992604733, "serialize_ms": 5.441750050522387, "load_ms": 1.1243330081924796, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.470208044163883, "ttft_ms": 18.470208044163883, "decode_ms": 13.53750005364418}, "total_wall_ms": 34.52441596891731, "ttft_ms": 18.470208044163883, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1333837824, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12760995088, "mlx_cache_bytes": 14200064698, "process_rss_bytes": 1333837824}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12760995088, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf04375bba7813a8f4743b691fdf3e2211d95e066b93d1b6dcf90f00b4fd3363", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1731 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b11cc11d0d214b8150c41bad", "attempt_id": "e9591c76ef83", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.638396Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 45, "compress_ms": 43.449708027765155}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153044, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 48.80933300592005, "doc_prefill_ms": 208.1683750730008, "compress_ms": 44.82808301690966, "serialize_ms": 3.7724170833826065, "load_ms": 0.4788750084117055, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.282916978932917, "ttft_ms": 18.282916978932917, "decode_ms": 80.69754194002599}, "total_wall_ms": 149.85475002322346, "ttft_ms": 18.282916978932917, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 45}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1334149120, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 14338541746, "process_rss_bytes": 1334149120}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-400-K", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0db1a10bd210cf4472c0325432e36a9c60ebfe9e7860c17882545caa5c4ac79f", "output_hash": "90ec525dd4379026bfd060f35e2ed11b1bfa5a84f0cede526a6e48d49b6ca231"} | ||||
| 1732 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff8bb8f3bb2f05803ca3b792", "attempt_id": "67e67fd5b87e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.804676Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 37, "compress_ms": 40.15174997039139}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153043, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.05649993754923, "doc_prefill_ms": 208.1683750730008, "compress_ms": 41.551832924596965, "serialize_ms": 4.263125010766089, "load_ms": 1.1847499990835786, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.078166991472244, "ttft_ms": 18.078166991472244, "decode_ms": 13.449000078253448}, "total_wall_ms": 80.32379194628447, "ttft_ms": 18.078166991472244, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1353023488, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 14356482226, "process_rss_bytes": 1353023488}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d73eebf91382f2f300abdc562c742add262e52c399c68205994f30740ea9810f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1733 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9edd0e5c91fe384d6eaa795d", "attempt_id": "261555042019", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.901591Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 37, "compress_ms": 40.442332974635065}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153044, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 45.91754195280373, "doc_prefill_ms": 208.1683750730008, "compress_ms": 41.82304197456688, "serialize_ms": 3.887249971739948, "load_ms": 1.165832974947989, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.94574991799891, "ttft_ms": 17.94574991799891, "decode_ms": 13.393625034950674}, "total_wall_ms": 80.01595793757588, "ttft_ms": 17.94574991799891, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1353023488, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 14356482226, "process_rss_bytes": 1353023488}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0db1a10bd210cf4472c0325432e36a9c60ebfe9e7860c17882545caa5c4ac79f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1734 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8db3947b7ac7ff12febf819e", "attempt_id": "fc70d8ae5c16", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:58.998057Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 52, "compress_ms": 41.49108298588544}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 52, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153043, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.731875045225024, "doc_prefill_ms": 208.1683750730008, "compress_ms": 42.80270799063146, "serialize_ms": 3.7170000141486526, "load_ms": 1.183916931040585, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.610708018764853, "ttft_ms": 17.610708018764853, "decode_ms": 93.17775000818074}, "total_wall_ms": 160.25237506255507, "ttft_ms": 17.610708018764853, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1353056256, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12761437456, "mlx_cache_bytes": 14391199922, "process_rss_bytes": 1353056256}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12761437456, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6602595", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d73eebf91382f2f300abdc562c742add262e52c399c68205994f30740ea9810f", "output_hash": "7c4455ef10c23de209c68cdbcc2d12474ed62bc0dff7e30d933964078254b5b0"} | ||||
| 1735 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "df3c7decabd15c1a1468cde5", "attempt_id": "b7efb456bb89", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:59.175049Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 45, "compress_ms": 40.91612494084984}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153043, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.43366695381701, "doc_prefill_ms": 208.1683750730008, "compress_ms": 42.26691706571728, "serialize_ms": 3.955375053919852, "load_ms": 1.146791037172079, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.231459078378975, "ttft_ms": 18.231459078378975, "decode_ms": 79.77475004736334}, "total_wall_ms": 147.14825002010912, "ttft_ms": 18.231459078378975, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 45}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1353072640, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 14392674482, "process_rss_bytes": 1353072640}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "466045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d73eebf91382f2f300abdc562c742add262e52c399c68205994f30740ea9810f", "output_hash": "b87a05c1686ed24576a21ca1da9c3967d1980c731d8c73962a30d77a67087945"} | ||||
| 1736 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e1f3a275b9e20d3a596d13b1", "attempt_id": "2c23662bad5b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:59.338945Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 55, "compress_ms": 41.6377920191735}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 55, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153042, "side_information_bytes": 15954, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.22574993502349, "doc_prefill_ms": 208.1683750730008, "compress_ms": 42.984292027540505, "serialize_ms": 4.028875031508505, "load_ms": 1.1698330054059625, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.429957912303507, "ttft_ms": 18.429957912303507, "decode_ms": 81.04262501001358}, "total_wall_ms": 149.38674995210022, "ttft_ms": 18.429957912303507, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1353089024, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12765631772, "mlx_cache_bytes": 14416709810, "process_rss_bytes": 1353089024}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12765631772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0cfb0c1ce8f5aac39c13624bb5ba916003b780bde2f4291260e76d35352730a", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1737 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9cd92f0897951b883b1270bc", "attempt_id": "efbc8dbb7db6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:59.504992Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 47, "compress_ms": 41.110208025202155}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 47, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153044, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.498749987222254, "doc_prefill_ms": 208.1683750730008, "compress_ms": 42.45554096996784, "serialize_ms": 3.8300000596791506, "load_ms": 1.2069579679518938, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.185416935011744, "ttft_ms": 18.185416935011744, "decode_ms": 94.07016704790294}, "total_wall_ms": 161.57333296723664, "ttft_ms": 18.185416935011744, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1353089024, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12757488912, "mlx_cache_bytes": 14422624434, "process_rss_bytes": 1353089024}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12757488912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3048187", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0db1a10bd210cf4472c0325432e36a9c60ebfe9e7860c17882545caa5c4ac79f", "output_hash": "43abbeadd4277068be5a4cc4e933bc994a1108202e8c30e377af58b69464afd0"} | ||||
| 1738 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ede37d3c2edb6695ef6a7d3", "attempt_id": "ff41858ee1ed", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:59.683497Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 44, "compress_ms": 41.8698750436306}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 44, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153042, "side_information_bytes": 15954, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.39679198246449, "doc_prefill_ms": 208.1683750730008, "compress_ms": 43.22370793670416, "serialize_ms": 3.96425009239465, "load_ms": 1.1911250185221434, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.975624999962747, "ttft_ms": 17.975624999962747, "decode_ms": 120.53833401296288}, "total_wall_ms": 188.61295899841934, "ttft_ms": 17.975624999962747, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1353105408, "backend_memory": {"mlx_active_bytes": 12712989704, "mlx_peak_bytes": 12755391732, "mlx_cache_bytes": 14434764978, "process_rss_bytes": 1353105408}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12755391732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "178632000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0cfb0c1ce8f5aac39c13624bb5ba916003b780bde2f4291260e76d35352730a", "output_hash": "5da45ef2d5f134f0eeff447afcff39a67d340ce28b9f838d058a8b2f10042597"} | ||||
| 1739 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0ad90367ae98005d1e940b61", "attempt_id": "c573d0f882db", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:59.888898Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 49, "compress_ms": 41.0847500897944}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 49, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153042, "side_information_bytes": 15954, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.5823340928182, "doc_prefill_ms": 208.1683750730008, "compress_ms": 42.46166697703302, "serialize_ms": 3.9177919970825315, "load_ms": 0.4570829914882779, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.176832934841514, "ttft_ms": 18.176832934841514, "decode_ms": 13.059708988294005}, "total_wall_ms": 79.77549999486655, "ttft_ms": 18.176832934841514, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1353121792, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12759471376, "mlx_cache_bytes": 14442121394, "process_rss_bytes": 1353121792}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12759471376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0cfb0c1ce8f5aac39c13624bb5ba916003b780bde2f4291260e76d35352730a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1740 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d89761609c39c89b5e2e71ec", "attempt_id": "3d2d00125430", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:58:59.984888Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1966, "keep": 492, "window_tokens": 49, "compress_ms": 42.3758749384433}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 49, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 18137088, "serialized_payload_bytes": 18153042, "side_information_bytes": 15954, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.76558303274214, "doc_prefill_ms": 208.1683750730008, "compress_ms": 43.804582906886935, "serialize_ms": 3.721750108525157, "load_ms": 1.0198330273851752, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.4548330726102, "ttft_ms": 18.4548330726102, "decode_ms": 13.486540992744267}, "total_wall_ms": 82.4054169934243, "ttft_ms": 18.4548330726102, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1353121792, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12759471376, "mlx_cache_bytes": 14442121394, "process_rss_bytes": 1353121792}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12759471376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0cfb0c1ce8f5aac39c13624bb5ba916003b780bde2f4291260e76d35352730a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1741 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa3861af8d33e41255fd97ce", "attempt_id": "e3ce3030dd79", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:00.227696Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 2.3732080589979887, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.352124982513487, "ttft_ms": 21.352124982513487, "decode_ms": 145.5852499930188}, "total_wall_ms": 170.95979198347777, "ttft_ms": 21.352124982513487, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1430257664, "backend_memory": {"mlx_active_bytes": 12751939976, "mlx_peak_bytes": 12822252752, "mlx_cache_bytes": 14574903602, "process_rss_bytes": 1430257664}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12822252752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 1742 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "680aa60def2021be56a971d0", "attempt_id": "279c78a7e255", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:00.416006Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.918083056807518, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.644208998419344, "ttft_ms": 20.644208998419344, "decode_ms": 14.83079104218632}, "total_wall_ms": 38.818374974653125, "ttft_ms": 20.644208998419344, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1430372352, "backend_memory": {"mlx_active_bytes": 12751928744, "mlx_peak_bytes": 12830602936, "mlx_cache_bytes": 14574914834, "process_rss_bytes": 1430372352}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12830602936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1743 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "77eecdd8f464678f8a65a23f", "attempt_id": "3d8e6da39af4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:00.471556Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 37, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.7218749271705747, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.939833018928766, "ttft_ms": 20.939833018928766, "decode_ms": 14.85579099971801}, "total_wall_ms": 38.94250001758337, "ttft_ms": 20.939833018928766, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1430372352, "backend_memory": {"mlx_active_bytes": 12751928744, "mlx_peak_bytes": 12830602936, "mlx_cache_bytes": 14574914834, "process_rss_bytes": 1430372352}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12830602936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1744 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3012ca9c813f6693a625aa47", "attempt_id": "b1d18d0aa49c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:00.526598Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 52, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.9973749294877052, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.98087500780821, "ttft_ms": 20.98087500780821, "decode_ms": 105.18387495540082}, "total_wall_ms": 129.58299997262657, "ttft_ms": 20.98087500780821, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1430765568, "backend_memory": {"mlx_active_bytes": 12751944584, "mlx_peak_bytes": 12831007820, "mlx_cache_bytes": 14614459250, "process_rss_bytes": 1430765568}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12831007820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6602245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "d117fa8197988f8d1e4fabc6c4cdaab9516018e54553b57c63b875b3de82b16f"} | ||||
| 1745 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c891e9ff12d9ae4609dd7c9e", "attempt_id": "f94290b7f69d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:00.672703Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 45, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.8695000326260924, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.671042031608522, "ttft_ms": 20.671042031608522, "decode_ms": 101.9553339574486}, "total_wall_ms": 125.9101249743253, "ttft_ms": 20.671042031608522, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1430781952, "backend_memory": {"mlx_active_bytes": 12751936520, "mlx_peak_bytes": 12822251632, "mlx_cache_bytes": 14614467314, "process_rss_bytes": 1430781952}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12822251632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "466,045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "4a66e3c0960c26d2429d36e0c7f9d4c2192499734aa4ec831aea9100579be90f"} | ||||
| 1746 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7aff44e256318818a0c0fa4a", "attempt_id": "ba12d87edf4e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:00.815075Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 55, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 2.0609170896932483, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.689167013391852, "ttft_ms": 21.689167013391852, "decode_ms": 88.03379104938358}, "total_wall_ms": 113.24429197702557, "ttft_ms": 21.689167013391852, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1431339008, "backend_memory": {"mlx_active_bytes": 12751946888, "mlx_peak_bytes": 12835631624, "mlx_cache_bytes": 14651279330, "process_rss_bytes": 1431339008}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12835631624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1747 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7b4d8bdb6d25a17a404a8392", "attempt_id": "692a27bc4ab3", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:00.944953Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 47, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.6596670029684901, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.70550003554672, "ttft_ms": 20.70550003554672, "decode_ms": 102.48075006529689}, "total_wall_ms": 126.29129097331315, "ttft_ms": 20.70550003554672, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1431355392, "backend_memory": {"mlx_active_bytes": 12751938824, "mlx_peak_bytes": 12824611388, "mlx_cache_bytes": 14678566754, "process_rss_bytes": 1431355392}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12824611388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4445448", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "cebea831caa9b1760d2576a6b3093b66fe4520ced5a5c5a2ec35657de828ed70"} | ||||
| 1748 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ac148d393a4f6e79d046e201", "attempt_id": "63391b061c41", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:01.087839Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 44, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.847042003646493, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.762374973855913, "ttft_ms": 20.762374973855913, "decode_ms": 72.68700003623962}, "total_wall_ms": 96.70941601507366, "ttft_ms": 20.762374973855913, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1431388160, "backend_memory": {"mlx_active_bytes": 12751933064, "mlx_peak_bytes": 12821055776, "mlx_cache_bytes": 14704082402, "process_rss_bytes": 1431388160}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12821055776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44620", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "2bd125847727be7e7c0a656ee4c81f3bc6d0fef11f536f50ce7bc83688907075"} | ||||
| 1749 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c1fdd526ca497fa44ecba18a", "attempt_id": "85e4ef0d7bcc", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:01.201347Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 49, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.2473339447751641, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.798625075258315, "ttft_ms": 20.798625075258315, "decode_ms": 14.663167065009475}, "total_wall_ms": 38.12341601587832, "ttft_ms": 20.798625075258315, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1431404544, "backend_memory": {"mlx_active_bytes": 12751934216, "mlx_peak_bytes": 12827661116, "mlx_cache_bytes": 14732540258, "process_rss_bytes": 1431404544}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12827661116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1750 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd57d6edfc0b61f99646489a", "attempt_id": "465706ecccab", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:01.256032Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711863048}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1927, "source_tokens_receiver": 1927, "query_tokens": 49, "message_tokens": 1966, "message_utf8_bytes": 7489, "cache_tensor_bytes": 38502144, "serialized_payload_bytes": 38536334, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 143.43108294997364, "doc_prefill_ms": 208.1683750730008, "compress_ms": 9.921207907609642, "serialize_ms": 133.123500039801, "load_ms": 1.9615839701145887, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.83758299704641, "ttft_ms": 20.83758299704641, "decode_ms": 14.501875033602118}, "total_wall_ms": 38.825249997898936, "ttft_ms": 20.83758299704641, "input_usage": {"receiver_prefix_tokens": 1966, "dense_cache_bytes": 72474624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1431404544, "backend_memory": {"mlx_active_bytes": 12751934216, "mlx_peak_bytes": 12827661116, "mlx_cache_bytes": 14732540258, "process_rss_bytes": 1431404544}, "peak_prefill_memory": 13456503720, "peak_decode_memory": 12827661116, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "dc8a5e68f73b02158e28d80b2eb2e6b834d3ebbb74da48b1af054995d5dfdc17", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1751 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "143126816336b9b2b713872a", "attempt_id": "8c56b132ccab", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:01.385157Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1871, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.89266696758568, "ttft_ms": 14.802124933339655, "decode_ms": 99.68037495855242}, "total_wall_ms": 328.84904195088893, "ttft_ms": 14.802124933339655, "input_usage": {"receiver_prompt_tokens": 1871}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 727678976, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13295251820, "mlx_cache_bytes": 824614288, "process_rss_bytes": 727678976}, "peak_prefill_memory": null, "peak_decode_memory": 13295251820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 1752 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e9f097c4fa89fac9ca366b2a", "attempt_id": "83d0c6826627", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:01.736629Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1864, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 200.76941698789597, "ttft_ms": 13.979417039081454, "decode_ms": 27.924290974624455}, "total_wall_ms": 245.29008311219513, "ttft_ms": 13.979417039081454, "input_usage": {"receiver_prompt_tokens": 1864}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 727678976, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13293482348, "mlx_cache_bytes": 1259707792, "process_rss_bytes": 727678976}, "peak_prefill_memory": null, "peak_decode_memory": 13293482348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1753 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "edb61c2755de30c4cfbca084", "attempt_id": "65c9b12feeda", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:02.000286Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1865, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 201.15233305841684, "ttft_ms": 14.138709055259824, "decode_ms": 27.9671250609681}, "total_wall_ms": 245.8394579589367, "ttft_ms": 14.138709055259824, "input_usage": {"receiver_prompt_tokens": 1865}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 727695360, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13293580652, "mlx_cache_bytes": 1442946448, "process_rss_bytes": 727695360}, "peak_prefill_memory": null, "peak_decode_memory": 13293580652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1754 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed398aa59c38656412271afc", "attempt_id": "2487c4faad77", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:02.261995Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1880, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 203.36754200980067, "ttft_ms": 14.304874930530787, "decode_ms": 70.64941700082272}, "total_wall_ms": 290.9740830073133, "ttft_ms": 14.304874930530787, "input_usage": {"receiver_prompt_tokens": 1880}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 727711744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13297365392, "mlx_cache_bytes": 1916435180, "process_rss_bytes": 727711744}, "peak_prefill_memory": null, "peak_decode_memory": 13297365392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,899,340", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "cdcb6f9099e6e651a99b4424bdf64b76bf516969970c3c7ba61297500761eb4f"} | ||||
| 1755 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "12eb4ad27a79fb2288d726b9", "attempt_id": "64e27da6f7ad", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:02.568366Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1872, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 203.73758301138878, "ttft_ms": 14.159333077259362, "decode_ms": 42.728666914626956}, "total_wall_ms": 263.14091694075614, "ttft_ms": 14.159333077259362, "input_usage": {"receiver_prompt_tokens": 1872}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 727711744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13295350160, "mlx_cache_bytes": 2100361964, "process_rss_bytes": 727711744}, "peak_prefill_memory": null, "peak_decode_memory": 13295350160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "466,045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "4a66e3c0960c26d2429d36e0c7f9d4c2192499734aa4ec831aea9100579be90f"} | ||||
| 1756 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f2d0866d1b0b45ec99532eb9", "attempt_id": "32eaef803689", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:02.847861Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1882, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.0658330814913, "ttft_ms": 14.79416701477021, "decode_ms": 84.37070797663182}, "total_wall_ms": 309.8342079902068, "ttft_ms": 14.79416701477021, "input_usage": {"receiver_prompt_tokens": 1882}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 727711744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13298069912, "mlx_cache_bytes": 2574555216, "process_rss_bytes": 727711744}, "peak_prefill_memory": null, "peak_decode_memory": 13298069912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1757 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9ac6914336b00d7699a063fb", "attempt_id": "63e881c85b43", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:03.173489Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1875, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.56191595178097, "ttft_ms": 14.046167023479939, "decode_ms": 323.77229107078165}, "total_wall_ms": 552.6207919465378, "ttft_ms": 14.046167023479939, "input_usage": {"receiver_prompt_tokens": 1875}, "output_usage": {"output_tokens": 23}, "provider_cached_usage": null, "process_memory": 727728128, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13296152976, "mlx_cache_bytes": 3012171856, "process_rss_bytes": 727728128}, "peak_prefill_memory": null, "peak_decode_memory": 13296152976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,381,835\n5,690,750\n1,839,955\n9,381,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "2eb12945f311d9a531389537752f1f08c58fb7f17cebc2b228085e958cee5761"} | ||||
| 1758 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8239180d5d6516d37886577b", "attempt_id": "8c4d911641ff", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:03.741980Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1872, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 201.1252089869231, "ttft_ms": 14.22062492929399, "decode_ms": 42.552834027446806}, "total_wall_ms": 265.3423750307411, "ttft_ms": 14.22062492929399, "input_usage": {"receiver_prompt_tokens": 1872}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 727777280, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13295350160, "mlx_cache_bytes": 3012171856, "process_rss_bytes": 727777280}, "peak_prefill_memory": null, "peak_decode_memory": 13295350160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.62", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "d9a3265d0a78db3d082616021f44cd388888ddddf0a7328ce458e95e7824f8e9"} | ||||
| 1759 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "726129e77e2a7ebf716b658d", "attempt_id": "9ad7df0fc529", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:04.023470Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1876, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 213.56225002091378, "ttft_ms": 14.251457992941141, "decode_ms": 13.974459026940167}, "total_wall_ms": 244.33279095683247, "ttft_ms": 14.251457992941141, "input_usage": {"receiver_prompt_tokens": 1876}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 727777280, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13334704540, "mlx_cache_bytes": 3254163536, "process_rss_bytes": 727777280}, "peak_prefill_memory": null, "peak_decode_memory": 13334704540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1760 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c5c6fed618b3a9ffeb8f7989", "attempt_id": "ed595cef7d26", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:04.284307Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 1877, "message_tokens": 1767, "message_utf8_bytes": 7489, "cache_tensor_bytes": null, "serialized_payload_bytes": 7489, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.007875030860304832, "decode_payload_ms": 0.0, "receiver_prefill_ms": 228.79241697955877, "ttft_ms": 14.436000026762486, "decode_ms": 14.202040969394147}, "total_wall_ms": 260.03262505400926, "ttft_ms": 14.436000026762486, "input_usage": {"receiver_prompt_tokens": 1877}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 727777280, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13354742160, "mlx_cache_bytes": 3438581840, "process_rss_bytes": 727777280}, "peak_prefill_memory": null, "peak_decode_memory": 13354742160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1761 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f1da7f3ef71ed537a35b07f", "attempt_id": "27481c7454c2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:12.000130Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.09425000939518, "ttft_ms": 13.977666036225855, "decode_ms": 94.65379198081791}, "total_wall_ms": 187.43824993725866, "ttft_ms": 13.977666036225855, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13049929224, "mlx_cache_bytes": 4912089008, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13049929224, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 1762 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "65a65a26bd8929db76262645", "attempt_id": "83fe0cc0fdb7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:12.204021Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.72925002407283, "ttft_ms": 13.523290981538594, "decode_ms": 27.055834070779383}, "total_wall_ms": 118.405457935296, "ttft_ms": 13.523290981538594, "input_usage": {"receiver_prompt_tokens": 614, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198280, "mlx_cache_bytes": 5255006128, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13038198280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1763 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae1798b9ca68349d241ba46a", "attempt_id": "a4b7f8034345", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:12.338467Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.65408391039819, "ttft_ms": 13.602540944702923, "decode_ms": 27.488625026308}, "total_wall_ms": 118.86408308055252, "ttft_ms": 13.602540944702923, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083016, "mlx_cache_bytes": 5538465712, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13039083016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1764 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d31f29aade09f8cd4a98b515", "attempt_id": "d8b91fa8dc06", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:12.473171Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 630, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.40000006742775, "ttft_ms": 13.813124969601631, "decode_ms": 68.13470798078924}, "total_wall_ms": 160.54575005546212, "ttft_ms": 13.813124969601631, "input_usage": {"receiver_prompt_tokens": 630, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047176748, "mlx_cache_bytes": 5878829444, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13047176748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,602,245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "f121947078d464ab91a83739861b98c336a10c001704e2df84cc2b041bb8f4de"} | ||||
| 1765 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4561e1370e25306f2f74a727", "attempt_id": "132e8a25331e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:12.650433Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.06512499134988, "ttft_ms": 13.598500052466989, "decode_ms": 13.458249974064529}, "total_wall_ms": 105.15079100150615, "ttft_ms": 13.598500052466989, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13054139948, "mlx_cache_bytes": 6062068100, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13054139948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1766 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f81ba5a22b6bf05785e4eddc", "attempt_id": "32a1bd9398a7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:12.772275Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 632, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.73854106198996, "ttft_ms": 13.59266706276685, "decode_ms": 13.578041922301054}, "total_wall_ms": 106.00562498439103, "ttft_ms": 13.59266706276685, "input_usage": {"receiver_prompt_tokens": 632, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13056335412, "mlx_cache_bytes": 6391929696, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13056335412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1767 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ee60bed46223720a601c6c39", "attempt_id": "13a8eaef2f17", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:12.894200Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.65708398073912, "ttft_ms": 13.6417499743402, "decode_ms": 67.47712497599423}, "total_wall_ms": 159.85441603697836, "ttft_ms": 13.6417499743402, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13044129324, "mlx_cache_bytes": 6671801184, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13044129324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,703,177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "6b5e55f3e632d49839d73369d95b5ada5541a94ac23e7caff218a9700daa94bf"} | ||||
| 1768 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0f8ca6ff08be1b40a9fb8007", "attempt_id": "8ac3396e52bc", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:13.069903Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.38529106043279, "ttft_ms": 13.574208016507328, "decode_ms": 41.38629196677357}, "total_wall_ms": 132.44337495416403, "ttft_ms": 13.574208016507328, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13054139948, "mlx_cache_bytes": 6671801184, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13054139948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.62", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "d9a3265d0a78db3d082616021f44cd388888ddddf0a7328ce458e95e7824f8e9"} | ||||
| 1769 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5b73f2e69ed2f4c4ac8137e9", "attempt_id": "1571f01c3efe", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:13.218253Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.09404202271253, "ttft_ms": 13.772417092695832, "decode_ms": 13.458415982313454}, "total_wall_ms": 106.46866704337299, "ttft_ms": 13.772417092695832, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13084565036, "mlx_cache_bytes": 6860069728, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13084565036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1770 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27bbdfbb7c141e3053d85738", "attempt_id": "ad260db84e78", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:13.341314Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1668, "cache_tensor_bytes": null, "serialized_payload_bytes": 1668, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7439.665790996514, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.29137502610683, "ttft_ms": 13.482292066328228, "decode_ms": 13.746542041189969}, "total_wall_ms": 105.56083300616592, "ttft_ms": 13.482292066328228, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 1901, "sender_output_tokens": 512, "sender_prefill_ms": 243.8546249177307, "sender_ttft_ms": 14.909707941114902, "sender_decode_ms": 7172.861416940577}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728252416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13084745260, "mlx_cache_bytes": 6983146336, "process_rss_bytes": 728252416}, "peak_prefill_memory": null, "peak_decode_memory": 13084745260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e0d03f580f73d979319a9f0ffc1596e15d1f6dedc49c2aee59c152036bbf376", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1771 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bd81300d7840d116e39bff94", "attempt_id": "1f91a35806fd", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:20.876924Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 424, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.37291697692126, "ttft_ms": 13.707666890695691, "decode_ms": 13.590208953246474}, "total_wall_ms": 83.5133750224486, "ttft_ms": 13.707666890695691, "input_usage": {"receiver_prompt_tokens": 424, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899572824, "mlx_cache_bytes": 7722023304, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12899572824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1772 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "206f4af88172d8a1a8b54586", "attempt_id": "d3e4e2027200", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:20.979496Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 417, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.8423750763759, "ttft_ms": 13.783916947431862, "decode_ms": 13.512125005945563}, "total_wall_ms": 79.96295799966902, "ttft_ms": 13.783916947431862, "input_usage": {"receiver_prompt_tokens": 417, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12895411288, "mlx_cache_bytes": 7954610568, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12895411288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1773 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3adc3f5e87e7f10ca1beea82", "attempt_id": "4c5851071fdc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.076158Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 418, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.468334001488984, "ttft_ms": 13.668958912603557, "decode_ms": 13.368250103667378}, "total_wall_ms": 83.2988329930231, "ttft_ms": 13.668958912603557, "input_usage": {"receiver_prompt_tokens": 418, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12896492632, "mlx_cache_bytes": 8188295560, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12896492632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 1774 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3bcff6ff7a43ef7ca2588e5f", "attempt_id": "26fed8cccbc8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.175863Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 433, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.24341692216694, "ttft_ms": 13.663707999512553, "decode_ms": 13.887124950997531}, "total_wall_ms": 83.6336660431698, "ttft_ms": 13.663707999512553, "input_usage": {"receiver_prompt_tokens": 433, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904389720, "mlx_cache_bytes": 8445753736, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12904389720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1775 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ad0e4e7b60c7475887805fc4", "attempt_id": "be71471bbba4", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.275279Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 425, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.4118329891935, "ttft_ms": 13.695082976482809, "decode_ms": 13.411124935373664}, "total_wall_ms": 83.356500021182, "ttft_ms": 13.695082976482809, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899753048, "mlx_cache_bytes": 8529115528, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12899753048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1776 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "70bbc1e0538e4013f4d10df8", "attempt_id": "8ec2427afa93", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.374824Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 435, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.769499925896525, "ttft_ms": 13.7458749813959, "decode_ms": 13.473125058226287}, "total_wall_ms": 82.81950000673532, "ttft_ms": 13.7458749813959, "input_usage": {"receiver_prompt_tokens": 435, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12905946200, "mlx_cache_bytes": 8788162952, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12905946200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1777 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "abf8950218e75d7f5ba16cd8", "attempt_id": "b148275eb213", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.473358Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 428, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.767832974903286, "ttft_ms": 13.741416041739285, "decode_ms": 13.621667050756514}, "total_wall_ms": 83.04691698867828, "ttft_ms": 13.741416041739285, "input_usage": {"receiver_prompt_tokens": 428, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12924165208, "mlx_cache_bytes": 8940566920, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12924165208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1778 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "005877b5a97c3523c1463ca6", "attempt_id": "e4991831b795", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.573840Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 425, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.29024999123067, "ttft_ms": 13.737458037212491, "decode_ms": 40.516666951589286}, "total_wall_ms": 110.39758299011737, "ttft_ms": 13.737458037212491, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12899753048, "mlx_cache_bytes": 8940566920, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12899753048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.62", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "d9a3265d0a78db3d082616021f44cd388888ddddf0a7328ce458e95e7824f8e9"} | ||||
| 1779 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1c21b30e369610b271c34b9b", "attempt_id": "06f7d5dba94e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.700883Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 429, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.47074996866286, "ttft_ms": 13.910667039453983, "decode_ms": 13.585458043962717}, "total_wall_ms": 83.82337493821979, "ttft_ms": 13.910667039453983, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12929653848, "mlx_cache_bytes": 9024715144, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12929653848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1780 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce49ca7d903c44a6f4ea5a91", "attempt_id": "83c702259a33", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.800991Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 430, "message_tokens": 304, "message_utf8_bytes": 824, "cache_tensor_bytes": null, "serialized_payload_bytes": 824, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7413.977208081633, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.63266605511308, "ttft_ms": 13.62350000999868, "decode_ms": 13.897291966713965}, "total_wall_ms": 83.06216599885374, "ttft_ms": 13.62350000999868, "input_usage": {"receiver_prompt_tokens": 430, "sender_input_tokens": 1931, "sender_output_tokens": 512, "sender_prefill_ms": 213.80954200867563, "sender_ttft_ms": 14.713792013935745, "sender_decode_ms": 7183.874165988527}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728301568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12930227288, "mlx_cache_bytes": 9109059976, "process_rss_bytes": 728301568}, "peak_prefill_memory": null, "peak_decode_memory": 12930227288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4982c31f835d407e58817c10d900b3e20e22159fcf3d9727e1b177c6e1e5ee5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1781 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a27e6fceedd837e5031a7da", "attempt_id": "14ddf94adbc9", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:21.901823Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 605, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.84516594558954, "ttft_ms": 13.839957886375487, "decode_ms": 13.900834019295871}, "total_wall_ms": 103.75866701360792, "ttft_ms": 13.839957886375487, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728317952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032889864, "mlx_cache_bytes": 9469524360, "process_rss_bytes": 728317952}, "peak_prefill_memory": null, "peak_decode_memory": 13032889864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1782 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "50484bfd98910b8a8690006c", "attempt_id": "2f7fa98b1de0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:22.021784Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 598, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.73216694779694, "ttft_ms": 13.80008296109736, "decode_ms": 27.528499951586127}, "total_wall_ms": 117.12075001560152, "ttft_ms": 13.80008296109736, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 728317952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13028924936, "mlx_cache_bytes": 9803495816, "process_rss_bytes": 728317952}, "peak_prefill_memory": null, "peak_decode_memory": 13028924936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1783 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aae7253e6ae354e2d24b2243", "attempt_id": "59e15a535c37", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:22.155487Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 599, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.3646250339225, "ttft_ms": 13.971084030345082, "decode_ms": 27.52904105000198}, "total_wall_ms": 116.94225005339831, "ttft_ms": 13.971084030345082, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 728317952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13029809672, "mlx_cache_bytes": 10079582600, "process_rss_bytes": 728317952}, "peak_prefill_memory": null, "peak_decode_memory": 13029809672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1784 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b1418f4410a79e846dbd2558", "attempt_id": "ea69c84c24a9", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:22.288307Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 614, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.09250000678003, "ttft_ms": 14.175625052303076, "decode_ms": 69.14729194249958}, "total_wall_ms": 160.54683295078576, "ttft_ms": 14.175625052303076, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 728317952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198280, "mlx_cache_bytes": 10079582600, "process_rss_bytes": 728317952}, "peak_prefill_memory": null, "peak_decode_memory": 13038198280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "6,602,245", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "f121947078d464ab91a83739861b98c336a10c001704e2df84cc2b041bb8f4de"} | ||||
| 1785 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a105c3c699ac8756a65d6d9b", "attempt_id": "de85d3599696", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:22.465388Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 606, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.75250004790723, "ttft_ms": 13.608457986265421, "decode_ms": 40.730625041760504}, "total_wall_ms": 130.1683330675587, "ttft_ms": 13.608457986265421, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 728317952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033266696, "mlx_cache_bytes": 10258102664, "process_rss_bytes": 728317952}, "peak_prefill_memory": null, "peak_decode_memory": 13033266696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "587,410", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "1ff6356b78c4ee5e9f9d86b1793571429696bc7d99bc3d89ec1c4be0b9afaa97"} | ||||
| 1786 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8c36e3292193a07571eefe8", "attempt_id": "976697f07d1e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:22.611609Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 616, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.26112503930926, "ttft_ms": 13.640417018905282, "decode_ms": 81.36945904698223}, "total_wall_ms": 172.3315000999719, "ttft_ms": 13.640417018905282, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 728317952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039459848, "mlx_cache_bytes": 10439571848, "process_rss_bytes": 728317952}, "peak_prefill_memory": null, "peak_decode_memory": 13039459848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1787 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9695cb75136d489ca514d8f9", "attempt_id": "a24d157c0370", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:22.800347Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 609, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.9094580532983, "ttft_ms": 13.743708026595414, "decode_ms": 543.6530419392511}, "total_wall_ms": 633.3902920596302, "ttft_ms": 13.743708026595414, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 40}, "provider_cached_usage": null, "process_memory": 728350720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708488, "mlx_cache_bytes": 10779507080, "process_rss_bytes": 728350720}, "peak_prefill_memory": null, "peak_decode_memory": 13034708488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,381,835 + 9,381,835 + 5,690,750 + 5,899,340 + 6,602,245 = 37,455,705", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "fb94293bfcc703eef98304430263f2cdb5a668a1cd2c774c5bc08c3b8f2ae69e"} | ||||
| 1788 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "17f4e7048181413d68cb6ca9", "attempt_id": "a1631410fff1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:23.450617Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 606, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.32558399159461, "ttft_ms": 13.609791989438236, "decode_ms": 13.436042005196214}, "total_wall_ms": 102.35204198397696, "ttft_ms": 13.609791989438236, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728350720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13033266696, "mlx_cache_bytes": 10779507080, "process_rss_bytes": 728350720}, "peak_prefill_memory": null, "peak_decode_memory": 13033266696, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1789 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f7aee0744d6ea0159b8a47f9", "attempt_id": "ea4553d39591", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:23.569646Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 610, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.8380419574678, "ttft_ms": 13.653249945491552, "decode_ms": 13.60295806080103}, "total_wall_ms": 104.08966708928347, "ttft_ms": 13.653249945491552, "input_usage": {"receiver_prompt_tokens": 610}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728350720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067066888, "mlx_cache_bytes": 10996726152, "process_rss_bytes": 728350720}, "peak_prefill_memory": null, "peak_decode_memory": 13067066888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1790 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "daf0b3c64b972a03107b982c", "attempt_id": "b166d53fd19d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:23.689159Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 500, "n_sentences": 20}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 611, "message_tokens": 500, "message_utf8_bytes": 1710, "cache_tensor_bytes": null, "serialized_payload_bytes": 1710, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.6748750349506736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.9876670781523, "ttft_ms": 13.793749967589974, "decode_ms": 13.650582986883819}, "total_wall_ms": 104.40162499435246, "ttft_ms": 13.793749967589974, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 728350720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13074783752, "mlx_cache_bytes": 11116657032, "process_rss_bytes": 728350720}, "peak_prefill_memory": null, "peak_decode_memory": 13074783752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2212d18b16bddab1b6ad98b1c9c164f3ba2e3f86070cfad88e4f01710f4c0a62", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1791 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b01145e2f4c505cf1048e078", "attempt_id": "185266f9a57b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.115532Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 44, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.1769160628318787, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.349874997511506, "ttft_ms": 18.349874997511506, "decode_ms": 41.27045802306384}, "total_wall_ms": 62.44816700927913, "ttft_ms": 18.349874997511506, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 806453248, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12991321320, "mlx_cache_bytes": 11340577513, "process_rss_bytes": 806453248}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12991321320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not found.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "0802559db1375af3ff5caabba71acea1d6299f1a7fc64b6a5024f19cbd33b72f"} | ||||
| 1792 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "55f69aba8ac6e902e715cb8f", "attempt_id": "0f1b27991685", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.194772Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 37, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.114083919674158, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.073834013193846, "ttft_ms": 18.073834013193846, "decode_ms": 13.693541986867785}, "total_wall_ms": 34.22437491826713, "ttft_ms": 18.073834013193846, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 806453248, "backend_memory": {"mlx_active_bytes": 12942365704, "mlx_peak_bytes": 12983653608, "mlx_cache_bytes": 11445009129, "process_rss_bytes": 806453248}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12983653608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 1793 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38f3c0dcaadfc0b3eaaebf76", "attempt_id": "3401056a0fa6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.245093Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 38, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.44379201810807, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.76525005698204, "ttft_ms": 17.76525005698204, "decode_ms": 13.75404093414545}, "total_wall_ms": 34.46954092942178, "ttft_ms": 17.76525005698204, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 806453248, "backend_memory": {"mlx_active_bytes": 12942365704, "mlx_peak_bytes": 12985111784, "mlx_cache_bytes": 11475516137, "process_rss_bytes": 806453248}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12985111784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1794 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6881bcca098eb69d7fa321b0", "attempt_id": "158f54245e0f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.295653Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 53, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.6132909804582596, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.124207970686257, "ttft_ms": 18.124207970686257, "decode_ms": 27.62345806695521}, "total_wall_ms": 48.67508297320455, "ttft_ms": 18.124207970686257, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 53}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 806453248, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12998202636, "mlx_cache_bytes": 11506075530, "process_rss_bytes": 806453248}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12998202636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "$0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "ce66470e18f3579ac7665d2a660da03089cd89698b57c5e900e8ba608bb394ee"} | ||||
| 1795 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c25e89ff2c7d90ae0c44f84", "attempt_id": "8adb3e817072", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.360330Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 45, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.3005000073462725, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.03641696460545, "ttft_ms": 18.03641696460545, "decode_ms": 28.006125008687377}, "total_wall_ms": 48.685292014852166, "ttft_ms": 18.03641696460545, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 806453248, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12991812876, "mlx_cache_bytes": 11516397450, "process_rss_bytes": 806453248}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12991812876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1796 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cc14b59fedfdff04026b72b9", "attempt_id": "a23f9cf089dd", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.424640Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 55, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.6306249890476465, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.901083920150995, "ttft_ms": 17.901083920150995, "decode_ms": 83.50841701030731}, "total_wall_ms": 104.47116603609174, "ttft_ms": 17.901083920150995, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 806453248, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 12999922964, "mlx_cache_bytes": 11623486739, "process_rss_bytes": 806453248}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12999922964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1797 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "819d29019fced2b60acbf720", "attempt_id": "e75ef5f12419", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.545038Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 48, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.5677079791203141, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.95679097995162, "ttft_ms": 17.95679097995162, "decode_ms": 68.93887498881668}, "total_wall_ms": 89.9224579334259, "ttft_ms": 17.95679097995162, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 806453248, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12994008332, "mlx_cache_bytes": 11662480659, "process_rss_bytes": 806453248}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12994008332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,911,955", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "c788da59a9ec4695f7945d51c50788bb00e74710f9aca8ad8da57bea6e50d595"} | ||||
| 1798 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7068b7cf3d0773c94f81a7d2", "attempt_id": "c016c906dd5e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.653644Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 45, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.5778340166434646, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.77079200837761, "ttft_ms": 17.77079200837761, "decode_ms": 178.30033402424306}, "total_wall_ms": 199.02158295735717, "ttft_ms": 17.77079200837761, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 45}, "output_usage": {"output_tokens": 13}, "provider_cached_usage": null, "process_memory": 806469632, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 12991812876, "mlx_cache_bytes": 11661563155, "process_rss_bytes": 806469632}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12991812876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "There is no Felaldfel-9 in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "74ff506286db275cb104766da9d576a58fa608b1fa21ed7cb90b5c62486b55d0"} | ||||
| 1799 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e6b6a81f04b4e3fcb3864abe", "attempt_id": "461ff62d3072", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.868613Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 49, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 0.6698330398648977, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.842667060904205, "ttft_ms": 17.842667060904205, "decode_ms": 13.652084046043456}, "total_wall_ms": 33.4887090139091, "ttft_ms": 17.842667060904205, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 806486016, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12999038220, "mlx_cache_bytes": 11690038547, "process_rss_bytes": 806486016}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12999038220, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1800 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "20706f8beb067633bfabe1e2", "attempt_id": "5bb6402124f6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.918605Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12885480456}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1827, "keep": 457, "compress_ms": 7.370291044935584}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 50, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425298, "side_information_bytes": 12882, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 306.09654204454273, "doc_prefill_ms": 196.8172499909997, "compress_ms": 7.409499958157539, "serialize_ms": 99.32491695508361, "load_ms": 1.6993749886751175, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.04899994749576, "ttft_ms": 18.04899994749576, "decode_ms": 13.622749946080148}, "total_wall_ms": 34.693207941018045, "ttft_ms": 18.04899994749576, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 806486016, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12999890188, "mlx_cache_bytes": 11714336019, "process_rss_bytes": 806486016}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12999890188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "49d4681b8cf52d3f0115168110940be7e5ac852f513e6f94674701d2045336d0", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1801 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "414d4a14e5d680b3f1aacbf5", "attempt_id": "b51aa67f5c76", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:24.969240Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 44, "compress_ms": 45.44595896732062}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 44, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425338, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.628875037655234, "doc_prefill_ms": 196.8172499909997, "compress_ms": 46.69654194731265, "serialize_ms": 8.748791995458305, "load_ms": 1.1631250381469727, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.52229197882116, "ttft_ms": 17.52229197882116, "decode_ms": 96.0724160540849}, "total_wall_ms": 171.84066702611744, "ttft_ms": 17.52229197882116, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 806748160, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12991321320, "mlx_cache_bytes": 11978003835, "process_rss_bytes": 806748160}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12991321320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3c833cc75e8fe1d61f7e43200f40dd7a87d9661020ca15076c289db3aeb070f6", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 1802 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c9e57a0f97da1742fd3d5cf6", "attempt_id": "c72fb15f5a9f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:25.157589Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 37, "compress_ms": 42.45345795061439}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 37, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425338, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.71825001202524, "doc_prefill_ms": 196.8172499909997, "compress_ms": 43.71629189699888, "serialize_ms": 9.82020900119096, "load_ms": 1.3961660442873836, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.245707917027175, "ttft_ms": 17.245707917027175, "decode_ms": 27.551874984055758}, "total_wall_ms": 101.27783298958093, "ttft_ms": 17.245707917027175, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12942365704, "mlx_peak_bytes": 12983653608, "mlx_cache_bytes": 11988178299, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12983653608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3c833cc75e8fe1d61f7e43200f40dd7a87d9661020ca15076c289db3aeb070f6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1803 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fa759d46fe155397b77055be", "attempt_id": "6c3e4f891331", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:25.275647Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 38, "compress_ms": 43.23075001593679}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 38, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425338, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.0256669735536, "doc_prefill_ms": 196.8172499909997, "compress_ms": 44.520084047690034, "serialize_ms": 8.319957996718585, "load_ms": 1.5074170660227537, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.428457969799638, "ttft_ms": 17.428457969799638, "decode_ms": 27.53029193263501}, "total_wall_ms": 100.9167080046609, "ttft_ms": 17.428457969799638, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12985095400, "mlx_cache_bytes": 12006020475, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12985095400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3c833cc75e8fe1d61f7e43200f40dd7a87d9661020ca15076c289db3aeb070f6", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1804 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b9f8ec6bbc4447269e23d43", "attempt_id": "314d3feda019", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:25.392969Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 53, "compress_ms": 43.61504199914634}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 53, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425338, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.192416904494166, "doc_prefill_ms": 196.8172499909997, "compress_ms": 44.885208015330136, "serialize_ms": 8.12499993480742, "load_ms": 1.4366250252351165, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.35683309379965, "ttft_ms": 17.35683309379965, "decode_ms": 68.74229200184345}, "total_wall_ms": 142.16749998740852, "ttft_ms": 17.35683309379965, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 12998202636, "mlx_cache_bytes": 12016702843, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12998202636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,899,340", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3c833cc75e8fe1d61f7e43200f40dd7a87d9661020ca15076c289db3aeb070f6", "output_hash": "cdcb6f9099e6e651a99b4424bdf64b76bf516969970c3c7ba61297500761eb4f"} | ||||
| 1805 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f50543e5460d9f1b0be53a3c", "attempt_id": "5f4907750876", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:25.552271Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 45, "compress_ms": 43.8200420467183}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 45, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425337, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.48254193086177, "doc_prefill_ms": 196.8172499909997, "compress_ms": 45.089874998666346, "serialize_ms": 8.205417077988386, "load_ms": 1.3357090065255761, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.339959042146802, "ttft_ms": 17.339959042146802, "decode_ms": 40.951750008389354}, "total_wall_ms": 114.52758393716067, "ttft_ms": 17.339959042146802, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12991812876, "mlx_cache_bytes": 12026074491, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12991812876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "466,045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2fc4302dba44c59b9a9b62156d07f3a966e9639a019e5ff8f7782d7dddfc1fb9", "output_hash": "4a66e3c0960c26d2429d36e0c7f9d4c2192499734aa4ec831aea9100579be90f"} | ||||
| 1806 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6926490704cb34af5a10ff52", "attempt_id": "3741fc8d5340", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:25.683806Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 55, "compress_ms": 43.75737498048693}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 55, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425338, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.010999923571944, "doc_prefill_ms": 196.8172499909997, "compress_ms": 45.021124999038875, "serialize_ms": 7.796375080943108, "load_ms": 0.5436250939965248, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.187332967296243, "ttft_ms": 17.187332967296243, "decode_ms": 83.13500008080155}, "total_wall_ms": 155.3869160125032, "ttft_ms": 17.187332967296243, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12945118216, "mlx_peak_bytes": 12999922964, "mlx_cache_bytes": 12053386619, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12999922964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3c833cc75e8fe1d61f7e43200f40dd7a87d9661020ca15076c289db3aeb070f6", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1807 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ca66329703749fbcd48647b9", "attempt_id": "1dc1597c4dd2", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:25.856091Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 48, "compress_ms": 44.096625060774386}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 48, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425339, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.32295794505626, "doc_prefill_ms": 196.8172499909997, "compress_ms": 45.39224994368851, "serialize_ms": 7.7338749542832375, "load_ms": 0.5606659688055515, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.621624981984496, "ttft_ms": 17.621624981984496, "decode_ms": 68.57904198113829}, "total_wall_ms": 141.51279092766345, "ttft_ms": 17.621624981984496, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12994008332, "mlx_cache_bytes": 12074521979, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12994008332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,943,420", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "19fcb564e65537aa7d35b0b4a85896b9b8b79bc81eb9ddae8be99aa414b16d49", "output_hash": "c0dd7dc162aff6a1a743464a928b16a8b727f786f45a692ae1bcb45feb2292d1"} | ||||
| 1808 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cff5474945b45396d2d1caa9", "attempt_id": "6e23621b8e39", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:26.014511Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 45, "compress_ms": 43.3914999011904}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 45, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425337, "side_information_bytes": 12921, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.60695796459913, "doc_prefill_ms": 196.8172499909997, "compress_ms": 44.64991600252688, "serialize_ms": 7.774834055453539, "load_ms": 1.4525000005960464, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.397417104803026, "ttft_ms": 17.397417104803026, "decode_ms": 41.0742920357734}, "total_wall_ms": 113.98400005418807, "ttft_ms": 17.397417104803026, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12991812876, "mlx_cache_bytes": 12074521979, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12991812876, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.62", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2fc4302dba44c59b9a9b62156d07f3a966e9639a019e5ff8f7782d7dddfc1fb9", "output_hash": "d9a3265d0a78db3d082616021f44cd388888ddddf0a7328ce458e95e7824f8e9"} | ||||
| 1809 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "36bf99ce1155edd78226167f", "attempt_id": "e7aa3d5de991", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:26.145369Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 49, "compress_ms": 43.71691704727709}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 49, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425338, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.13662509433925, "doc_prefill_ms": 196.8172499909997, "compress_ms": 44.99954194761813, "serialize_ms": 7.960665971040726, "load_ms": 1.1459169909358025, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.663249978795648, "ttft_ms": 17.663249978795648, "decode_ms": 13.613666989840567}, "total_wall_ms": 86.9442920666188, "ttft_ms": 17.663249978795648, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12995532044, "mlx_cache_bytes": 12095575419, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12995532044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3c833cc75e8fe1d61f7e43200f40dd7a87d9661020ca15076c289db3aeb070f6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1810 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "70c7c949ad9ee4a69bdbdbeb", "attempt_id": "86bf5fa40b6f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:26.248661Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1827, "keep": 457, "window_tokens": 50, "compress_ms": 43.86366705875844}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 50, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 52412416, "serialized_payload_bytes": 52425338, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 53.094583097845316, "doc_prefill_ms": 196.8172499909997, "compress_ms": 45.12199992313981, "serialize_ms": 7.783040986396372, "load_ms": 1.2446669861674309, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.478000023402274, "ttft_ms": 17.478000023402274, "decode_ms": 13.602916966192424}, "total_wall_ms": 86.7940419120714, "ttft_ms": 17.478000023402274, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 859963392, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12996007180, "mlx_cache_bytes": 12104357243, "process_rss_bytes": 859963392}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 12996007180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3c833cc75e8fe1d61f7e43200f40dd7a87d9661020ca15076c289db3aeb070f6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1811 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d3fe2a4d11a6159bc3f02d97", "attempt_id": "b88df1517312", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:26.732595Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 44, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 3.1466659856960177, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.803916035220027, "ttft_ms": 20.803916035220027, "decode_ms": 105.2914580795914}, "total_wall_ms": 131.2827500514686, "ttft_ms": 20.803916035220027, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13146620256, "mlx_cache_bytes": 12493498491, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13146620256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "DG-40E-2777", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "16a7e3f4a7cc4a9b66f86c2cdcfad3b35daf1da199d9406e0627c8af2d8d73f3"} | ||||
| 1812 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f52a4cfe8a0ceb1499d4a150", "attempt_id": "6328a1dbbb66", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:26.880727Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 37, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.136582974344492, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.029707928188145, "ttft_ms": 20.029707928188145, "decode_ms": 29.53316702041775}, "total_wall_ms": 53.040915983729064, "ttft_ms": 20.029707928188145, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13059806216, "mlx_peak_bytes": 13136590976, "mlx_cache_bytes": 12518439675, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13136590976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1813 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b5bb773733fc6aa2c7401a09", "attempt_id": "3853544e6196", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:26.950279Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 38, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.195167005993426, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.146333030425012, "ttft_ms": 20.146333030425012, "decode_ms": 29.69841693993658}, "total_wall_ms": 53.38774994015694, "ttft_ms": 20.146333030425012, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13059806216, "mlx_peak_bytes": 13138442496, "mlx_cache_bytes": 12518444539, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13138442496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1814 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "88c890399eca5e6aa2a5dd6c", "attempt_id": "82c0870278ae", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.020186Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 53, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.234125044196844, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.723333000205457, "ttft_ms": 20.723333000205457, "decode_ms": 74.30195796769112}, "total_wall_ms": 98.59758394304663, "ttft_ms": 20.723333000205457, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13146075464, "mlx_cache_bytes": 12546699035, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13146075464, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "5,899,340", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "cdcb6f9099e6e651a99b4424bdf64b76bf516969970c3c7ba61297500761eb4f"} | ||||
| 1815 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3e2acc25f4f34ea37f749dd0", "attempt_id": "55f67bb2f2f7", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.134457Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 45, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.155457972548902, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.097541972063482, "ttft_ms": 20.097541972063482, "decode_ms": 44.42849999759346}, "total_wall_ms": 67.99499993212521, "ttft_ms": 20.097541972063482, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13147606340, "mlx_cache_bytes": 12575034171, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13147606340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "466,045", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "4a66e3c0960c26d2429d36e0c7f9d4c2192499734aa4ec831aea9100579be90f"} | ||||
| 1816 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c703d1272fc61190c220b889", "attempt_id": "de71f4f681dd", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.218929Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 55, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.0009169820696115, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.709582953713834, "ttft_ms": 20.709582953713834, "decode_ms": 89.22887500375509}, "total_wall_ms": 113.33579197525978, "ttft_ms": 20.709582953713834, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13148680784, "mlx_cache_bytes": 12575157659, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13148680784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Felaldfel-9", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "09ab1578c99909d3c22a0c8042977ad718c576e7b4cce4e50abc683b5f7d9a64"} | ||||
| 1817 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "566861cbe842d552a2cc1d38", "attempt_id": "e2edec509bb8", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.348470Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 48, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.2373750107362866, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.477249985560775, "ttft_ms": 20.477249985560775, "decode_ms": 342.8947909269482}, "total_wall_ms": 366.99270794633776, "ttft_ms": 20.477249985560775, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 48}, "output_usage": {"output_tokens": 23}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13061641224, "mlx_peak_bytes": 13152457604, "mlx_cache_bytes": 12744895899, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13152457604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,381,835\n5,690,750\n1,839,955\n9,381,835", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "2eb12945f311d9a531389537752f1f08c58fb7f17cebc2b228085e958cee5761"} | ||||
| 1818 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9fe12e36b52957bf37aad6d2", "attempt_id": "a04482ecfe02", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.731794Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 45, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.3489160230383277, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.980208948254585, "ttft_ms": 19.980208948254585, "decode_ms": 44.452166999690235}, "total_wall_ms": 68.18529195152223, "ttft_ms": 19.980208948254585, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13147604548, "mlx_cache_bytes": 12745813403, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13147604548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "44.62", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "d9a3265d0a78db3d082616021f44cd388888ddddf0a7328ce458e95e7824f8e9"} | ||||
| 1819 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "02ac9e81569d0778345645a8", "attempt_id": "042708a77f36", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.816445Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 49, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.311083022505045, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.45208401978016, "ttft_ms": 20.45208401978016, "decode_ms": 14.805209008045495}, "total_wall_ms": 38.899541017599404, "ttft_ms": 20.45208401978016, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13155062660, "mlx_cache_bytes": 12777074075, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13155062660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1820 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "088da8ed5e8068882339c77b", "attempt_id": "11f12247023b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.871442Z", "task_family": "synthetic", "document_id": "syn_03012_2000", "document_hash": "03e441e68d54e1af036f8ff905dfd6cbbccead62636279c1a8e179352ab08945", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03012_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12945118216}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1767, "source_tokens_receiver": 1767, "query_tokens": 50, "message_tokens": 1827, "message_utf8_bytes": 7489, "cache_tensor_bytes": 111315456, "serialized_payload_bytes": 111342574, "side_information_bytes": 27118, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 380.6544169783592, "doc_prefill_ms": 196.8172499909997, "compress_ms": 10.486542014405131, "serialize_ms": 369.8749169707298, "load_ms": 2.110083936713636, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.616249996237457, "ttft_ms": 20.616249996237457, "decode_ms": 14.996458077803254}, "total_wall_ms": 39.15429103653878, "ttft_ms": 20.616249996237457, "input_usage": {"receiver_prefix_tokens": 1827, "dense_cache_bytes": 209534976, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1084030976, "backend_memory": {"mlx_active_bytes": 13060723720, "mlx_peak_bytes": 13142583448, "mlx_cache_bytes": 12804107675, "process_rss_bytes": 1084030976}, "peak_prefill_memory": 13284520300, "peak_decode_memory": 13142583448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03012_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b047dfee2e9a6e760659370099c46f9dae95764640d4263436f9ccaf2d3d710a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1821 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "11178a57dc02f6224c472442", "attempt_id": "6aa8dfe2058c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:27.999874Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5895, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 689.6502911113203, "ttft_ms": 14.075707993470132, "decode_ms": 138.48570792470127}, "total_wall_ms": 850.6847909884527, "ttft_ms": 14.075707993470132, "input_usage": {"receiver_prompt_tokens": 5895}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 945373184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 2351871416, "process_rss_bytes": 945373184}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 1822 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1a42a939e9287b858f38992b", "attempt_id": "ed78da412e09", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:28.874534Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5885, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 691.2230419693515, "ttft_ms": 14.118499937467277, "decode_ms": 13.884833082556725}, "total_wall_ms": 727.7360000880435, "ttft_ms": 14.118499937467277, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 945405952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3279386040, "process_rss_bytes": 945405952}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1823 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "21b9077717d335dfd6e5ab25", "attempt_id": "fccd69e564d2", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:29.624333Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5884, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 724.6132919099182, "ttft_ms": 14.289792045019567, "decode_ms": 13.885000022128224}, "total_wall_ms": 761.3822499988601, "ttft_ms": 14.289792045019567, "input_usage": {"receiver_prompt_tokens": 5884}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 945438720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3279386040, "process_rss_bytes": 945438720}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1824 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5527ccef50e5c198cf795b30", "attempt_id": "81bbf3f70be0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:30.407684Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5900, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 754.9446659395471, "ttft_ms": 14.274999964982271, "decode_ms": 97.25295891985297}, "total_wall_ms": 875.06529095117, "ttft_ms": 14.274999964982271, "input_usage": {"receiver_prompt_tokens": 5900}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 945471488, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3988534712, "process_rss_bytes": 945471488}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7782250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "35ed445e80874ee97060da399132c68930141ac0b1db960634d510ba5e921356"} | ||||
| 1825 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b7cbbb065263920778fea96b", "attempt_id": "a40d0d84157f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:31.304911Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5893, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 762.8932079533115, "ttft_ms": 14.358208049088717, "decode_ms": 139.68483393546194}, "total_wall_ms": 925.6878339219838, "ttft_ms": 14.358208049088717, "input_usage": {"receiver_prompt_tokens": 5893}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 945504256, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 4481496504, "process_rss_bytes": 945504256}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,897,865", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "bf83aaa75e325e289601f3e10f3355c6cb797de4ffc4ee604831642a5b3ee46b"} | ||||
| 1826 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f92d086c21f29c92fe113f9", "attempt_id": "ad99b0c3b54b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:32.252815Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5902, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 766.4447919232771, "ttft_ms": 14.657374937087297, "decode_ms": 70.78574993647635}, "total_wall_ms": 860.7875830493867, "ttft_ms": 14.657374937087297, "input_usage": {"receiver_prompt_tokens": 5902}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 945537024, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5191710136, "process_rss_bytes": 945537024}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1827 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "088ccb1000153480ae226ffe", "attempt_id": "77a61b25c53f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:33.137031Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5896, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 820.4916249960661, "ttft_ms": 14.284542063251138, "decode_ms": 112.92358406353742}, "total_wall_ms": 956.5607500262558, "ttft_ms": 14.284542063251138, "input_usage": {"receiver_prompt_tokens": 5896}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 945569792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5685523896, "process_rss_bytes": 945569792}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "47944518", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "587930ddb516d362cba50ca2b2c963efaa1d70f832f470735f75f53a87a032de"} | ||||
| 1828 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1aa17e4472a7d52d47145c09", "attempt_id": "f9970b984f26", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:34.115994Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5892, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 812.5373750226572, "ttft_ms": 14.531125081703067, "decode_ms": 42.460458003915846}, "total_wall_ms": 878.0098330462351, "ttft_ms": 14.531125081703067, "input_usage": {"receiver_prompt_tokens": 5892}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 945602560, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13601707072, "mlx_cache_bytes": 5737018808, "process_rss_bytes": 945602560}, "peak_prefill_memory": null, "peak_decode_memory": 13601707072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "30eec89ddd9c342ef28a87f731d6e50ba977baf12d7caa7045a9d56b0e923f03"} | ||||
| 1829 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f624f448bc4095d3495f5ddf", "attempt_id": "7a625d9cbec4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:35.016541Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5896, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 818.3645410463214, "ttft_ms": 14.220000011846423, "decode_ms": 14.032708946615458}, "total_wall_ms": 855.0838750088587, "ttft_ms": 14.220000011846423, "input_usage": {"receiver_prompt_tokens": 5896}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 945635328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5737018808, "process_rss_bytes": 945635328}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1830 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c12328f609a644061e004a74", "attempt_id": "dbc8b2b49eda", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:35.893989Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 5898, "message_tokens": 5810, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.016583944670856, "decode_payload_ms": 0.0, "receiver_prefill_ms": 847.9372080182657, "ttft_ms": 14.37920902390033, "decode_ms": 14.628165983594954}, "total_wall_ms": 885.452541988343, "ttft_ms": 14.37920902390033, "input_usage": {"receiver_prompt_tokens": 5898}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 945668096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 6231422392, "process_rss_bytes": 945668096}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1831 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2bb942d8090b92ee4d1a8c25", "attempt_id": "18a3b23fc94f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.090156Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 336, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.66683299001306, "ttft_ms": 13.202250003814697, "decode_ms": 13.265458052046597}, "total_wall_ms": 74.79245797730982, "ttft_ms": 13.202250003814697, "input_usage": {"receiver_prompt_tokens": 336, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882975148, "mlx_cache_bytes": 7379061492, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12882975148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1832 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "40871e709e7b73a04534553a", "attempt_id": "b9fb8d5a1f8d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.188393Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 326, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.6153749730438, "ttft_ms": 13.806500006467104, "decode_ms": 13.109333929605782}, "total_wall_ms": 74.51820804271847, "ttft_ms": 13.806500006467104, "input_usage": {"receiver_prompt_tokens": 326, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12875667884, "mlx_cache_bytes": 7634160372, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12875667884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1833 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "413d3a7e464229216e063b02", "attempt_id": "4e81e63b9e7d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.285966Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 325, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.720625017769635, "ttft_ms": 13.426249963231385, "decode_ms": 13.179791974835098}, "total_wall_ms": 74.25979105755687, "ttft_ms": 13.426249963231385, "input_usage": {"receiver_prompt_tokens": 325, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12875405740, "mlx_cache_bytes": 7697861364, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12875405740, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1834 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7bd76779b642d65e1a25b4ed", "attempt_id": "803fec30f06b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.382327Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 341, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.51362507138401, "ttft_ms": 13.293292024172843, "decode_ms": 13.578542042523623}, "total_wall_ms": 74.37925005797297, "ttft_ms": 13.293292024172843, "input_usage": {"receiver_prompt_tokens": 341, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12886792640, "mlx_cache_bytes": 7855362116, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12886792640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1835 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c5584cc24be47909dd07ca5c", "attempt_id": "a37c4a4a6be7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.479141Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 334, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.29758291412145, "ttft_ms": 13.468082994222641, "decode_ms": 13.235708000138402}, "total_wall_ms": 73.94366699736565, "ttft_ms": 13.468082994222641, "input_usage": {"receiver_prompt_tokens": 334, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12881910188, "mlx_cache_bytes": 7986958404, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12881910188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1836 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aafbfd8e62ed42fb32da56a9", "attempt_id": "ef64e2007d3b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.575444Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 343, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.415750053711236, "ttft_ms": 13.313874951563776, "decode_ms": 13.289958005771041}, "total_wall_ms": 73.9195829955861, "ttft_ms": 13.313874951563776, "input_usage": {"receiver_prompt_tokens": 343, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12888545736, "mlx_cache_bytes": 8255100316, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12888545736, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1837 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e0fddf7463631a37b2d8bcc5", "attempt_id": "4a1ec95eeb7b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.671627Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 337, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.53000005055219, "ttft_ms": 13.275874895043671, "decode_ms": 12.957166996784508}, "total_wall_ms": 73.6617500660941, "ttft_ms": 13.275874895043671, "input_usage": {"receiver_prompt_tokens": 337, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12883368384, "mlx_cache_bytes": 8321160604, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12883368384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1838 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78f518a1cbb99eb346412646", "attempt_id": "17d791cb5390", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.767529Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 333, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.41870909836143, "ttft_ms": 13.632499962113798, "decode_ms": 13.54737498331815}, "total_wall_ms": 74.47075005620718, "ttft_ms": 13.632499962113798, "input_usage": {"receiver_prompt_tokens": 333, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12881271212, "mlx_cache_bytes": 8386434460, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12881271212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1839 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8d458c5856a1b1ff907c3e01", "attempt_id": "43c85c054d5a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.864345Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 337, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 45.692124986089766, "ttft_ms": 13.232917059212923, "decode_ms": 13.189750025048852}, "total_wall_ms": 73.02820798940957, "ttft_ms": 13.232917059212923, "input_usage": {"receiver_prompt_tokens": 337, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12883368384, "mlx_cache_bytes": 8386434460, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12883368384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1840 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "381db5bb44514c8633b11a05", "attempt_id": "7ea282b24f68", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:41.959886Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 339, "message_tokens": 247, "message_utf8_bytes": 1362, "cache_tensor_bytes": null, "serialized_payload_bytes": 1362, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4288.1959999212995, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.88024998176843, "ttft_ms": 13.363667065277696, "decode_ms": 13.678082963451743}, "total_wall_ms": 74.81100002769381, "ttft_ms": 13.363667065277696, "input_usage": {"receiver_prompt_tokens": 339, "sender_input_tokens": 5926, "sender_output_tokens": 247, "sender_prefill_ms": 859.3006250448525, "sender_ttft_ms": 14.23791702836752, "sender_decode_ms": 3405.325416009873}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946012160, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885612992, "mlx_cache_bytes": 8572163484, "process_rss_bytes": 946012160}, "peak_prefill_memory": null, "peak_decode_memory": 12885612992, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a0faa56207527d31a32e016f33e8ba6955b26031d35640dfafc35555d71747c2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1841 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "32e99e70ecca6b605bd1de65", "attempt_id": "089c9dc7a343", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:49.886057Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 420, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.982292069122195, "ttft_ms": 13.308749999850988, "decode_ms": 13.286042027175426}, "total_wall_ms": 84.41016601864249, "ttft_ms": 13.308749999850988, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950215420, "mlx_cache_bytes": 9907559464, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12950215420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1842 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b233e60e2825232dae879826", "attempt_id": "90d26697eb4f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:49.993364Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 410, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.453208016231656, "ttft_ms": 13.109165942296386, "decode_ms": 13.244041940197349}, "total_wall_ms": 79.64104099664837, "ttft_ms": 13.109165942296386, "input_usage": {"receiver_prompt_tokens": 410, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12942908156, "mlx_cache_bytes": 10228407336, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12942908156, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1843 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "de01dc57062daef4e3a008a5", "attempt_id": "a1371a500fda", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:50.095660Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 409, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.083375048823655, "ttft_ms": 13.173415907658637, "decode_ms": 13.430124963633716}, "total_wall_ms": 79.52504197601229, "ttft_ms": 13.173415907658637, "input_usage": {"receiver_prompt_tokens": 409, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12942187260, "mlx_cache_bytes": 10321992744, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12942187260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1844 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d0948c646b0d5312dd21c0e7", "attempt_id": "cf3df06b9e10", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:50.197736Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 425, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.5961251007393, "ttft_ms": 13.364207930862904, "decode_ms": 134.16595896705985}, "total_wall_ms": 202.01150001958013, "ttft_ms": 13.364207930862904, "input_usage": {"receiver_prompt_tokens": 425, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12953541392, "mlx_cache_bytes": 10653770440, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12953541392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,955,800 CAD", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "c4e25f3ad08d84ec67d3a6e6f3c19002a6063585f385c37fe6746c1ea9763677"} | ||||
| 1845 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0658a7f1de130c29aaab9992", "attempt_id": "1ab6d453b4aa", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:50.422327Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 418, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.335833945311606, "ttft_ms": 13.381875003688037, "decode_ms": 13.754750019870698}, "total_wall_ms": 81.307083950378, "ttft_ms": 13.381875003688037, "input_usage": {"receiver_prompt_tokens": 418, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12949035772, "mlx_cache_bytes": 10882884296, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12949035772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1846 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eb04de30337c6274fa5c1188", "attempt_id": "cf81c68376ad", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:50.526543Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 427, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.66112501360476, "ttft_ms": 13.253625016659498, "decode_ms": 13.859875034540892}, "total_wall_ms": 81.65370800998062, "ttft_ms": 13.253625016659498, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12955786008, "mlx_cache_bytes": 11230931312, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12955786008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1847 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7959016d2891d53b740128b6", "attempt_id": "b786c1ab4d93", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:50.630717Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 421, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.31162502989173, "ttft_ms": 13.305541942827404, "decode_ms": 107.22324997186661}, "total_wall_ms": 174.70029194373637, "ttft_ms": 13.305541942827404, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950608656, "mlx_cache_bytes": 11461618032, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12950608656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "18217300", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "c76e5f548b2f9772bfd6fd344b23e909ccf85519d389609c068cba52da7ef627"} | ||||
| 1848 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1609d2e23d9978c43082d3e2", "attempt_id": "be71d0e9857f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:50.827546Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 417, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.610041060484946, "ttft_ms": 13.143082964234054, "decode_ms": 13.381625059992075}, "total_wall_ms": 78.94295896403491, "ttft_ms": 13.143082964234054, "input_usage": {"receiver_prompt_tokens": 417, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12948249340, "mlx_cache_bytes": 11689945456, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12948249340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1849 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26f17ab6d67ddba54ea4b231", "attempt_id": "3c3daa86c1fc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:50.928785Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 421, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.58220904599875, "ttft_ms": 13.351833098568022, "decode_ms": 13.27954197768122}, "total_wall_ms": 81.09908399637789, "ttft_ms": 13.351833098568022, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950608656, "mlx_cache_bytes": 11689945456, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12950608656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1850 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b8c04aef05334a6793b5c5b4", "attempt_id": "e742638ce5f2", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:51.031819Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 423, "message_tokens": 319, "message_utf8_bytes": 740, "cache_tensor_bytes": null, "serialized_payload_bytes": 740, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7829.0212920401245, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.28912497498095, "ttft_ms": 13.458666042424738, "decode_ms": 13.325207983143628}, "total_wall_ms": 80.93441708479077, "ttft_ms": 13.458666042424738, "input_usage": {"receiver_prompt_tokens": 423, "sender_input_tokens": 5954, "sender_output_tokens": 512, "sender_prefill_ms": 753.8429578999057, "sender_ttft_ms": 14.545374899171293, "sender_decode_ms": 7055.995917064138}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12952623888, "mlx_cache_bytes": 11921811824, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12952623888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b3151ae22512421fd564b6a36f9f2ff0d1936fd50ba9762d234c0973b20affea", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1851 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8bc2044bbdc1b17b50c7931a", "attempt_id": "730440ae0426", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:51.139196Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 597, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.27566700708121, "ttft_ms": 13.218292035162449, "decode_ms": 13.503249967470765}, "total_wall_ms": 97.97245892696083, "ttft_ms": 13.218292035162449, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 12317747568, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1852 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b1c9bb9d058d6ee29589dac3", "attempt_id": "3e7670c1884d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:51.259654Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 587, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.75895795039833, "ttft_ms": 13.331332942470908, "decode_ms": 13.404417084529996}, "total_wall_ms": 97.50004194211215, "ttft_ms": 13.331332942470908, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946110464, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12987753560, "mlx_cache_bytes": 12660238704, "process_rss_bytes": 946110464}, "peak_prefill_memory": null, "peak_decode_memory": 12987753560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1853 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f994d9c670bc9f45e1f9c5a4", "attempt_id": "98767dc37186", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:51.379643Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 586, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.72116709221154, "ttft_ms": 13.236790895462036, "decode_ms": 13.254208955913782}, "total_wall_ms": 100.03204201348126, "ttft_ms": 13.236790895462036, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12987753560, "mlx_cache_bytes": 12660238704, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 12987753560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 1854 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "65b58d55575aadfd321220fc", "attempt_id": "2f73092d8bc3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:51.502028Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 602, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.43145806528628, "ttft_ms": 13.24312505312264, "decode_ms": 94.20179191511124}, "total_wall_ms": 178.93333302345127, "ttft_ms": 13.24312505312264, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994421848, "mlx_cache_bytes": 13026617712, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 12994421848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7782250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "35ed445e80874ee97060da399132c68930141ac0b1db960634d510ba5e921356"} | ||||
| 1855 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "22629c0721b37c4d0f5f2bd0", "attempt_id": "018d81b2d824", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:51.702932Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 595, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.68216702807695, "ttft_ms": 13.309375033713877, "decode_ms": 107.36658307723701}, "total_wall_ms": 191.3391660200432, "ttft_ms": 13.309375033713877, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992472152, "mlx_cache_bytes": 13271296368, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 12992472152, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10897865", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "795facd6ec9bf870c1fd5245bfde895e2cdf0e6690ae28308b78883d80e86927"} | ||||
| 1856 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e9130e0d46914bd4a7eacec3", "attempt_id": "3a67f22eb48e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:51.916192Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 604, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.20895800087601, "ttft_ms": 13.331583002582192, "decode_ms": 66.79012498352677}, "total_wall_ms": 151.33566700387746, "ttft_ms": 13.331583002582192, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12995306584, "mlx_cache_bytes": 13519710576, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 12995306584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1857 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "84c6f74145160ac11fea2c6f", "attempt_id": "b2eed47d8d21", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:52.089762Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 598, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.19100000616163, "ttft_ms": 13.383209006860852, "decode_ms": 134.45687503553927}, "total_wall_ms": 219.0617499873042, "ttft_ms": 13.383209006860852, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13014770776, "mlx_cache_bytes": 13787785584, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 13014770776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "37,025,171", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "209e0dad208d8010ab1ebc425122c9968592b7df83b84160fd99bd2a0b78a4fd"} | ||||
| 1858 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d316fd598cb2de809c10f1e0", "attempt_id": "1c899dbc82ae", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:52.331075Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 594, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.61674999911338, "ttft_ms": 13.293083058670163, "decode_ms": 13.199458015151322}, "total_wall_ms": 97.10699995048344, "ttft_ms": 13.293083058670163, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992078936, "mlx_cache_bytes": 13944482160, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 12992078936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1859 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "426ff34e418595c3c93e1596", "attempt_id": "cf5d0334467e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:52.450792Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 598, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.81083401478827, "ttft_ms": 14.021167065948248, "decode_ms": 13.367165927775204}, "total_wall_ms": 98.27495901845396, "ttft_ms": 14.021167065948248, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012296792, "mlx_cache_bytes": 13944482160, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 13012296792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1860 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0f77e45660134b0ba7cd3956", "attempt_id": "229885580e41", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:52.570985Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 600, "message_tokens": 511, "message_utf8_bytes": 1221, "cache_tensor_bytes": null, "serialized_payload_bytes": 1221, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.273207974620163, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.4723329981789, "ttft_ms": 13.518542051315308, "decode_ms": 13.473208993673325}, "total_wall_ms": 98.46925002057105, "ttft_ms": 13.518542051315308, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 946126848, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13005562968, "mlx_cache_bytes": 14191126896, "process_rss_bytes": 946126848}, "peak_prefill_memory": null, "peak_decode_memory": 13005562968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8107578bdf33dd9e288f04f1d71ea68be1d05ba33b247b910465cfa43f8d1ba4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1861 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "16206e8ff0fd138007468b6f", "attempt_id": "ec67991a6fa0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:53.543428Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 46, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.8422920256853104, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.770125000737607, "ttft_ms": 23.770125000737607, "decode_ms": 28.59737502876669}, "total_wall_ms": 58.35916707292199, "ttft_ms": 23.770125000737607, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 46}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977116408, "mlx_cache_bytes": 14784375521, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977116408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not provided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "d83b9ff3c07a8390e2ea0a2af45fba37595da25f31b85ba625363ee98c0c796f"} | ||||
| 1862 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "828d0ae2db2807543a974416", "attempt_id": "c65b5007c89d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:53.625405Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.4945829752832651, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.813583073206246, "ttft_ms": 23.813583073206246, "decode_ms": 13.669042033143342}, "total_wall_ms": 43.473875033669174, "ttft_ms": 23.813583073206246, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12968088824, "mlx_cache_bytes": 14819060449, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968088824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1863 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ef0b34b39250f02ec68fcd9d", "attempt_id": "99e26c802d9e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:53.691603Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.6926670214161277, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.44112505670637, "ttft_ms": 23.44112505670637, "decode_ms": 13.740624999627471}, "total_wall_ms": 43.10920892748982, "ttft_ms": 23.44112505670637, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12967531768, "mlx_cache_bytes": 14829710049, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12967531768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1864 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "12c640c91a5a42dc0efeb87a", "attempt_id": "b243e765aa37", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:53.756573Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 51, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.5003749867901206, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.113082909025252, "ttft_ms": 24.113082909025252, "decode_ms": 67.99766700714827}, "total_wall_ms": 97.85708307754248, "ttft_ms": 24.113082909025252, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12982392076, "mlx_cache_bytes": 14874930297, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12982392076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "50000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "60734f174b2035e5b2ba85fef8c648cc0cb18c5995b419d3cd1c025c5b09d0c7"} | ||||
| 1865 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "691c05c94aa1b3282c4f9b14", "attempt_id": "2d5d90ddb1a3", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:53.876778Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 44, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.7295409925282001, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.54550000745803, "ttft_ms": 23.54550000745803, "decode_ms": 123.35466698277742}, "total_wall_ms": 153.0131669715047, "ttft_ms": 23.54550000745803, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 44}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12975756536, "mlx_cache_bytes": 14906012681, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975756536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10897.865", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "8f7e2e0911e19c07e60146eb06050667e7489f78e72dcf2ace0d1986353f1dc7"} | ||||
| 1866 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1fc800f88ebc5e0e4768ba7", "attempt_id": "b9c563f57b28", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.051946Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 53, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.7883330583572388, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.98833294864744, "ttft_ms": 23.98833294864744, "decode_ms": 68.90516693238169}, "total_wall_ms": 98.79733296111226, "ttft_ms": 23.98833294864744, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12983555348, "mlx_cache_bytes": 14952068529, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12983555348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1867 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aa1ba3c29d540de72f953f10", "attempt_id": "fce073bbecbc", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.172939Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 47, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.4803750673308969, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.94774998538196, "ttft_ms": 23.94774998538196, "decode_ms": 96.28379193600267}, "total_wall_ms": 126.24204205349088, "ttft_ms": 23.94774998538196, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977935628, "mlx_cache_bytes": 14966355377, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977935628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1245000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "3cc333775ac37dae0b950afc75e97ee7f6baebd7310444ff1b2b4e76d1384f3d"} | ||||
| 1868 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "268d064b99ecc9d9a782dcba", "attempt_id": "012040d16565", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.321824Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 43, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.620542025193572, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.226959048770368, "ttft_ms": 23.226959048770368, "decode_ms": 69.14166698697954}, "total_wall_ms": 98.20758400019258, "ttft_ms": 23.226959048770368, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976788728, "mlx_cache_bytes": 14966355377, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976788728, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "c5d1866aabc15dda07995e73b08c4ccb514947dcd3a621cea851af5fe366f11b"} | ||||
| 1869 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2ea7a24f2393a9398b431dde", "attempt_id": "ada10f11405f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.442299Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 47, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.7142909346148372, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.87533290311694, "ttft_ms": 23.87533290311694, "decode_ms": 13.617207994684577}, "total_wall_ms": 43.44491602387279, "ttft_ms": 23.87533290311694, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1054359552, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977935628, "mlx_cache_bytes": 14966355377, "process_rss_bytes": 1054359552}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977935628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1870 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0486a23d5f40fa7d4c401143", "attempt_id": "a11932e45c44", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.508431Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5849, "keep": 1462, "compress_ms": 9.889709064736962}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 49, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911356, "side_information_bytes": 16188, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 851.5965839615092, "doc_prefill_ms": 727.2169999778271, "compress_ms": 9.92708292324096, "serialize_ms": 105.30045907944441, "load_ms": 1.605625031515956, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.976749973371625, "ttft_ms": 23.976749973371625, "decode_ms": 13.559125014580786}, "total_wall_ms": 43.52341592311859, "ttft_ms": 23.976749973371625, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1054375936, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981114124, "mlx_cache_bytes": 15000712625, "process_rss_bytes": 1054375936}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981114124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8b0f3fc18d3a82b14459ae16d6180575c53929962b06f1db3270d77f071ecf5e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1871 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "51bf4edc1fc31f42a4f2e614", "attempt_id": "48226b20326e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.573811Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 46, "compress_ms": 70.18308399710804}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 46, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911396, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 88.08400004636496, "doc_prefill_ms": 727.2169999778271, "compress_ms": 74.30254202336073, "serialize_ms": 13.567416928708553, "load_ms": 1.6586669953539968, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.69041701219976, "ttft_ms": 22.69041701219976, "decode_ms": 138.15429201349616}, "total_wall_ms": 255.01529197208583, "ttft_ms": 22.69041701219976, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1054523392, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977116408, "mlx_cache_bytes": 15266795929, "process_rss_bytes": 1054523392}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977116408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e6e399f9fd031f55b32e59dd6c91cb69f95d808c27532b1e95321a27ec89049", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 1872 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb3e588ecf36fd768975c2f6", "attempt_id": "47f41c2a5b25", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.851453Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 36, "compress_ms": 62.4913340434432}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911395, "side_information_bytes": 16227, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 78.99612502660602, "doc_prefill_ms": 727.2169999778271, "compress_ms": 66.5751249762252, "serialize_ms": 12.207709020003676, "load_ms": 1.4711669646203518, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.417499964125454, "ttft_ms": 23.417499964125454, "decode_ms": 13.768749893642962}, "total_wall_ms": 122.05504102166742, "ttft_ms": 23.417499964125454, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1108787200, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12968088824, "mlx_cache_bytes": 15303856537, "process_rss_bytes": 1108787200}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968088824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0cb324bcab39480494b9c71457c42ccf7e28614a7deb3150458ef60a3d06edb6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1873 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cd767c1ffc47219ef64d9c55", "attempt_id": "dfb2d453af23", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:54.997043Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 35, "compress_ms": 63.282583956606686}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911397, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.55304099898785, "doc_prefill_ms": 727.2169999778271, "compress_ms": 67.41433299612254, "serialize_ms": 8.915125043131411, "load_ms": 1.581749995239079, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.16412495262921, "ttft_ms": 26.16412495262921, "decode_ms": 13.597000041045249}, "total_wall_ms": 122.3467499949038, "ttft_ms": 26.16412495262921, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1108803584, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12967531768, "mlx_cache_bytes": 15310115225, "process_rss_bytes": 1108803584}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12967531768, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cbadda9c80e1afe2ba8bccb38e0f34fa2184e2b708f5ee14d384031fbe8fb7e6", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1874 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3963c5d74e415629047eec74", "attempt_id": "9972fe4c1b66", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:55.142114Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 51, "compress_ms": 63.594084000214934}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 51, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911397, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.88316702842712, "doc_prefill_ms": 727.2169999778271, "compress_ms": 67.99637491349131, "serialize_ms": 8.667916990816593, "load_ms": 1.544084050692618, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.712458088994026, "ttft_ms": 23.712458088994026, "decode_ms": 83.64045806229115}, "total_wall_ms": 190.1871250011027, "ttft_ms": 23.712458088994026, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 51}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1108803584, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981310732, "mlx_cache_bytes": 15337738649, "process_rss_bytes": 1108803584}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981310732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "770375", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cbadda9c80e1afe2ba8bccb38e0f34fa2184e2b708f5ee14d384031fbe8fb7e6", "output_hash": "630c71959e991bb402b27efa49041a6f522eba3faa5943b905fbb6b7cfea1008"} | ||||
| 1875 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1bb6d559546317430c26c38b", "attempt_id": "03e21f1198f4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:55.355436Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 44, "compress_ms": 64.04325005132705}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 44, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911396, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.63583294581622, "doc_prefill_ms": 727.2169999778271, "compress_ms": 68.38662503287196, "serialize_ms": 9.025792009197176, "load_ms": 1.4806250110268593, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.986792027950287, "ttft_ms": 22.986792027950287, "decode_ms": 138.62179208081216}, "total_wall_ms": 245.1844169991091, "ttft_ms": 22.986792027950287, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1108819968, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12975461624, "mlx_cache_bytes": 15357825433, "process_rss_bytes": 1108819968}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975461624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,897,865", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e6e399f9fd031f55b32e59dd6c91cb69f95d808c27532b1e95321a27ec89049", "output_hash": "bf83aaa75e325e289601f3e10f3355c6cb797de4ffc4ee604831642a5b3ee46b"} | ||||
| 1876 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27a8f6d9b0bdea7f9f984ce5", "attempt_id": "0526d561a202", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:55.623969Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 53, "compress_ms": 64.30762493982911}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 53, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911396, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.20708299893886, "doc_prefill_ms": 727.2169999778271, "compress_ms": 68.43691598623991, "serialize_ms": 8.552624960429966, "load_ms": 1.5275829937309027, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.628292023204267, "ttft_ms": 23.628292023204267, "decode_ms": 69.60675003938377}, "total_wall_ms": 176.35308299213648, "ttft_ms": 23.628292023204267, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1108819968, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12983555348, "mlx_cache_bytes": 15395541401, "process_rss_bytes": 1108819968}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12983555348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e6e399f9fd031f55b32e59dd6c91cb69f95d808c27532b1e95321a27ec89049", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1877 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "92297a295072ad05e736a433", "attempt_id": "f797a25c5a40", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:55.823198Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 47, "compress_ms": 62.43741710204631}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 47, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911396, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.26187493931502, "doc_prefill_ms": 727.2169999778271, "compress_ms": 66.57566700596362, "serialize_ms": 8.47749994136393, "load_ms": 1.4443330001085997, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.627916001714766, "ttft_ms": 23.627916001714766, "decode_ms": 110.22795794997364}, "total_wall_ms": 215.064833057113, "ttft_ms": 23.627916001714766, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1108819968, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977935628, "mlx_cache_bytes": 15413137817, "process_rss_bytes": 1108819968}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977935628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "47024418", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e6e399f9fd031f55b32e59dd6c91cb69f95d808c27532b1e95321a27ec89049", "output_hash": "203874e76fe678dafea8a26c1be9d025b7bc2d8b2bb3aea3c3e744f4b183cdef"} | ||||
| 1878 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "50fadbbb7e062d3d1d26fee3", "attempt_id": "594dbd0c7d2e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:56.061459Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 43, "compress_ms": 61.59000005573034}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 43, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911396, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 74.65012499596924, "doc_prefill_ms": 727.2169999778271, "compress_ms": 65.90541591867805, "serialize_ms": 8.532084058970213, "load_ms": 1.5287080314010382, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.13579199835658, "ttft_ms": 23.13579199835658, "decode_ms": 41.04975005611777}, "total_wall_ms": 144.8656669817865, "ttft_ms": 23.13579199835658, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1108819968, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12975019256, "mlx_cache_bytes": 15414219161, "process_rss_bytes": 1108819968}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975019256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5e6e399f9fd031f55b32e59dd6c91cb69f95d808c27532b1e95321a27ec89049", "output_hash": "30eec89ddd9c342ef28a87f731d6e50ba977baf12d7caa7045a9d56b0e923f03"} | ||||
| 1879 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fdbdd07aa8fc571a0d027514", "attempt_id": "11777fe52006", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:56.229149Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 47, "compress_ms": 63.599082990549505}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 47, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911397, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.92091597709805, "doc_prefill_ms": 727.2169999778271, "compress_ms": 68.01779090892524, "serialize_ms": 8.673041011206806, "load_ms": 1.358125009573996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.64137500990182, "ttft_ms": 23.64137500990182, "decode_ms": 13.632584013976157}, "total_wall_ms": 119.92779199499637, "ttft_ms": 23.64137500990182, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1108819968, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977935628, "mlx_cache_bytes": 15414219161, "process_rss_bytes": 1108819968}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977935628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cbadda9c80e1afe2ba8bccb38e0f34fa2184e2b708f5ee14d384031fbe8fb7e6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1880 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31f582481d19306587f172ad", "attempt_id": "b66c904a5642", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:56.372125Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5849, "keep": 1462, "window_tokens": 49, "compress_ms": 65.0299999397248}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 49, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 53895168, "serialized_payload_bytes": 53911395, "side_information_bytes": 16227, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 78.48129095509648, "doc_prefill_ms": 727.2169999778271, "compress_ms": 69.50079102534801, "serialize_ms": 8.76858294941485, "load_ms": 1.50862499140203, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.476833011955023, "ttft_ms": 23.476833011955023, "decode_ms": 13.578332960605621}, "total_wall_ms": 121.53395789209753, "ttft_ms": 23.476833011955023, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1108836352, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12979918092, "mlx_cache_bytes": 15432569241, "process_rss_bytes": 1108836352}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979918092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0cb324bcab39480494b9c71457c42ccf7e28614a7deb3150458ef60a3d06edb6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1881 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d6abd524649c9de789faa13f", "attempt_id": "0d258c2c6cd6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:56.930779Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 46, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 3.0475410167127848, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.47966698836535, "ttft_ms": 32.47966698836535, "decode_ms": 153.0005419626832}, "total_wall_ms": 192.95162498019636, "ttft_ms": 32.47966698836535, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1338982400, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13174950196, "mlx_cache_bytes": 15742716633, "process_rss_bytes": 1338982400}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13174950196, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 1882 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6aae63009e74abc478e97ed8", "attempt_id": "cd9a2ab4b62f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:57.147849Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 36, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.428750041872263, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.359125087969005, "ttft_ms": 27.359125087969005, "decode_ms": 15.215500025078654}, "total_wall_ms": 49.492749967612326, "ttft_ms": 27.359125087969005, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1338982400, "backend_memory": {"mlx_active_bytes": 13047780360, "mlx_peak_bytes": 13151357076, "mlx_cache_bytes": 15797865177, "process_rss_bytes": 1338982400}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13151357076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1883 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "81dd5ec2bfd4a75a2553f28c", "attempt_id": "14570f5581ac", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:57.220380Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 35, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.3463329998776317, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.19016605988145, "ttft_ms": 27.19016605988145, "decode_ms": 15.47083305194974}, "total_wall_ms": 49.42949989344925, "ttft_ms": 27.19016605988145, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 35}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1338982400, "backend_memory": {"mlx_active_bytes": 13047780360, "mlx_peak_bytes": 13149538452, "mlx_cache_bytes": 15850687193, "process_rss_bytes": 1338982400}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13149538452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1884 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b289dca40f2907e90247fefd", "attempt_id": "3436e9eaf8e2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:57.292392Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 51, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 1.427583978511393, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.274833923205733, "ttft_ms": 28.274833923205733, "decode_ms": 107.3492499999702}, "total_wall_ms": 141.62066695280373, "ttft_ms": 28.274833923205733, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 51}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1338982400, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13185945976, "mlx_cache_bytes": 15927087401, "process_rss_bytes": 1338982400}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13185945976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7782250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "35ed445e80874ee97060da399132c68930141ac0b1db960634d510ba5e921356"} | ||||
| 1885 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e56b23265d086be3e4feee44", "attempt_id": "42d2834abe7f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:57.457035Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 44, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.3525829892605543, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.546499972231686, "ttft_ms": 27.546499972231686, "decode_ms": 152.72841695696115}, "total_wall_ms": 187.05100007355213, "ttft_ms": 27.546499972231686, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1338998784, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13170443396, "mlx_cache_bytes": 15927087401, "process_rss_bytes": 1338998784}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13170443396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10,897,865", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "bf83aaa75e325e289601f3e10f3355c6cb797de4ffc4ee604831642a5b3ee46b"} | ||||
| 1886 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "726e9fcd64393ad52c777681", "attempt_id": "1ff6a168bf7f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:57.666683Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 53, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.0929579623043537, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.758374974131584, "ttft_ms": 28.758374974131584, "decode_ms": 75.9664170909673}, "total_wall_ms": 111.15383298601955, "ttft_ms": 28.758374974131584, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 53}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1338998784, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13231124064, "mlx_cache_bytes": 15967680601, "process_rss_bytes": 1338998784}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13231124064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1887 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4bc3173de781c756b4ee2b13", "attempt_id": "d9291c4864d1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:57.800730Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 47, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.338749938644469, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.138041961938143, "ttft_ms": 28.138041961938143, "decode_ms": 121.98329193051904}, "total_wall_ms": 156.84687509201467, "ttft_ms": 28.138041961938143, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1338998784, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13177163272, "mlx_cache_bytes": 16038721625, "process_rss_bytes": 1338998784}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13177163272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "47044588", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "d1971a8b5902a779441b751d513c367b5b13c13f0df5d09babf076891d1e4179"} | ||||
| 1888 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1706865a9977d74161cfe9ca", "attempt_id": "0edab858d878", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:57.979820Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 43, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.3500830866396427, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.806124999187887, "ttft_ms": 27.806124999187887, "decode_ms": 45.95058306585997}, "total_wall_ms": 80.55745891761035, "ttft_ms": 27.806124999187887, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 43}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1338998784, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13169296164, "mlx_cache_bytes": 16103602265, "process_rss_bytes": 1338998784}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13169296164, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "470", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "30eec89ddd9c342ef28a87f731d6e50ba977baf12d7caa7045a9d56b0e923f03"} | ||||
| 1889 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9cf3cbef4c3f8e064576ce94", "attempt_id": "c799bdc21a5e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:58.083095Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 47, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.289625001139939, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.699874946847558, "ttft_ms": 27.699874946847558, "decode_ms": 15.590165974572301}, "total_wall_ms": 49.8075409559533, "ttft_ms": 27.699874946847558, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1338998784, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13177163272, "mlx_cache_bytes": 16103602265, "process_rss_bytes": 1338998784}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13177163272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1890 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a8a1118936a419ae2f9e2712", "attempt_id": "b134db4b2ddd", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:58.155531Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5810, "source_tokens_receiver": 5810, "query_tokens": 49, "message_tokens": 5849, "message_utf8_bytes": 29338, "cache_tensor_bytes": 114546816, "serialized_payload_bytes": 114581145, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 414.2380830598995, "doc_prefill_ms": 727.2169999778271, "compress_ms": 11.804417008534074, "serialize_ms": 402.02104195486754, "load_ms": 2.2898749448359013, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.766791987232864, "ttft_ms": 27.766791987232864, "decode_ms": 15.445125056430697}, "total_wall_ms": 49.89591601770371, "ttft_ms": 27.766791987232864, "input_usage": {"receiver_prefix_tokens": 5849, "dense_cache_bytes": 215617536, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1338998784, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13181914632, "mlx_cache_bytes": 16103602265, "process_rss_bytes": 1338998784}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13181914632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7d5acdd179169b6180ad337a2bd9be34d3066b6cf3b85f2f2a363afa9d4ed94d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1891 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c3172c73c1a1e56d90d8dd86", "attempt_id": "3444d7b6bbf6", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:58.309951Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5718, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 676.6989160096273, "ttft_ms": 15.261332970112562, "decode_ms": 103.9171670563519}, "total_wall_ms": 803.8229170488194, "ttft_ms": 15.261332970112562, "input_usage": {"receiver_prompt_tokens": 5718}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1119535104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746164788, "mlx_cache_bytes": 2689343832, "process_rss_bytes": 1119535104}, "peak_prefill_memory": null, "peak_decode_memory": 13746164788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 1892 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c93af150d67d940bde3330c", "attempt_id": "5ba3d9196386", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:59.140139Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5710, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 685.1884580682963, "ttft_ms": 15.507583040744066, "decode_ms": 30.326582957059145}, "total_wall_ms": 738.7482500635087, "ttft_ms": 15.507583040744066, "input_usage": {"receiver_prompt_tokens": 5710}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1119535104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13744297012, "mlx_cache_bytes": 3065979224, "process_rss_bytes": 1119535104}, "peak_prefill_memory": null, "peak_decode_memory": 13744297012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1893 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4b3e9fa6650d8eec2c25d846", "attempt_id": "abf55387b3bc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T08:59:59.900847Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5709, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 696.7742500128224, "ttft_ms": 15.33974998164922, "decode_ms": 30.450207996182144}, "total_wall_ms": 750.5167500348762, "ttft_ms": 15.33974998164922, "input_usage": {"receiver_prompt_tokens": 5709}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1119535104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13744297012, "mlx_cache_bytes": 3065979224, "process_rss_bytes": 1119535104}, "peak_prefill_memory": null, "peak_decode_memory": 13744297012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1894 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3996238b79465f596cb86e0e", "attempt_id": "bf0dac640314", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:00.672858Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5724, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 736.8229170097038, "ttft_ms": 15.509166056290269, "decode_ms": 76.34066697210073}, "total_wall_ms": 836.3905410515144, "ttft_ms": 15.509166056290269, "input_usage": {"receiver_prompt_tokens": 5724}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119535104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13747983412, "mlx_cache_bytes": 3476234584, "process_rss_bytes": 1119535104}, "peak_prefill_memory": null, "peak_decode_memory": 13747983412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,782,250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "9e8f8185ef1e292f5c23ff36cfaf1b8f94dd03ebe9397ea178b92c4926b199c1"} | ||||
| 1895 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5343ed71cc2ddccbf94e04c1", "attempt_id": "9163f7ae73f9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:01.531154Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5718, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 779.3814999749884, "ttft_ms": 15.578374965116382, "decode_ms": 76.61933393683285}, "total_wall_ms": 879.3017499847338, "ttft_ms": 15.578374965116382, "input_usage": {"receiver_prompt_tokens": 5718}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119535104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746164788, "mlx_cache_bytes": 3476234584, "process_rss_bytes": 1119535104}, "peak_prefill_memory": null, "peak_decode_memory": 13746164788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,632,220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "b44a776e6bb6f15c7526630db9ad71e409f2e799d7bb0d8bfb42c1ec7e29ed3b"} | ||||
| 1896 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c934cc05f069cff838847672", "attempt_id": "0b86b2e5496b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:02.431771Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5727, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 785.7065829448402, "ttft_ms": 15.867249923758209, "decode_ms": 76.8993750680238}, "total_wall_ms": 886.4442079793662, "ttft_ms": 15.867249923758209, "input_usage": {"receiver_prompt_tokens": 5727}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119535104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13748638772, "mlx_cache_bytes": 3857064280, "process_rss_bytes": 1119535104}, "peak_prefill_memory": null, "peak_decode_memory": 13748638772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1897 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "603314e661d1c87338643cd2", "attempt_id": "07a78c909f55", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:03.339574Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5721, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 817.494791932404, "ttft_ms": 15.943125006742775, "decode_ms": 77.18366698827595}, "total_wall_ms": 918.3791669784114, "ttft_ms": 15.943125006742775, "input_usage": {"receiver_prompt_tokens": 5721}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119518720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746820148, "mlx_cache_bytes": 4236222808, "process_rss_bytes": 1119518720}, "peak_prefill_memory": null, "peak_decode_memory": 13746820148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,789,225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "8e932c1fd7116275c4255a7b0a8bcca314f3a877df0adb977f698071fe93fa18"} | ||||
| 1898 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "02b6c6f70a3610510b59ff5e", "attempt_id": "a29f21691d4a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:04.279601Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5717, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 819.8094160761684, "ttft_ms": 15.77358297072351, "decode_ms": 46.978291939012706}, "total_wall_ms": 890.2018329827115, "ttft_ms": 15.77358297072351, "input_usage": {"receiver_prompt_tokens": 5717}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1119518720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746164788, "mlx_cache_bytes": 4236222808, "process_rss_bytes": 1119518720}, "peak_prefill_memory": null, "peak_decode_memory": 13746164788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.47", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "b440d5b1227fa50d5a1413a593f4777388144db3ec5ce126ab798efba0a0514b"} | ||||
| 1899 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "905c0ee66fee20cbc393aeb8", "attempt_id": "92094565512d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:05.191211Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5721, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 802.3673329735175, "ttft_ms": 15.665875049307942, "decode_ms": 15.33308404032141}, "total_wall_ms": 841.3498330628499, "ttft_ms": 15.665875049307942, "input_usage": {"receiver_prompt_tokens": 5721}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119518720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746820148, "mlx_cache_bytes": 4236222808, "process_rss_bytes": 1119518720}, "peak_prefill_memory": null, "peak_decode_memory": 13746820148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1900 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "82e8f12dd267221cc04083e1", "attempt_id": "35b42f2d5c47", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:06.053993Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 5723, "message_tokens": 5613, "message_utf8_bytes": 29338, "cache_tensor_bytes": null, "serialized_payload_bytes": 29338, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009625102393329144, "decode_payload_ms": 0.0, "receiver_prefill_ms": 854.1997499996796, "ttft_ms": 15.815707971341908, "decode_ms": 15.58866596315056}, "total_wall_ms": 893.3354170294479, "ttft_ms": 15.815707971341908, "input_usage": {"receiver_prompt_tokens": 5723}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119518720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13787927604, "mlx_cache_bytes": 4296188248, "process_rss_bytes": 1119518720}, "peak_prefill_memory": null, "peak_decode_memory": 13787927604, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1901 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7917624920685645748a629", "attempt_id": "445cecb584c4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:15.417593Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.65204191673547, "ttft_ms": 13.710541999898851, "decode_ms": 13.472666963934898}, "total_wall_ms": 105.98124994430691, "ttft_ms": 13.710541999898851, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 6338691852, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1902 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1d78f33b9d0f76b43404240", "attempt_id": "6dfe5e3fc48f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:15.546180Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.14141707401723, "ttft_ms": 13.899083016440272, "decode_ms": 26.823125081136823}, "total_wall_ms": 118.92891698516905, "ttft_ms": 13.899083016440272, "input_usage": {"receiver_prompt_tokens": 614, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198284, "mlx_cache_bytes": 6681608972, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13038198284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1903 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e19dedd1062bce490579e30b", "attempt_id": "9dfa5e9975f1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:15.686443Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.61666697822511, "ttft_ms": 14.134834054857492, "decode_ms": 27.659791987389326}, "total_wall_ms": 119.5130420383066, "ttft_ms": 14.134834054857492, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038018060, "mlx_cache_bytes": 6681608972, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13038018060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1904 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed825936cb104dc9a152bce7", "attempt_id": "3b66ffc1968c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:15.827750Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 628, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.00491696596146, "ttft_ms": 13.541667023673654, "decode_ms": 13.54495796840638}, "total_wall_ms": 105.37816595751792, "ttft_ms": 13.541667023673654, "input_usage": {"receiver_prompt_tokens": 628, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046619684, "mlx_cache_bytes": 7056182488, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13046619684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1905 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c2ed49d8df53c850d4ef9fd1", "attempt_id": "e468bca46765", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:15.954533Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.29679194744676, "ttft_ms": 13.634750037454069, "decode_ms": 13.591625029221177}, "total_wall_ms": 105.62904202379286, "ttft_ms": 13.634750037454069, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 7056182488, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1906 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4a7ae63d45af12ad0d17efc1", "attempt_id": "923c4ce5c0f1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:16.081892Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.90562498848885, "ttft_ms": 13.850415940396488, "decode_ms": 81.64012501947582}, "total_wall_ms": 174.54050004016608, "ttft_ms": 13.850415940396488, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 7408948912, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithzenban-5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "cc5e85bb9beafdd57dcb7f11c04a12aea0492c44343bf9633324f1d50e9c4b6f"} | ||||
| 1907 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "beb0afaeaa05bfd9c1bb898f", "attempt_id": "65a782c5479b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:16.277962Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.21937505993992, "ttft_ms": 13.690249994397163, "decode_ms": 351.6514169750735}, "total_wall_ms": 443.69075004942715, "ttft_ms": 13.690249994397163, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981860, "mlx_cache_bytes": 7757829808, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13043981860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,261,538 + 9,056,740 + 10,521,145 = 28,839,423", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "47b95d0ea271e19b37f2bfb2fe58900e16fef4e6198cad5d97aa41e6c48ff476"} | ||||
| 1908 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "174e1dd75cac153adf46963c", "attempt_id": "27e4e2680518", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:16.743192Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.29425001889467, "ttft_ms": 13.5677499929443, "decode_ms": 40.551334037445486}, "total_wall_ms": 132.53637496381998, "ttft_ms": 13.5677499929443, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 7757829808, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.47", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "b440d5b1227fa50d5a1413a593f4777388144db3ec5ce126ab798efba0a0514b"} | ||||
| 1909 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c6fb5b8c441e4e4988bb798d", "attempt_id": "49d317d400e5", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:16.897273Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.74399996176362, "ttft_ms": 13.680208940058947, "decode_ms": 14.161083032377064}, "total_wall_ms": 105.68391694687307, "ttft_ms": 13.680208940058947, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981860, "mlx_cache_bytes": 7757829808, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13043981860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1910 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce0bae89b1a5541ea2d70dfc", "attempt_id": "76f0ed73a610", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:17.024015Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1798, "cache_tensor_bytes": null, "serialized_payload_bytes": 1798, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8448.31179198809, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.77254190295935, "ttft_ms": 13.665499980561435, "decode_ms": 13.691250002011657}, "total_wall_ms": 106.21079197153449, "ttft_ms": 13.665499980561435, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 5747, "sender_output_tokens": 512, "sender_prefill_ms": 845.6397498957813, "sender_ttft_ms": 15.904958010651171, "sender_decode_ms": 7582.767583080567}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119633408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077388836, "mlx_cache_bytes": 7796332208, "process_rss_bytes": 1119633408}, "peak_prefill_memory": null, "peak_decode_memory": 13077388836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "db5ece1b9c3c646e5ebf18f76353c547644bb80ea0b7efd2e346bf43c8336532", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1911 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "18cdc6c90ce43b6d8a3e781e", "attempt_id": "6d562f750a02", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:25.555415Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 394, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.79079200793058, "ttft_ms": 13.501333072781563, "decode_ms": 13.492750003933907}, "total_wall_ms": 82.32616703025997, "ttft_ms": 13.501333072781563, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882582616, "mlx_cache_bytes": 8389400240, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12882582616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1912 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "782f3b57c08afbef76c99358", "attempt_id": "df0c6992cf75", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:25.659990Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 386, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.63820807542652, "ttft_ms": 13.54283292312175, "decode_ms": 13.595958007499576}, "total_wall_ms": 81.58337499480695, "ttft_ms": 13.54283292312175, "input_usage": {"receiver_prompt_tokens": 386, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12878240856, "mlx_cache_bytes": 8605193904, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12878240856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1913 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4bd5bc30cc95afeb8e6b780e", "attempt_id": "fe572d530c05", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:25.763422Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 385, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 51.77820904646069, "ttft_ms": 14.592000050470233, "decode_ms": 14.24158294685185}, "total_wall_ms": 81.45670802332461, "ttft_ms": 14.592000050470233, "input_usage": {"receiver_prompt_tokens": 385, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12877651032, "mlx_cache_bytes": 8619349680, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12877651032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1914 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7b785c6d8d1bff97119f2aa2", "attempt_id": "27d4f57845f9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:25.867095Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 400, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.30087500624359, "ttft_ms": 13.627666980028152, "decode_ms": 13.424375094473362}, "total_wall_ms": 81.19883306790143, "ttft_ms": 13.627666980028152, "input_usage": {"receiver_prompt_tokens": 400, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885662808, "mlx_cache_bytes": 8842794672, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12885662808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1915 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e467102d70b97a87c4f93adb", "attempt_id": "c5d7b5852ef8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:25.969987Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 394, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.13908401876688, "ttft_ms": 13.661667006090283, "decode_ms": 13.502625050023198}, "total_wall_ms": 81.10691595356911, "ttft_ms": 13.661667006090283, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882582616, "mlx_cache_bytes": 8842794672, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12882582616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1916 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce21dbf2631a8f6b791fcd11", "attempt_id": "e0376297f554", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.073175Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 403, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.49725007545203, "ttft_ms": 13.566166977398098, "decode_ms": 13.333749957382679}, "total_wall_ms": 81.24258404131979, "ttft_ms": 13.566166977398098, "input_usage": {"receiver_prompt_tokens": 403, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887399512, "mlx_cache_bytes": 9082771120, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12887399512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1917 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f37ec3c8b426203aa43f9473", "attempt_id": "18de1c6c2d7f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.175669Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 397, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.43441595323384, "ttft_ms": 13.579457998275757, "decode_ms": 67.6240420434624}, "total_wall_ms": 135.50204201601446, "ttft_ms": 13.579457998275757, "input_usage": {"receiver_prompt_tokens": 397, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904225880, "mlx_cache_bytes": 9223968432, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12904225880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,261,538", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "79bd6584714ca010fcf7884ec45ccf962c42b77239c83ed7dbfbfc382ca4edcd"} | ||||
| 1918 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "90db1d22d803f1b960ffc023", "attempt_id": "40941100229c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.332960Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 393, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.60441596712917, "ttft_ms": 13.854167074896395, "decode_ms": 13.969750027172267}, "total_wall_ms": 82.27041608188301, "ttft_ms": 13.854167074896395, "input_usage": {"receiver_prompt_tokens": 393, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882582616, "mlx_cache_bytes": 9223968432, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12882582616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1919 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0edef885fb37d00dc890063", "attempt_id": "9a6d6b849f84", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.437040Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 397, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.5962920403108, "ttft_ms": 13.738583074882627, "decode_ms": 13.401790987700224}, "total_wall_ms": 81.52079198043793, "ttft_ms": 13.738583074882627, "input_usage": {"receiver_prompt_tokens": 397, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12909141080, "mlx_cache_bytes": 9223968432, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12909141080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1920 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a2a1116d5d298ac02059a82d", "attempt_id": "b038179008f7", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.539867Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 399, "message_tokens": 273, "message_utf8_bytes": 756, "cache_tensor_bytes": null, "serialized_payload_bytes": 756, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8403.401624993421, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.28566604293883, "ttft_ms": 13.629332999698818, "decode_ms": 13.738875044509768}, "total_wall_ms": 81.44424995407462, "ttft_ms": 13.629332999698818, "input_usage": {"receiver_prompt_tokens": 399, "sender_input_tokens": 5777, "sender_output_tokens": 512, "sender_prefill_ms": 802.4617090122774, "sender_ttft_ms": 15.695124980993569, "sender_decode_ms": 7580.96045802813}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885662808, "mlx_cache_bytes": 9223968432, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 12885662808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "82c12c719034d2582de113eee47c362d2b1ffae0a8bc845cbea3ec504a32f48b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1921 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c9eef145a5b26ee7e94932a", "attempt_id": "3f10eec05f3e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.647057Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 609, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.93391609750688, "ttft_ms": 13.610249967314303, "decode_ms": 13.907999964430928}, "total_wall_ms": 103.47933403681964, "ttft_ms": 13.610249967314303, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708492, "mlx_cache_bytes": 9466779312, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 13034708492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1922 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9fc2fbd545b4b300d0961cc2", "attempt_id": "552a2fbebf66", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.771436Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 601, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.68337507452816, "ttft_ms": 13.695875066332519, "decode_ms": 27.07495796494186}, "total_wall_ms": 116.46216607186943, "ttft_ms": 13.695875066332519, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13030366732, "mlx_cache_bytes": 9802241712, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 13030366732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1923 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0193793cdab31ddeb0aa6067", "attempt_id": "6e1dcbff73e0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:26.909288Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 600, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.10441699903458, "ttft_ms": 13.439417001791298, "decode_ms": 27.318749926052988}, "total_wall_ms": 115.87912496179342, "ttft_ms": 13.439417001791298, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13030366732, "mlx_cache_bytes": 9802241712, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 13030366732, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 1924 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f5e5a84c59110f98e42b529c", "attempt_id": "fb8c27fd27c6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:27.046883Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 615, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.59695902839303, "ttft_ms": 13.719000038690865, "decode_ms": 67.79687502421439}, "total_wall_ms": 159.18712504208088, "ttft_ms": 13.719000038690865, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039083020, "mlx_cache_bytes": 10085701296, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 13039083020, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,782,250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "9e8f8185ef1e292f5c23ff36cfaf1b8f94dd03ebe9397ea178b92c4926b199c1"} | ||||
| 1925 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c4a1e13a585a34e06cbec5dc", "attempt_id": "5a1048b285a8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:27.227489Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 609, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.7574589913711, "ttft_ms": 13.58050003182143, "decode_ms": 68.16991697996855}, "total_wall_ms": 157.53716602921486, "ttft_ms": 13.58050003182143, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708492, "mlx_cache_bytes": 10085701296, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 13034708492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,632,220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "b44a776e6bb6f15c7526630db9ad71e409f2e799d7bb0d8bfb42c1ec7e29ed3b"} | ||||
| 1926 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "33762bb04613822bfa9a0683", "attempt_id": "e649b1050f63", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:27.406194Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 618, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.92712498828769, "ttft_ms": 13.85204098187387, "decode_ms": 67.36766698304564}, "total_wall_ms": 159.19891698285937, "ttft_ms": 13.85204098187387, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119715328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071801868, "mlx_cache_bytes": 10305771184, "process_rss_bytes": 1119715328}, "peak_prefill_memory": null, "peak_decode_memory": 13071801868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1927 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b11efc5de9aa2b340143a17b", "attempt_id": "769ad1c466b0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:27.587234Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 612, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.25225000083447, "ttft_ms": 13.783875037916005, "decode_ms": 67.63700000010431}, "total_wall_ms": 158.7044158950448, "ttft_ms": 13.783875037916005, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1119748096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037837836, "mlx_cache_bytes": 10305771184, "process_rss_bytes": 1119748096}, "peak_prefill_memory": null, "peak_decode_memory": 13037837836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,444,123", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "eb6f9ebdf9bfcac3842dd280d43c7de3405fa7f988b840c1bf52c5d2f978b5bd"} | ||||
| 1928 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e880404bde45ca312505529", "attempt_id": "06de84e7c883", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:27.767437Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 608, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.91712500248104, "ttft_ms": 13.61020898912102, "decode_ms": 13.715542037971318}, "total_wall_ms": 102.22962498664856, "ttft_ms": 13.61020898912102, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119748096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708492, "mlx_cache_bytes": 10305771184, "process_rss_bytes": 1119748096}, "peak_prefill_memory": null, "peak_decode_memory": 13034708492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1929 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "67521c9817a766cb5116e993", "attempt_id": "9885176c2d8c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:27.891371Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 612, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.4271249063313, "ttft_ms": 13.59879202209413, "decode_ms": 13.436167035251856}, "total_wall_ms": 104.41991593688726, "ttft_ms": 13.59879202209413, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119748096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037837836, "mlx_cache_bytes": 10305771184, "process_rss_bytes": 1119748096}, "peak_prefill_memory": null, "peak_decode_memory": 13037837836, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1930 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7dfe4964d36a26f8947d700", "attempt_id": "06c579f2c5e1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:28.017128Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 504, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 614, "message_tokens": 503, "message_utf8_bytes": 1524, "cache_tensor_bytes": null, "serialized_payload_bytes": 1524, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275707993656397, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.26933399681002, "ttft_ms": 13.7866250006482, "decode_ms": 13.546374975703657}, "total_wall_ms": 105.60420795809478, "ttft_ms": 13.7866250006482, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1119748096, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198284, "mlx_cache_bytes": 10305771184, "process_rss_bytes": 1119748096}, "peak_prefill_memory": null, "peak_decode_memory": 13038198284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f9d3bab1a89e5e2953952260cea827a746ae384759a250f83b68e725e722b45e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1931 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d49c850d9762bbce8621dc44", "attempt_id": "d76e0ffc1ee8", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.212706Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 45, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 2.12304200977087, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.082791944034398, "ttft_ms": 23.082791944034398, "decode_ms": 43.57229208108038}, "total_wall_ms": 72.96412496361881, "ttft_ms": 23.082791944034398, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 10027790361, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not found.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "0802559db1375af3ff5caabba71acea1d6299f1a7fc64b6a5024f19cbd33b72f"} | ||||
| 1932 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "02f4278ec0f1947e39e0b575", "attempt_id": "c4731b82f3fa", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.307535Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 37, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 2.020500018261373, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.866958985105157, "ttft_ms": 22.866958985105157, "decode_ms": 14.543541008606553}, "total_wall_ms": 43.26608404517174, "ttft_ms": 22.866958985105157, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13659149540, "mlx_cache_bytes": 10264768537, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13659149540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1933 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc883e265884dd3ddb6091e6", "attempt_id": "3297a1ca42c7", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.372387Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 36, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 1.8608750542625785, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.114000050351024, "ttft_ms": 22.114000050351024, "decode_ms": 14.228667016141117}, "total_wall_ms": 42.050707968883216, "ttft_ms": 22.114000050351024, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13658887396, "mlx_cache_bytes": 10274009113, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13658887396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1934 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "84dc3b9f46ee4c0fa2f78445", "attempt_id": "4f21ff059733", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.435351Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 51, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 1.998333027586341, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.36183302011341, "ttft_ms": 22.36183302011341, "decode_ms": 28.814334073103964}, "total_wall_ms": 57.08712502382696, "ttft_ms": 22.36183302011341, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 51}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13671372028, "mlx_cache_bytes": 10288004058, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13671372028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 1935 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4e4045a0362adbbf8ade1eac", "attempt_id": "69c771ff27f0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.514099Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 45, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 1.8882500007748604, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.37262495327741, "ttft_ms": 22.37262495327741, "decode_ms": 71.68904202990234}, "total_wall_ms": 99.78499996941537, "ttft_ms": 22.37262495327741, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 10288004058, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,846,545", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "77d7beaf301ce085d0b52f1ffccc70fe340d883e4f7677ef3ec61ef496cd7d5d"} | ||||
| 1936 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3c156a8f9c6495e8de87933a", "attempt_id": "15a0cd8b5124", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.635255Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 54, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 1.9691659836098552, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.73420798499137, "ttft_ms": 21.73420798499137, "decode_ms": 72.97391700558364}, "total_wall_ms": 100.53545900154859, "ttft_ms": 21.73420798499137, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13673338120, "mlx_cache_bytes": 10538191086, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13673338120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1937 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "962e97af6839bdfcd0421d91", "attempt_id": "eb9028d1ec23", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.757191Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 48, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 1.8046670593321323, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.81691611278802, "ttft_ms": 22.81691611278802, "decode_ms": 72.3050000378862}, "total_wall_ms": 100.72099999524653, "ttft_ms": 22.81691611278802, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521212, "mlx_cache_bytes": 10563815662, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13668521212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,032,220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "e226527f9a6e882da53a9719b627e2c730f136ad114b889549ec384aedf3bdd1"} | ||||
| 1938 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3cd2c22d4b63985cb0eeb0c0", "attempt_id": "ba66fe836cb4", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:29.879054Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 44, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 1.6108750132843852, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.22925005480647, "ttft_ms": 22.22925005480647, "decode_ms": 86.58095798455179}, "total_wall_ms": 114.51237509027123, "ttft_ms": 22.22925005480647, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 44}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666227428, "mlx_cache_bytes": 10575104238, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13666227428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not present in the text.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "f305e086f8114e736778d33fdcdbf08bf6fa555dc3208d99cbc0e45293867ffe"} | ||||
| 1939 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ab170bef3b574a3474395f27", "attempt_id": "2b063446e4dd", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:30.014881Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 48, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 2.1539160516113043, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.44374994188547, "ttft_ms": 22.44374994188547, "decode_ms": 14.498749980702996}, "total_wall_ms": 42.93025005608797, "ttft_ms": 22.44374994188547, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521212, "mlx_cache_bytes": 10575104238, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13668521212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1940 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ac8124afe6b54869d636b6cd", "attempt_id": "b94bad1b4418", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:30.079410Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5673, "keep": 1418, "compress_ms": 10.861708084121346}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 50, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1068.6089999508113, "doc_prefill_ms": 789.594916976057, "compress_ms": 10.89912501629442, "serialize_ms": 259.63662494905293, "load_ms": 1.1497499654069543, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.01920805964619, "ttft_ms": 22.01920805964619, "decode_ms": 14.38795798458159}, "total_wall_ms": 41.3703330559656, "ttft_ms": 22.01920805964619, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1445494784, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13673387260, "mlx_cache_bytes": 10591045870, "process_rss_bytes": 1445494784}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13673387260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 1941 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "86a5b8384b166469748bc343", "attempt_id": "b16f4c247a8f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:30.141989Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 45, "compress_ms": 90.66245798021555}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 45, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 130.4979999549687, "doc_prefill_ms": 789.594916976057, "compress_ms": 94.4397080456838, "serialize_ms": 35.87337501812726, "load_ms": 1.7622500890865922, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.42941688746214, "ttft_ms": 22.42941688746214, "decode_ms": 100.94579099677503}, "total_wall_ms": 259.64625005144626, "ttft_ms": 22.42941688746214, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1446445056, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 11965466966, "process_rss_bytes": 1446445056}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 1942 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7eb16032e8a333af770ad6cc", "attempt_id": "56c351da14c3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:30.423598Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 37, "compress_ms": 77.72133406251669}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 37, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 112.40683402866125, "doc_prefill_ms": 789.594916976057, "compress_ms": 81.4988340716809, "serialize_ms": 30.72387503925711, "load_ms": 1.622541924007237, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.7575840651989, "ttft_ms": 21.7575840651989, "decode_ms": 28.86891702655703}, "total_wall_ms": 168.70441602077335, "ttft_ms": 21.7575840651989, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1609760768, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13659149540, "mlx_cache_bytes": 11999840598, "process_rss_bytes": 1609760768}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13659149540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1943 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26282a273f7f0a9399254485", "attempt_id": "32d1096e760b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:30.615774Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 36, "compress_ms": 76.8509169574827}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 36, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640733, "side_information_bytes": 13149, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.52725007012486, "doc_prefill_ms": 789.594916976057, "compress_ms": 80.58316702954471, "serialize_ms": 21.758791990578175, "load_ms": 1.807291992008686, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.581416949629784, "ttft_ms": 21.581416949629784, "decode_ms": 28.67341600358486}, "total_wall_ms": 158.59966597054154, "ttft_ms": 21.581416949629784, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1609760768, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13658887396, "mlx_cache_bytes": 12021287254, "process_rss_bytes": 1609760768}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13658887396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "41b0ca063fe412c878c4f00765819f8d12e722d2aff2aace8016c07b94d742c4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1944 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a20f28a57a8c249d5e3afa1", "attempt_id": "4e19692e0adc", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:30.796845Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 51, "compress_ms": 78.26904207468033}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 51, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.59841601550579, "doc_prefill_ms": 789.594916976057, "compress_ms": 82.25533296354115, "serialize_ms": 22.161042084917426, "load_ms": 1.663415925577283, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.562791080214083, "ttft_ms": 21.562791080214083, "decode_ms": 72.14595808181912}, "total_wall_ms": 203.96041707135737, "ttft_ms": 21.562791080214083, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1609760768, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13671372028, "mlx_cache_bytes": 12053842262, "process_rss_bytes": 1609760768}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13671372028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,782,250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "9e8f8185ef1e292f5c23ff36cfaf1b8f94dd03ebe9397ea178b92c4926b199c1"} | ||||
| 1945 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "338a91e1ba844f3f9913d440", "attempt_id": "7f946d437f70", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:31.023788Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 45, "compress_ms": 77.22374994773418}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 45, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 102.93533396907151, "doc_prefill_ms": 789.594916976057, "compress_ms": 81.02241693995893, "serialize_ms": 21.72808302566409, "load_ms": 1.8139159074053168, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.818333072587848, "ttft_ms": 21.818333072587848, "decode_ms": 72.18912499956787}, "total_wall_ms": 202.78187503572553, "ttft_ms": 21.818333072587848, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1609760768, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666505956, "mlx_cache_bytes": 12054759766, "process_rss_bytes": 1609760768}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13666505956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,632,220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "b44a776e6bb6f15c7526630db9ad71e409f2e799d7bb0d8bfb42c1ec7e29ed3b"} | ||||
| 1946 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f3d9d250d0881bce1b122150", "attempt_id": "28c79fa0b4c1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:31.249488Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 54, "compress_ms": 79.75558307953179}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 54, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 106.2529580667615, "doc_prefill_ms": 789.594916976057, "compress_ms": 83.77591706812382, "serialize_ms": 22.2889999859035, "load_ms": 1.7657079733908176, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.962374983355403, "ttft_ms": 20.962374983355403, "decode_ms": 72.56091700401157}, "total_wall_ms": 205.62262495514005, "ttft_ms": 20.962374983355403, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1609777152, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13673338120, "mlx_cache_bytes": 12104567126, "process_rss_bytes": 1609777152}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13673338120, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1947 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da9699432888717714bb2d47", "attempt_id": "ef1e76417626", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:31.477646Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 48, "compress_ms": 78.08904093690217}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 48, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.86937495786697, "doc_prefill_ms": 789.594916976057, "compress_ms": 82.08837499842048, "serialize_ms": 21.60266600549221, "load_ms": 1.8914169631898403, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.923875086940825, "ttft_ms": 21.923875086940825, "decode_ms": 72.36654195003211}, "total_wall_ms": 204.0900409920141, "ttft_ms": 21.923875086940825, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1609777152, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521212, "mlx_cache_bytes": 12146379094, "process_rss_bytes": 1609777152}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13668521212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,789,326", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "9d49d570c1affe8964496524802a9337440f018935583893d19e8d7e521b8510"} | ||||
| 1948 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c555cb1fd3b704f62fbf1a2", "attempt_id": "7ccae18d4cc2", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:31.704192Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 44, "compress_ms": 77.84574991092086}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 44, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 103.97174989338964, "doc_prefill_ms": 789.594916976057, "compress_ms": 81.58620807807893, "serialize_ms": 22.207832895219326, "load_ms": 1.7160000279545784, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.56304195523262, "ttft_ms": 21.56304195523262, "decode_ms": 43.0638330290094}, "total_wall_ms": 174.37741602770984, "ttft_ms": 21.56304195523262, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1609777152, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13666227428, "mlx_cache_bytes": 12170348886, "process_rss_bytes": 1609777152}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13666227428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.47", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "b440d5b1227fa50d5a1413a593f4777388144db3ec5ce126ab798efba0a0514b"} | ||||
| 1949 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e7b57d0d8ef0c7c8111e6ff2", "attempt_id": "bb814ebed40f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:31.901729Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 48, "compress_ms": 77.91308395098895}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 48, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.17824995238334, "doc_prefill_ms": 789.594916976057, "compress_ms": 81.93824999034405, "serialize_ms": 22.056707995943725, "load_ms": 1.7884999979287386, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.037707967683673, "ttft_ms": 22.037707967683673, "decode_ms": 14.41808301024139}, "total_wall_ms": 146.4715829351917, "ttft_ms": 22.037707967683673, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1609777152, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521212, "mlx_cache_bytes": 12170348886, "process_rss_bytes": 1609777152}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13668521212, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1950 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6bfa65f28b8f0e9e360f48da", "attempt_id": "768244f53519", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:32.070600Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5673, "keep": 1418, "window_tokens": 50, "compress_ms": 78.15524993930012}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 50, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.52449996955693, "doc_prefill_ms": 789.594916976057, "compress_ms": 81.9800419267267, "serialize_ms": 22.322500008158386, "load_ms": 1.770750037394464, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.024708985351026, "ttft_ms": 21.024708985351026, "decode_ms": 14.360625064000487}, "total_wall_ms": 145.76416707132012, "ttft_ms": 21.024708985351026, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1609777152, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13670274300, "mlx_cache_bytes": 12208179542, "process_rss_bytes": 1609777152}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 13670274300, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1951 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "13c5c5f982a1b171d64695b4", "attempt_id": "4f715b149554", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:32.339782Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 45, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 6.451042019762099, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.57704204507172, "ttft_ms": 28.57704204507172, "decode_ms": 115.71074998937547}, "total_wall_ms": 154.5899580232799, "ttft_ms": 28.57704204507172, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14144359452, "mlx_cache_bytes": 13015074326, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14144359452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "YA-85D-7885", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "d7c446b684af4f3a0aa8481919c405aba8a334272947b087f62b1b6c80b3f946"} | ||||
| 1952 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c476541792e42723f39c07ee", "attempt_id": "7ae2f775c07b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:32.517067Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 37, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 3.0291249277070165, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.17012504581362, "ttft_ms": 27.17012504581362, "decode_ms": 33.28762506134808}, "total_wall_ms": 67.35974992625415, "ttft_ms": 27.17012504581362, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14127053124, "mlx_cache_bytes": 13015488662, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14127053124, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1953 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e63d725b0a43c42a486d45d", "attempt_id": "14a553e71579", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:32.606457Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 36, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 2.2532499860972166, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.394082979299128, "ttft_ms": 27.394082979299128, "decode_ms": 33.42954197432846}, "total_wall_ms": 67.01091700233519, "ttft_ms": 27.394082979299128, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14125480260, "mlx_cache_bytes": 13074765974, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14125480260, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 1954 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f0eaa2bd98a5800f6694107", "attempt_id": "9480b4eba374", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:32.694716Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 51, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 2.1114579867571592, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.412875020876527, "ttft_ms": 28.412875020876527, "decode_ms": 83.15958408638835}, "total_wall_ms": 117.56875005085021, "ttft_ms": 28.412875020876527, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13971805192, "mlx_peak_bytes": 14158353533, "mlx_cache_bytes": 13488076918, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14158353533, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,782,250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "9e8f8185ef1e292f5c23ff36cfaf1b8f94dd03ebe9397ea178b92c4926b199c1"} | ||||
| 1955 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f76952121296e238f7d73f69", "attempt_id": "9cc5970587dd", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:32.834249Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 45, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 3.1005420023575425, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.63812500052154, "ttft_ms": 27.63812500052154, "decode_ms": 82.20829092897475}, "total_wall_ms": 117.07662499975413, "ttft_ms": 27.63812500052154, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14144356004, "mlx_cache_bytes": 13488994422, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14144356004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,632,220", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "b44a776e6bb6f15c7526630db9ad71e409f2e799d7bb0d8bfb42c1ec7e29ed3b"} | ||||
| 1956 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "67f27b998864cfcfc5830fa2", "attempt_id": "dbe87820d5fa", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:32.972890Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 54, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 2.9117920203134418, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.826917055994272, "ttft_ms": 28.826917055994272, "decode_ms": 82.61608402244747}, "total_wall_ms": 118.48583293613046, "ttft_ms": 28.826917055994272, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13971805192, "mlx_peak_bytes": 14164711017, "mlx_cache_bytes": 13647829558, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14164711017, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ruksol-3", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "df672b6adfdef81742635c0ef2ac39baba09d15dea6c1ec8cdcec73661af11e3"} | ||||
| 1957 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "59cbda6556119676b38bfabb", "attempt_id": "23db3f465322", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:33.113238Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 48, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 2.092250040732324, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.107625083066523, "ttft_ms": 28.107625083066523, "decode_ms": 82.30450004339218}, "total_wall_ms": 116.55870906542987, "ttft_ms": 28.107625083066523, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14150715068, "mlx_cache_bytes": 13727881782, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14150715068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,789,225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "8e932c1fd7116275c4255a7b0a8bcca314f3a877df0adb977f698071fe93fa18"} | ||||
| 1958 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "24d2587e6bae97dfa351275d", "attempt_id": "2e7e8e36246d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:33.251587Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 44, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 3.138249972835183, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.81308302655816, "ttft_ms": 27.81308302655816, "decode_ms": 49.60237490013242}, "total_wall_ms": 84.6153749153018, "ttft_ms": 27.81308302655816, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14142683236, "mlx_cache_bytes": 13800331830, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14142683236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0.47", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "b440d5b1227fa50d5a1413a593f4777388144db3ec5ce126ab798efba0a0514b"} | ||||
| 1959 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f2939276e3d4b741a240cbbf", "attempt_id": "2891ef94a51e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:33.358235Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 48, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 3.080124966800213, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.705791988410056, "ttft_ms": 27.705791988410056, "decode_ms": 16.654500039294362}, "total_wall_ms": 51.46054201759398, "ttft_ms": 27.705791988410056, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14150715068, "mlx_cache_bytes": 13800331830, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14150715068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1960 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ebfdca9b168fbdb3ebbfc7d8", "attempt_id": "f2c6471e1e54", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:33.432419Z", "task_family": "synthetic", "document_id": "syn_03013_8000", "document_hash": "779b3b1693ab26a564a0bbea9239f13134bc3d34d4fb5688b86da554a5994b05", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03013_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5613, "source_tokens_receiver": 5613, "query_tokens": 50, "message_tokens": 5673, "message_utf8_bytes": 29338, "cache_tensor_bytes": 345644544, "serialized_payload_bytes": 345671880, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 100.70120892487466, "doc_prefill_ms": 789.594916976057, "compress_ms": 17.67158298753202, "serialize_ms": 82.74312503635883, "load_ms": 2.983874990604818, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.411915991455317, "ttft_ms": 28.411915991455317, "decode_ms": 16.466917004436255}, "total_wall_ms": 51.67404096573591, "ttft_ms": 28.411915991455317, "input_usage": {"receiver_prefix_tokens": 5673, "dense_cache_bytes": 650625024, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2302132224, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14156105404, "mlx_cache_bytes": 13882808886, "process_rss_bytes": 2302132224}, "peak_prefill_memory": 13735334964, "peak_decode_memory": 14156105404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03013_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7511f1e8dcdf27bc147bf2a556ff2c896f540c6e5b4dd56fb133769ab4a63dd7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1961 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "23078aa6c14fc53c99e935a4", "attempt_id": "588bc67196bd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:33.583021Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11147, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1584.8417499801144, "ttft_ms": 15.138208982534707, "decode_ms": 145.68079204764217}, "total_wall_ms": 1761.7814999539405, "ttft_ms": 15.138208982534707, "input_usage": {"receiver_prompt_tokens": 11147}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1858715648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 3968868792, "process_rss_bytes": 1858715648}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 1962 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bf428a9cca61ee6f5f73d05a", "attempt_id": "47f1a8483c37", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:35.375895Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11141, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1687.195249949582, "ttft_ms": 15.199834015220404, "decode_ms": 15.183250070549548}, "total_wall_ms": 1733.5777090629563, "ttft_ms": 15.199834015220404, "input_usage": {"receiver_prompt_tokens": 11141}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858715648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4497990072, "process_rss_bytes": 1858715648}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1963 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "516fba64a6744559b2d92923", "attempt_id": "1d8ab889319a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:37.139630Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11141, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1762.15291605331, "ttft_ms": 15.406291000545025, "decode_ms": 15.102291945368052}, "total_wall_ms": 1809.3875420745462, "ttft_ms": 15.406291000545025, "input_usage": {"receiver_prompt_tokens": 11141}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858715648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4497990072, "process_rss_bytes": 1858715648}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 1964 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f34fd6e84363eae9b0157d25", "attempt_id": "3a7cf327f036", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:38.980038Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11157, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1819.7336250450462, "ttft_ms": 15.347165986895561, "decode_ms": 104.58725003991276}, "total_wall_ms": 1955.8122500311583, "ttft_ms": 15.347165986895561, "input_usage": {"receiver_prompt_tokens": 11157}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1858715648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5059027384, "process_rss_bytes": 1858715648}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8189710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "0e29458d3d62613e564b50cee6e041e654f6c59aba26eb6bd0703d95cfc686cd"} | ||||
| 1965 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b3cacf22477c146b788c3597", "attempt_id": "449309af3077", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:40.966914Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11150, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1777.4968340527266, "ttft_ms": 15.303625026717782, "decode_ms": 105.20333296153694}, "total_wall_ms": 1914.6432499401271, "ttft_ms": 15.303625026717782, "input_usage": {"receiver_prompt_tokens": 11150}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1858715648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5470724536, "process_rss_bytes": 1858715648}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "3739fd622fb90f28a6ba23b6391fc85a3d64478214b8012e7895bd4f3bf0caff"} | ||||
| 1966 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bac3210064370708b806ffee", "attempt_id": "a15b2cd6f1e5", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:42.911313Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11159, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1822.0227499259636, "ttft_ms": 15.65308403223753, "decode_ms": 104.62933301459998}, "total_wall_ms": 1958.814708981663, "ttft_ms": 15.65308403223753, "input_usage": {"receiver_prompt_tokens": 11159}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1858715648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6010741176, "process_rss_bytes": 1858715648}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 1967 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b383848b28953e54f688d04", "attempt_id": "6084fa6d1a6c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:44.900268Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11151, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1795.1835409039631, "ttft_ms": 15.266292029991746, "decode_ms": 103.64662506617606}, "total_wall_ms": 1930.2502080099657, "ttft_ms": 15.266292029991746, "input_usage": {"receiver_prompt_tokens": 11151}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1858715648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6385377720, "process_rss_bytes": 1858715648}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3804165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "c93f344d5c194d22eba4818cea7d22ac0213a2c7239e00dd200f71c56a4818e5"} | ||||
| 1968 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4fe1f3199fd1b86289b70b6f", "attempt_id": "141d032852fa", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:46.860898Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11148, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1819.8025419842452, "ttft_ms": 15.406750026158988, "decode_ms": 60.4520000051707}, "total_wall_ms": 1912.5490830047056, "ttft_ms": 15.406750026158988, "input_usage": {"receiver_prompt_tokens": 11148}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1858764800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6758834616, "process_rss_bytes": 1858764800}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2150", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "81b187544ef8734d6c3668ffd47b2e7761a7c374074eb4091e95a5385a318c9d"} | ||||
| 1969 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ba55c7cc4043c8c3db1edacb", "attempt_id": "c809d02faa3b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:48.803372Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11150, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1835.0786250084639, "ttft_ms": 15.270999982021749, "decode_ms": 149.438958032988}, "total_wall_ms": 2015.7576251076534, "ttft_ms": 15.270999982021749, "input_usage": {"receiver_prompt_tokens": 11150}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1858764800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6758834616, "process_rss_bytes": 1858764800}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 1970 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a5a35f24637e6624c970fb3", "attempt_id": "d050d3979d5f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:00:50.849249Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 11152, "message_tokens": 11064, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1805.6431249715388, "ttft_ms": 15.041499980725348, "decode_ms": 15.28466702438891}, "total_wall_ms": 1852.5947500020266, "ttft_ms": 15.041499980725348, "input_usage": {"receiver_prompt_tokens": 11152}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858764800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 7134060984, "process_rss_bytes": 1858764800}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1971 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea8732431898f0fb9ce97c11", "attempt_id": "921764b1faad", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:01.954560Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.08783402852714, "ttft_ms": 13.3156250230968, "decode_ms": 13.251291937194765}, "total_wall_ms": 97.80325007159263, "ttft_ms": 13.3156250230968, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858863104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994733144, "mlx_cache_bytes": 8976778680, "process_rss_bytes": 1858863104}, "peak_prefill_memory": null, "peak_decode_memory": 12994733144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1972 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f1ec9baa64d2c42e107880c8", "attempt_id": "f398ecccb7f0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:02.083325Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.60508297197521, "ttft_ms": 13.504707952961326, "decode_ms": 13.424750068224967}, "total_wall_ms": 97.60595799889416, "ttft_ms": 13.504707952961326, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858863104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 9322415544, "process_rss_bytes": 1858863104}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1973 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3eef7e02d380331137470c75", "attempt_id": "0be532251999", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:02.211582Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.65512502938509, "ttft_ms": 13.492916012182832, "decode_ms": 13.279624981805682}, "total_wall_ms": 97.485417034477, "ttft_ms": 13.492916012182832, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858863104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 9322415544, "process_rss_bytes": 1858863104}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1974 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2098d2d0a0a5396de5435027", "attempt_id": "9d9b26ab2a02", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:02.339721Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 609, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.36437502130866, "ttft_ms": 13.99712497368455, "decode_ms": 95.24829196743667}, "total_wall_ms": 185.72670803405344, "ttft_ms": 13.99712497368455, "input_usage": {"receiver_prompt_tokens": 609, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1858863104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997846104, "mlx_cache_bytes": 9692235192, "process_rss_bytes": 1858863104}, "peak_prefill_memory": null, "peak_decode_memory": 12997846104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "3739fd622fb90f28a6ba23b6391fc85a3d64478214b8012e7895bd4f3bf0caff"} | ||||
| 1975 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "960cfeb9afd6074d0c190499", "attempt_id": "d3ba58612c3a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:02.555811Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.23974990099669, "ttft_ms": 13.724459102377295, "decode_ms": 94.40370905213058}, "total_wall_ms": 180.48150010872632, "ttft_ms": 13.724459102377295, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1858863104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009888344, "mlx_cache_bytes": 9962030520, "process_rss_bytes": 1858863104}, "peak_prefill_memory": null, "peak_decode_memory": 13009888344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "3739fd622fb90f28a6ba23b6391fc85a3d64478214b8012e7895bd4f3bf0caff"} | ||||
| 1976 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "179fb8c69213d599a34e948a", "attempt_id": "39745a02f56e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:02.765965Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 611, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.12012498732656, "ttft_ms": 13.356624986045063, "decode_ms": 79.53333295881748}, "total_wall_ms": 167.5152499228716, "ttft_ms": 13.356624986045063, "input_usage": {"receiver_prompt_tokens": 611, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1858879488, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12999894104, "mlx_cache_bytes": 10339517880, "process_rss_bytes": 1858879488}, "peak_prefill_memory": null, "peak_decode_memory": 12999894104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Drapratis-19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "d16129495492fc816bf31da116e8c9b11f7f3c42b8035f38fd128c983cd567eb"} | ||||
| 1977 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d673ac09cad3e764432b4d23", "attempt_id": "b754fc69ed24", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:02.963484Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.26229198183864, "ttft_ms": 13.35804199334234, "decode_ms": 399.468292016536}, "total_wall_ms": 485.2119580609724, "ttft_ms": 13.35804199334234, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 30}, "provider_cached_usage": null, "process_memory": 1858879488, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 10587342264, "process_rss_bytes": 1858879488}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346160\n8158050\n8189710\n8821450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "3b8e0eb75964932c6feaf89b36875e0490bc5b08cc2d58fcc55ca6cf0a653af5"} | ||||
| 1978 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6206ec13b2c63565382fabdf", "attempt_id": "ebdae9f51d01", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:03.479176Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.4608749365434, "ttft_ms": 13.469500001519918, "decode_ms": 66.1619589664042}, "total_wall_ms": 151.20974997989833, "ttft_ms": 13.469500001519918, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1858879488, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992668760, "mlx_cache_bytes": 10833987000, "process_rss_bytes": 1858879488}, "peak_prefill_memory": null, "peak_decode_memory": 12992668760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "21500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "16c655c82722e0b70099349809691ff18dd420a00614422b31a55d33cefc3ecb"} | ||||
| 1979 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "791a994190aae2388d571f83", "attempt_id": "56aca367d65e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:03.660360Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 602, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.91099996957928, "ttft_ms": 13.501666951924562, "decode_ms": 13.562249951064587}, "total_wall_ms": 98.05120795499533, "ttft_ms": 13.501666951924562, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858879488, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007397976, "mlx_cache_bytes": 10833987000, "process_rss_bytes": 1858879488}, "peak_prefill_memory": null, "peak_decode_memory": 13007397976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1980 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c0cfea67168b0bc34208857d", "attempt_id": "a827aa92ff61", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:03.788618Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1400, "cache_tensor_bytes": null, "serialized_payload_bytes": 1400, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9222.870792029426, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.43554203119129, "ttft_ms": 13.439292088150978, "decode_ms": 13.39775009546429}, "total_wall_ms": 98.37924991734326, "ttft_ms": 13.439292088150978, "input_usage": {"receiver_prompt_tokens": 604, "sender_input_tokens": 11180, "sender_output_tokens": 512, "sender_prefill_ms": 1852.7810840168968, "sender_ttft_ms": 15.104833990335464, "sender_decode_ms": 7346.880457946099}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1858879488, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008282712, "mlx_cache_bytes": 11082401208, "process_rss_bytes": 1858879488}, "peak_prefill_memory": null, "peak_decode_memory": 13008282712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f77150f2c8ef663064104f4504a6334fa7a69343a234ba73cb97117f65f2367a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1981 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e9b1a7a29f80fae205be52f", "attempt_id": "98141eaa3dc6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:13.153549Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 426, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.08525001257658, "ttft_ms": 13.333250069990754, "decode_ms": 137.44279206730425}, "total_wall_ms": 205.89858293533325, "ttft_ms": 13.333250069990754, "input_usage": {"receiver_prompt_tokens": 426, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12955392788, "mlx_cache_bytes": 12056218716, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12955392788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 1982 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "52667538e393746780153114", "attempt_id": "8b298086b69f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:13.390421Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 420, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.56241692788899, "ttft_ms": 13.433832908049226, "decode_ms": 13.519999920390546}, "total_wall_ms": 81.47633308544755, "ttft_ms": 13.433832908049226, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950444820, "mlx_cache_bytes": 12384570460, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12950444820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1983 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b2477e41efb2eff6ba3dd725", "attempt_id": "9840bb7d0c7e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:13.504919Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 420, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.44629194587469, "ttft_ms": 13.473666971549392, "decode_ms": 13.218041975051165}, "total_wall_ms": 81.04558405466378, "ttft_ms": 13.473666971549392, "input_usage": {"receiver_prompt_tokens": 420, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950444820, "mlx_cache_bytes": 12384570460, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12950444820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1984 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b99219645b7bbba9bb0369ca", "attempt_id": "9223a096b01b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:13.616319Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 436, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.68570901919156, "ttft_ms": 13.573333038948476, "decode_ms": 13.390416977927089}, "total_wall_ms": 81.54783397912979, "ttft_ms": 13.573333038948476, "input_usage": {"receiver_prompt_tokens": 436, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12962667324, "mlx_cache_bytes": 12739728168, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12962667324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1985 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5b643c5bd6107ca3402bd86e", "attempt_id": "07455be18819", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:13.728062Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 429, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.633084055036306, "ttft_ms": 13.306832988746464, "decode_ms": 13.168458943255246}, "total_wall_ms": 80.99541603587568, "ttft_ms": 13.306832988746464, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12956965692, "mlx_cache_bytes": 12974871336, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12956965692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1986 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da426330efc459d8c0a6303f", "attempt_id": "b393a2ff8c00", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:13.839102Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 438, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.840041044168174, "ttft_ms": 14.628333039581776, "decode_ms": 13.100915937684476}, "total_wall_ms": 82.49179203994572, "ttft_ms": 14.628333039581776, "input_usage": {"receiver_prompt_tokens": 438, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12964682564, "mlx_cache_bytes": 13317724668, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12964682564, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1987 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "125af97876f06ab9eeac1d7b", "attempt_id": "43cddd3dab15", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:13.951904Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 430, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.48645802587271, "ttft_ms": 13.319167075678706, "decode_ms": 79.72020807210356}, "total_wall_ms": 147.42395794019103, "ttft_ms": 13.319167075678706, "input_usage": {"receiver_prompt_tokens": 430, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12905454372, "mlx_cache_bytes": 13494475260, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12905454372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346160", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "3b0a689b683881b1e7b714099f969f96b453ba6d788e80a09b9a25958d619ae3"} | ||||
| 1988 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "921fcb2d157c30fa00c8d9d4", "attempt_id": "585848d9859b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:14.129507Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 427, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.647790919058025, "ttft_ms": 13.341499958187342, "decode_ms": 79.35016695410013}, "total_wall_ms": 147.2351250704378, "ttft_ms": 13.341499958187342, "input_usage": {"receiver_prompt_tokens": 427, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12955786044, "mlx_cache_bytes": 13728438780, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12955786044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "100000", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "3bb78535cc9555ff19fe3556aaa41c78a0a45c64d49ba2bc564507648a8e77a1"} | ||||
| 1989 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "442477431ea83ea2c3d27696", "attempt_id": "13165039d7a5", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:14.306895Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 429, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.79024997819215, "ttft_ms": 13.282833038829267, "decode_ms": 13.038292061537504}, "total_wall_ms": 80.98900003824383, "ttft_ms": 13.282833038829267, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12956965692, "mlx_cache_bytes": 13728438780, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12956965692, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1990 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd3a725cf535f992142545f1", "attempt_id": "101b0451ac28", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:14.417507Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 431, "message_tokens": 328, "message_utf8_bytes": 854, "cache_tensor_bytes": null, "serialized_payload_bytes": 854, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9236.712041078135, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.57354192528874, "ttft_ms": 13.146750046871603, "decode_ms": 13.542208005674183}, "total_wall_ms": 81.12929202616215, "ttft_ms": 13.146750046871603, "input_usage": {"receiver_prompt_tokens": 431, "sender_input_tokens": 11208, "sender_output_tokens": 512, "sender_prefill_ms": 1874.1204170510173, "sender_ttft_ms": 14.952208963222802, "sender_decode_ms": 7337.546417023987}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859026944, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12905749284, "mlx_cache_bytes": 13905484284, "process_rss_bytes": 1859026944}, "peak_prefill_memory": null, "peak_decode_memory": 12905749284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 3, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f291b1f8233f365ef31b11e18efe6935a5617e82257b71c0de5c84336325e1b2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1991 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0d5b479e4bd66e20c93f5395", "attempt_id": "2291daf86f0d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:14.536951Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 592, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.79912496171892, "ttft_ms": 13.353707967326045, "decode_ms": 13.50233401171863}, "total_wall_ms": 97.64908300712705, "ttft_ms": 13.353707967326045, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 13905484284, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1992 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f362235572330fd03c516d5f", "attempt_id": "116d515c8789", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:14.664102Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 586, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.544584072195, "ttft_ms": 13.456500018946826, "decode_ms": 13.589125010184944}, "total_wall_ms": 98.5464999685064, "ttft_ms": 13.456500018946826, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007397976, "mlx_cache_bytes": 14168201724, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 13007397976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1993 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5098cca76cc7a56d0c72b08e", "attempt_id": "bf77056dfda1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:14.793314Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 586, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.59774994943291, "ttft_ms": 13.485583942383528, "decode_ms": 13.400916941463947}, "total_wall_ms": 99.41170900128782, "ttft_ms": 13.485583942383528, "input_usage": {"receiver_prompt_tokens": 586}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13004973144, "mlx_cache_bytes": 14168201724, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 13004973144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 1994 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5715f4bfa251dde1de146acf", "attempt_id": "cf293ed6b9c4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:14.922717Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 602, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.70350004546344, "ttft_ms": 13.65241699386388, "decode_ms": 95.55349999573082}, "total_wall_ms": 182.84679192584008, "ttft_ms": 13.65241699386388, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007397976, "mlx_cache_bytes": 14168201724, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 13007397976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "3739fd622fb90f28a6ba23b6391fc85a3d64478214b8012e7895bd4f3bf0caff"} | ||||
| 1995 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a5b7f9f63aef503430f3664", "attempt_id": "660d71a8c34f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:15.135377Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 595, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.75479091145098, "ttft_ms": 13.68066598661244, "decode_ms": 94.31504202075303}, "total_wall_ms": 179.73383306525648, "ttft_ms": 13.68066598661244, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012673624, "mlx_cache_bytes": 14434851324, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 13012673624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "3739fd622fb90f28a6ba23b6391fc85a3d64478214b8012e7895bd4f3bf0caff"} | ||||
| 1996 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e96c4726b3bfa3cd3b62a24", "attempt_id": "9def7557717f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:15.344692Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 604, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.18149993382394, "ttft_ms": 13.43566703144461, "decode_ms": 94.00129201821983}, "total_wall_ms": 178.62799996510148, "ttft_ms": 13.43566703144461, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008282712, "mlx_cache_bytes": 14434851324, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 13008282712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 1997 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "84a40011b3981e68c69f40c8", "attempt_id": "d718ac954abf", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:15.553214Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 596, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.12204104103148, "ttft_ms": 14.041707967408001, "decode_ms": 508.08950001373887}, "total_wall_ms": 593.3213330572471, "ttft_ms": 14.041707967408001, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 38}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010609240, "mlx_cache_bytes": 14679923196, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 13010609240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346160\n10288485\n8158050\n346160\n8821450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "6b1dab593d0a8a14288f527ca5600661813c966e76e82e79ace6fb82ef4317fb"} | ||||
| 1998 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b97611c0b15fbf34c7cd159d", "attempt_id": "a8709639abdb", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:16.176820Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 593, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.95366606861353, "ttft_ms": 13.532750075682998, "decode_ms": 13.403333025053144}, "total_wall_ms": 97.98462502658367, "ttft_ms": 13.532750075682998, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 14679923196, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 1999 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "095bbd3036e1ca47927d98ec", "attempt_id": "0bfc81877d10", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:16.306356Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 595, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.94637497700751, "ttft_ms": 13.582458021119237, "decode_ms": 13.220833032391965}, "total_wall_ms": 97.80175006017089, "ttft_ms": 13.582458021119237, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010216024, "mlx_cache_bytes": 14679923196, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 13010216024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2000 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a04ae0e8d166dfd6f0eaa5c0", "attempt_id": "c9a703913e39", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:16.434834Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 13}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 597, "message_tokens": 508, "message_utf8_bytes": 1189, "cache_tensor_bytes": null, "serialized_payload_bytes": 1189, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.768040988594294, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.76966599561274, "ttft_ms": 13.658875017426908, "decode_ms": 13.56174994725734}, "total_wall_ms": 98.97208295296878, "ttft_ms": 13.658875017426908, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1859043328, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993700952, "mlx_cache_bytes": 14925289980, "process_rss_bytes": 1859043328}, "peak_prefill_memory": null, "peak_decode_memory": 12993700952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "6e9f425c97e2465b435712a22296dee20d844b297ed21e48882dcd9a395fce3e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2001 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "89f8a5416bb4726b05418df9", "attempt_id": "3816bd133d3f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:18.534655Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 44, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.7257919535040855, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.51695889048278, "ttft_ms": 32.51695889048278, "decode_ms": 142.7027080208063}, "total_wall_ms": 185.04079093690962, "ttft_ms": 32.51695889048278, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13280367856, "mlx_cache_bytes": 15172575981, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280367856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "AW-34Y-5883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "996159e95445ba10a0dc8d4d34936f8c6daa6ab431609552beed8912d42e39d4"} | ||||
| 2002 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "39eb6d83f7d371a79458d023", "attempt_id": "c6b7f35e7fcd", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:18.750043Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 38, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 0.9723330149427056, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.89849995356053, "ttft_ms": 29.89849995356053, "decode_ms": 14.20116692315787}, "total_wall_ms": 53.57787501998246, "ttft_ms": 29.89849995356053, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13274731760, "mlx_cache_bytes": 15209620205, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274731760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2003 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6484584823800eca6599dfba", "attempt_id": "6440f060631d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:18.833698Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 38, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.9338750280439854, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.079332947731018, "ttft_ms": 29.079332947731018, "decode_ms": 14.008708065375686}, "total_wall_ms": 53.05466603022069, "ttft_ms": 29.079332947731018, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13274731760, "mlx_cache_bytes": 15209620205, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274731760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2004 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "47a78038fe431194e85a9b55", "attempt_id": "5854a46f584d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:18.916633Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 54, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.8189999973401427, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.814916943199933, "ttft_ms": 30.814916943199933, "decode_ms": 112.93204105459154}, "total_wall_ms": 153.49808300379664, "ttft_ms": 30.814916943199933, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 54}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13288543512, "mlx_cache_bytes": 15256282269, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13288543512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12345000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "64d6c522ceed99f7ad66a9f8b6d61deadf8d3d19e972785139b93b8b5b2d9449"} | ||||
| 2005 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "605888e13075ae254a67a967", "attempt_id": "e4bfa5be55c4", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:19.100662Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 47, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.6817080322653055, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.288790982216597, "ttft_ms": 31.288790982216597, "decode_ms": 112.22700006328523}, "total_wall_ms": 153.65233295597136, "ttft_ms": 31.288790982216597, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13282350360, "mlx_cache_bytes": 15270569117, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13282350360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12500000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "7e004abcfebb4afbde445d3e1ed9e279cd0d89e0c640e8213d511e2520b27d41"} | ||||
| 2006 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "af3f28e5483711ed939da448", "attempt_id": "abc5011ce51a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:19.284887Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 56, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.7440420342609286, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.932000092230737, "ttft_ms": 29.932000092230737, "decode_ms": 84.4711660174653}, "total_wall_ms": 124.23099996522069, "ttft_ms": 29.932000092230737, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 56}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13289755936, "mlx_cache_bytes": 15287592541, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13289755936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Drapratis-19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "d16129495492fc816bf31da116e8c9b11f7f3c42b8035f38fd128c983cd567eb"} | ||||
| 2007 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2871d021d10b2d905ee778e9", "attempt_id": "f67d58c2de0a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:19.439981Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 48, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.9667079905048013, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.860750073567033, "ttft_ms": 29.860750073567033, "decode_ms": 14.189167064614594}, "total_wall_ms": 54.07841608393937, "ttft_ms": 29.860750073567033, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13282923800, "mlx_cache_bytes": 15306761821, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13282923800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "0", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "5feceb66ffc86f38d952786c6d696c79c2dbc239dd4e91b46729d73a27fb57e9"} | ||||
| 2008 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e60edcf153c2bd28002eeaa", "attempt_id": "6d9e462598ed", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:19.524305Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 45, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.9399590091779828, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.84920789115131, "ttft_ms": 30.84920789115131, "decode_ms": 71.13683398347348}, "total_wall_ms": 111.91033304203302, "ttft_ms": 30.84920789115131, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13280924952, "mlx_cache_bytes": 15338434118, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280924952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "f9bd7f602b256f32f8f8b7b45aa733e390adf642d440b3483c7339d5a3c743f5"} | ||||
| 2009 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2db90137afb8732fa2671711", "attempt_id": "f7924034c0c0", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:19.666202Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 47, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.9448749953880906, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.274500070139766, "ttft_ms": 31.274500070139766, "decode_ms": 14.060291927307844}, "total_wall_ms": 55.75095803942531, "ttft_ms": 31.274500070139766, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13282350360, "mlx_cache_bytes": 15338434118, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13282350360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2010 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5ba6e11a3d607b7831a7bf7d", "attempt_id": "c64c45470274", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:19.751590Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13115249672}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11103, "keep": 2776, "compress_ms": 12.267291895113885}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 49, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350744, "side_information_bytes": 16280, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1970.4953749896958, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 12.304292060434818, "serialize_ms": 22.98179198987782, "load_ms": 1.7674999544396996, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.553459004499018, "ttft_ms": 31.553459004499018, "decode_ms": 14.063125010579824}, "total_wall_ms": 55.40237505920231, "ttft_ms": 31.553459004499018, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1959510016, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13287462168, "mlx_cache_bytes": 15375986246, "process_rss_bytes": 1959510016}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13287462168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69c9b456c8b906c1a0c4096dd73c0b88cc89bb9336eb76a63ffbb3ff77adb3d7", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2011 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a8d98ce909285cfab413c1b8", "attempt_id": "924d4bef36c8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:19.838094Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 44, "compress_ms": 98.28945808112621}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 44, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 130.3401249460876, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 106.22624994721264, "serialize_ms": 23.880082997493446, "load_ms": 1.9290000200271606, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.441332979127765, "ttft_ms": 28.441332979127765, "decode_ms": 140.43124997988343}, "total_wall_ms": 309.3207080382854, "ttft_ms": 28.441332979127765, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1960460288, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13280056560, "mlx_cache_bytes": 15923211982, "process_rss_bytes": 1960460288}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280056560, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2012 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "251e461e825e10f81a1d177c", "attempt_id": "011e9d721d93", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:20.179074Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 38, "compress_ms": 91.47024992853403}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 38, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 122.31054098811, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 99.43995892535895, "serialize_ms": 22.63916691299528, "load_ms": 1.9536659820005298, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.01837497483939, "ttft_ms": 29.01837497483939, "decode_ms": 13.988042017444968}, "total_wall_ms": 175.52366701420397, "ttft_ms": 29.01837497483939, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2063089664, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13274731760, "mlx_cache_bytes": 15958748878, "process_rss_bytes": 2063089664}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274731760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2013 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "09dedceb051091203ad6d25c", "attempt_id": "fa07dad9823e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:20.386277Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 38, "compress_ms": 90.66108299884945}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 38, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.18412497732788, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 98.68570801336318, "serialize_ms": 15.256916987709701, "load_ms": 1.7281250329688191, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.933666995726526, "ttft_ms": 28.933666995726526, "decode_ms": 14.526834012940526}, "total_wall_ms": 167.5300830975175, "ttft_ms": 28.933666995726526, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2063089664, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13274731760, "mlx_cache_bytes": 15958748878, "process_rss_bytes": 2063089664}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274731760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2014 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cc3914cfdf2fe94155ffbc8", "attempt_id": "a088dd5da6e8", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:20.584576Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 54, "compress_ms": 94.03012506663799}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 54, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 117.34433297533542, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 102.39424998871982, "serialize_ms": 14.728000038303435, "load_ms": 1.5738330548629165, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.14458401594311, "ttft_ms": 30.14458401594311, "decode_ms": 98.31808391027153}, "total_wall_ms": 255.4676670115441, "ttft_ms": 30.14458401594311, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2063089664, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13288543512, "mlx_cache_bytes": 16014569166, "process_rss_bytes": 2063089664}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13288543512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "3739fd622fb90f28a6ba23b6391fc85a3d64478214b8012e7895bd4f3bf0caff"} | ||||
| 2015 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "108cca9447f8d9ff5e851ca1", "attempt_id": "966f8538e03b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:20.871366Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 47, "compress_ms": 92.24604105111212}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 47, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 116.13445798866451, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 100.68941593635827, "serialize_ms": 15.212416998110712, "load_ms": 1.5683339443057775, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.201584031805396, "ttft_ms": 31.201584031805396, "decode_ms": 98.93595799803734}, "total_wall_ms": 256.28600001800805, "ttft_ms": 31.201584031805396, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2063089664, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13282350360, "mlx_cache_bytes": 16050138830, "process_rss_bytes": 2063089664}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13282350360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158700", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "c0cd16462427e24b58adeb1ecae740bb55ab75d7704c3db911551e408ad699bf"} | ||||
| 2016 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2cf63d2d274fdeaab7c2a44c", "attempt_id": "094c0ef4f0bd", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:21.158334Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 56, "compress_ms": 95.16054193954915}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 56, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 118.92495804931968, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 103.13720803242177, "serialize_ms": 15.555332996882498, "load_ms": 1.7513339407742023, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.54120805952698, "ttft_ms": 29.54120805952698, "decode_ms": 98.88266597408801}, "total_wall_ms": 257.3484170716256, "ttft_ms": 29.54120805952698, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 56}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2063089664, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13289755936, "mlx_cache_bytes": 16089935566, "process_rss_bytes": 2063089664}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13289755936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 2017 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3f415b4a29b69c37d15f8222", "attempt_id": "ec3afc80a87c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:21.447612Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 48, "compress_ms": 92.45241701137275}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 48, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.63200003001839, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 100.35195900127292, "serialize_ms": 15.063625061884522, "load_ms": 1.7002500826492906, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.440041959285736, "ttft_ms": 31.440041959285736, "decode_ms": 99.09525001421571}, "total_wall_ms": 256.18754199240357, "ttft_ms": 31.440041959285736, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 48}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2063106048, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13282923800, "mlx_cache_bytes": 16124047054, "process_rss_bytes": 2063106048}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13282923800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3801165", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "685024d0d858c005e1bcbd8d3aa17a6e9228de92e18d9f3c8b98f0f8e58e85e2"} | ||||
| 2018 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6d1c5f9324c9275af911ac35", "attempt_id": "d3b0fc2780e4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:21.735692Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 45, "compress_ms": 91.28041693475097}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 45, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.48374995961785, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 99.0989999845624, "serialize_ms": 15.157083049416542, "load_ms": 1.7720420146360993, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.3069589426741, "ttft_ms": 30.3069589426741, "decode_ms": 56.12083396408707}, "total_wall_ms": 210.9262499725446, "ttft_ms": 30.3069589426741, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 45}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 2063122432, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13280924952, "mlx_cache_bytes": 16156028622, "process_rss_bytes": 2063122432}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280924952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2150", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "81b187544ef8734d6c3668ffd47b2e7761a7c374074eb4091e95a5385a318c9d"} | ||||
| 2019 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "40546f217f7856d87fd3dc94", "attempt_id": "80262330db40", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:21.977604Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 47, "compress_ms": 91.5992499794811}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 47, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350782, "side_information_bytes": 16318, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 115.69283402059227, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 99.97662506066263, "serialize_ms": 15.472791972570121, "load_ms": 1.6296249814331532, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.14887501578778, "ttft_ms": 31.14887501578778, "decode_ms": 140.71125001646578}, "total_wall_ms": 297.3184590227902, "ttft_ms": 31.14887501578778, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2063138816, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13282350360, "mlx_cache_bytes": 16156028622, "process_rss_bytes": 2063138816}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13282350360, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89bfb2606a4d0016607e8d09dff0188f8acb39a951656d8887619ec404807ea", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2020 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4a06bb2078d0ebf4c3909715", "attempt_id": "3c2759e5ad8b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:22.306323Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13012620296}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11103, "keep": 2776, "window_tokens": 49, "compress_ms": 92.90479100309312}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 49, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 102334464, "serialized_payload_bytes": 102350783, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 116.80970794986933, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 100.76249996200204, "serialize_ms": 15.808916999958456, "load_ms": 0.766709097661078, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.731874983757734, "ttft_ms": 30.731874983757734, "decode_ms": 13.883500010706484}, "total_wall_ms": 170.67999998107553, "ttft_ms": 30.731874983757734, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2063138816, "backend_memory": {"mlx_active_bytes": 13220238344, "mlx_peak_bytes": 13287298328, "mlx_cache_bytes": 16191270606, "process_rss_bytes": 2063138816}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13287298328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9c529006283a4a685bab1234757ceab8bc2a27041db28f76a4269452bf75e350", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2021 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a03d23669b22044c2cc9ffc1", "attempt_id": "b7bb49e1bcbc", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:22.565017Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 44, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 5.37054194137454, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.45791700202972, "ttft_ms": 37.45791700202972, "decode_ms": 167.60883305687457}, "total_wall_ms": 218.9274999545887, "ttft_ms": 37.45791700202972, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 44}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 2158936064, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13655266793, "mlx_cache_bytes": 16784967470, "process_rss_bytes": 2158936064}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13655266793, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2022 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31ad59ebd39bcd363a663ce8", "attempt_id": "001c2e19a606", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:22.817994Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 38, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.3598329862579703, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.26816701237112, "ttft_ms": 37.26816701237112, "decode_ms": 16.43920806236565}, "total_wall_ms": 64.15787502191961, "ttft_ms": 37.26816701237112, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2122121216, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13634360573, "mlx_cache_bytes": 16893364014, "process_rss_bytes": 2122121216}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13634360573, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2023 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "32fa8312b402881e2c7c0493", "attempt_id": "f12615613936", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:22.913287Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 38, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.5039579486474395, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.42800003197044, "ttft_ms": 35.42800003197044, "decode_ms": 16.40691701322794}, "total_wall_ms": 62.35345802269876, "ttft_ms": 35.42800003197044, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2122121216, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13634360573, "mlx_cache_bytes": 16893364014, "process_rss_bytes": 2122121216}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13634360573, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2024 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a994c1dda30a4468996bdd82", "attempt_id": "5322d9210fea", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:23.006864Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 54, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.828833064995706, "receiver_prefill_ms": 0.0, "query_prefill_ms": 42.002541013062, "ttft_ms": 42.002541013062, "decode_ms": 114.33387489523739}, "total_wall_ms": 167.67566604539752, "ttft_ms": 42.002541013062, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2112798720, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13689922313, "mlx_cache_bytes": 17048854222, "process_rss_bytes": 2112798720}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13689922313, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8189710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "0e29458d3d62613e564b50cee6e041e654f6c59aba26eb6bd0703d95cfc686cd"} | ||||
| 2025 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2e6405114857031670d67a99", "attempt_id": "b1dacd0ea5f6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:23.205588Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 47, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.616374986246228, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.90408405661583, "ttft_ms": 39.90408405661583, "decode_ms": 113.86654200032353}, "total_wall_ms": 164.41691701766104, "ttft_ms": 39.90408405661583, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2047770624, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13665395465, "mlx_cache_bytes": 17183071950, "process_rss_bytes": 2047770624}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13665395465, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8158050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "3739fd622fb90f28a6ba23b6391fc85a3d64478214b8012e7895bd4f3bf0caff"} | ||||
| 2026 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b424e3541ba46d85fed9ec21", "attempt_id": "9c3a38b7eea1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:23.402984Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 56, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.7151250978931785, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.54700003284961, "ttft_ms": 38.54700003284961, "decode_ms": 113.69166697841138}, "total_wall_ms": 162.9667499801144, "ttft_ms": 38.54700003284961, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 56}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2047770624, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13756683769, "mlx_cache_bytes": 17184336206, "process_rss_bytes": 2047770624}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13756683769, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 2027 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "394e69d944106c27f2b5c0b2", "attempt_id": "e1deb1c798a4", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:23.596461Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 48, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.7605840004980564, "receiver_prefill_ms": 0.0, "query_prefill_ms": 112.40012501366436, "ttft_ms": 112.40012501366436, "decode_ms": 120.74550008401275}, "total_wall_ms": 243.88249998446554, "ttft_ms": 112.40012501366436, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 48}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1648902144, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13668557193, "mlx_cache_bytes": 17322518862, "process_rss_bytes": 1648902144}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13668557193, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3011116", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "8cca1df51cdb81c39bbe740aba85a1ce3b2970d542dd84f00fea2b6ba43d1c92"} | ||||
| 2028 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bee7b2ff831b040cbc4ca4c9", "attempt_id": "b35a175743f6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:23.870911Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 45, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.5356250116601586, "receiver_prefill_ms": 0.0, "query_prefill_ms": 286.1899579875171, "ttft_ms": 286.1899579875171, "decode_ms": 69.93670796509832}, "total_wall_ms": 367.5093330675736, "ttft_ms": 286.1899579875171, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 45}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1647640576, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13658855794, "mlx_cache_bytes": 17450969422, "process_rss_bytes": 1647640576}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13658855794, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2150", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "81b187544ef8734d6c3668ffd47b2e7761a7c374074eb4091e95a5385a318c9d"} | ||||
| 2029 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "13aabf455538f18cc1182d80", "attempt_id": "91640bc339c0", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:24.272345Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 47, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.553374972194433, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.39641599915922, "ttft_ms": 38.39641599915922, "decode_ms": 173.82962501142174}, "total_wall_ms": 223.9672919968143, "ttft_ms": 38.39641599915922, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 47}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1647394816, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13665395081, "mlx_cache_bytes": 17450969422, "process_rss_bytes": 1647394816}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13665395081, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2030 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "69f6ae948e29a3c0d60285b3", "attempt_id": "6c64e518075c", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:24.530906Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13232034824}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 11064, "source_tokens_receiver": 11064, "query_tokens": 49, "message_tokens": 11103, "message_utf8_bytes": 58447, "cache_tensor_bytes": 217441152, "serialized_payload_bytes": 217476228, "side_information_bytes": 35076, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.503084022551775, "doc_prefill_ms": 1917.6650409353897, "compress_ms": 16.28620899282396, "serialize_ms": 39.87433295696974, "load_ms": 2.5317500112578273, "receiver_prefill_ms": 0.0, "query_prefill_ms": 432.9430829966441, "ttft_ms": 432.9430829966441, "decode_ms": 17.354957992210984}, "total_wall_ms": 461.6780000505969, "ttft_ms": 432.9430829966441, "input_usage": {"receiver_prefix_tokens": 11103, "dense_cache_bytes": 409300992, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1116274688, "backend_memory": {"mlx_active_bytes": 13452629000, "mlx_peak_bytes": 13677699465, "mlx_cache_bytes": 17592068430, "process_rss_bytes": 1116274688}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13677699465, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "281017a35aee9237a37360f8e4a9f9d968411a6407c6e1690c877333ab1d62e3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2031 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bb670adb66f46650a39b7e2f", "attempt_id": "841c12b86064", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:25.665482Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10929, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1688.8175420463085, "ttft_ms": 18.052542000077665, "decode_ms": 113.62120788544416}, "total_wall_ms": 1835.1957920240238, "ttft_ms": 18.052542000077665, "input_usage": {"receiver_prompt_tokens": 10929}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1094074368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14300615744, "mlx_cache_bytes": 6201876824, "process_rss_bytes": 1094074368}, "peak_prefill_memory": null, "peak_decode_memory": 14300615744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2032 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6823ae205ff329d4f4fcbb82", "attempt_id": "ab395b369668", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:27.532277Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10924, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1650.7494169054553, "ttft_ms": 16.61200006492436, "decode_ms": 33.3178750006482}, "total_wall_ms": 1715.3022920247167, "ttft_ms": 16.61200006492436, "input_usage": {"receiver_prompt_tokens": 10924}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1094074368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14310904896, "mlx_cache_bytes": 6353068376, "process_rss_bytes": 1094074368}, "peak_prefill_memory": null, "peak_decode_memory": 14310904896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2033 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aca4e7f7fbfc4fc530bc29b5", "attempt_id": "c5ac7ccd49bd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:29.276230Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10924, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1789.5952500402927, "ttft_ms": 16.76708401646465, "decode_ms": 33.76541589386761}, "total_wall_ms": 1854.5688330195844, "ttft_ms": 16.76708401646465, "input_usage": {"receiver_prompt_tokens": 10924}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1094074368, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14313067608, "mlx_cache_bytes": 6353068376, "process_rss_bytes": 1094074368}, "peak_prefill_memory": null, "peak_decode_memory": 14313067608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2034 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c66b03e6fdc4aba93474a0cb", "attempt_id": "3db51d461453", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:31.159243Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10940, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1824.2670419858769, "ttft_ms": 17.069665947929025, "decode_ms": 83.77000002656132}, "total_wall_ms": 1939.6261669462547, "ttft_ms": 17.069665947929025, "input_usage": {"receiver_prompt_tokens": 10940}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1094123520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14305432640, "mlx_cache_bytes": 6632825176, "process_rss_bytes": 1094123520}, "peak_prefill_memory": null, "peak_decode_memory": 14305432640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,189,710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "ff417a83395173e23eed2697e98ab63bb3a64e131460a4db313ac16229470c5f"} | ||||
| 2035 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2aa8418d8de64432b46a97ec", "attempt_id": "7e9d15e723c2", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:33.127320Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10933, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1885.538166970946, "ttft_ms": 17.017832957208157, "decode_ms": 83.64187506958842}, "total_wall_ms": 2000.8104579756036, "ttft_ms": 17.017832957208157, "input_usage": {"receiver_prompt_tokens": 10933}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1094123520, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14302680128, "mlx_cache_bytes": 6892413272, "process_rss_bytes": 1094123520}, "peak_prefill_memory": null, "peak_decode_memory": 14302680128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,189,710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "ff417a83395173e23eed2697e98ab63bb3a64e131460a4db313ac16229470c5f"} | ||||
| 2036 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dcc5fb0831da7669061451f4", "attempt_id": "ffa2aa068cdf", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:35.156442Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10941, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1871.752041974105, "ttft_ms": 16.968291020020843, "decode_ms": 100.80708400346339}, "total_wall_ms": 2004.1311669629067, "ttft_ms": 16.968291020020843, "input_usage": {"receiver_prompt_tokens": 10941}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1094172672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14305547328, "mlx_cache_bytes": 6984163672, "process_rss_bytes": 1094172672}, "peak_prefill_memory": null, "peak_decode_memory": 14305547328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 2037 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f1fe3962abfc69ea16327d47", "attempt_id": "c3141bd93a14", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:37.189753Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10935, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1883.9387079933658, "ttft_ms": 16.920958063565195, "decode_ms": 471.552083035931}, "total_wall_ms": 2387.02591706533, "ttft_ms": 16.920958063565195, "input_usage": {"receiver_prompt_tokens": 10935}, "output_usage": {"output_tokens": 29}, "provider_cached_usage": null, "process_memory": 1094189056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14303515712, "mlx_cache_bytes": 7244620120, "process_rss_bytes": 1094189056}, "peak_prefill_memory": null, "peak_decode_memory": 14303515712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346,160 + 302,390 + 2,046,021 + 9,487,300 = 10,179,851", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "28d84ab7015c1cf1dafccd1becebfbdfd661654e36fafef2a527383ea2bd5b90"} | ||||
| 2038 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fc8597803c43ac88450aeb93", "attempt_id": "385c37ffb485", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:39.605384Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10931, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1879.4145419960842, "ttft_ms": 16.989249968901277, "decode_ms": 50.29445793479681}, "total_wall_ms": 1962.3016249388456, "ttft_ms": 16.989249968901277, "input_usage": {"receiver_prompt_tokens": 10931}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1094221824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14313690176, "mlx_cache_bytes": 7352033624, "process_rss_bytes": 1094221824}, "peak_prefill_memory": null, "peak_decode_memory": 14313690176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2.15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "b720401fc5f0a1962c830b14132f12c2b376f2cca823b2efbaf226167720251e"} | ||||
| 2039 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc14f48be0e75b791f01bdad", "attempt_id": "1d8ce93bb707", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:41.596911Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10933, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1917.3660830128938, "ttft_ms": 16.94845804013312, "decode_ms": 17.218582914210856}, "total_wall_ms": 1967.0884580118582, "ttft_ms": 16.94845804013312, "input_usage": {"receiver_prompt_tokens": 10933}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094221824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14302680128, "mlx_cache_bytes": 7352033624, "process_rss_bytes": 1094221824}, "peak_prefill_memory": null, "peak_decode_memory": 14302680128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2040 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cfdf9d820713f7347d22170", "attempt_id": "e7879c52022e", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:43.594899Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 10936, "message_tokens": 10826, "message_utf8_bytes": 58447, "cache_tensor_bytes": null, "serialized_payload_bytes": 58447, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.009416951797902584, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1910.2986250072718, "ttft_ms": 16.951957950368524, "decode_ms": 16.915749991312623}, "total_wall_ms": 1958.6280409712344, "ttft_ms": 16.951957950368524, "input_usage": {"receiver_prompt_tokens": 10936}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094221824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14303761472, "mlx_cache_bytes": 7488741720, "process_rss_bytes": 1094221824}, "peak_prefill_memory": null, "peak_decode_memory": 14303761472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2041 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "09b2332bf10e33abdf27fbaa", "attempt_id": "05e9602da53e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:55.703033Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 619, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.14512501843274, "ttft_ms": 14.052332961000502, "decode_ms": 96.16708406247199}, "total_wall_ms": 189.95245802216232, "ttft_ms": 14.052332961000502, "input_usage": {"receiver_prompt_tokens": 619, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1094844416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040901632, "mlx_cache_bytes": 10837672704, "process_rss_bytes": 1094844416}, "peak_prefill_memory": null, "peak_decode_memory": 13040901632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2042 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2b6706fa6373890b815b930b", "attempt_id": "88314004a724", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:55.922485Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.3412919845432, "ttft_ms": 13.852208037860692, "decode_ms": 27.443416067399085}, "total_wall_ms": 120.80920906737447, "ttft_ms": 13.852208037860692, "input_usage": {"receiver_prompt_tokens": 614, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1094844416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198272, "mlx_cache_bytes": 11180589824, "process_rss_bytes": 1094844416}, "peak_prefill_memory": null, "peak_decode_memory": 13038198272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2043 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a52de4ca1b2aa81a98709ece", "attempt_id": "8128760ad615", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:56.071741Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 614, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.92158399429172, "ttft_ms": 13.90141702722758, "decode_ms": 13.571250019595027}, "total_wall_ms": 108.52654103655368, "ttft_ms": 13.90141702722758, "input_usage": {"receiver_prompt_tokens": 614, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094844416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038198272, "mlx_cache_bytes": 11180589824, "process_rss_bytes": 1094844416}, "peak_prefill_memory": null, "peak_decode_memory": 13038198272, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2044 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "89285843028d136cd45cd8c3", "attempt_id": "2054c63a83af", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:56.209259Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 630, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.55575001426041, "ttft_ms": 13.887958019040525, "decode_ms": 69.34591697063297}, "total_wall_ms": 168.95608301274478, "ttft_ms": 13.887958019040525, "input_usage": {"receiver_prompt_tokens": 630, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1094860800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13047176748, "mlx_cache_bytes": 11555753172, "process_rss_bytes": 1094860800}, "peak_prefill_memory": null, "peak_decode_memory": 13047176748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,487,300", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "b51d940e21147dfe8c0570b88d0320a93fdd428bea14d465357d1a660a8a062c"} | ||||
| 2045 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "91c142251babef5c182103c3", "attempt_id": "740d0f23335a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:56.406959Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 623, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 83.96279206499457, "ttft_ms": 13.997083995491266, "decode_ms": 69.05325001571327}, "total_wall_ms": 168.1541659636423, "ttft_ms": 13.997083995491266, "input_usage": {"receiver_prompt_tokens": 623, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1094860800, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043424812, "mlx_cache_bytes": 11904044244, "process_rss_bytes": 1094860800}, "peak_prefill_memory": null, "peak_decode_memory": 13043424812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,487,300", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "b51d940e21147dfe8c0570b88d0320a93fdd428bea14d465357d1a660a8a062c"} | ||||
| 2046 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ecce6dd612aca45ef98a1c0a", "attempt_id": "946d8dcf0a31", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:56.603730Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.27254201564938, "ttft_ms": 13.995875022374094, "decode_ms": 82.43337506428361}, "total_wall_ms": 183.9080840582028, "ttft_ms": 13.995875022374094, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1094877184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 12194879148, "process_rss_bytes": 1094877184}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 2047 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "73c838ee0da802ba91a771ce", "attempt_id": "41c428556511", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:56.816350Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.2530410522595, "ttft_ms": 13.965249992907047, "decode_ms": 69.33979201130569}, "total_wall_ms": 170.69395794533193, "ttft_ms": 13.965249992907047, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1094877184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981868, "mlx_cache_bytes": 12378904236, "process_rss_bytes": 1094877184}, "peak_prefill_memory": null, "peak_decode_memory": 13043981868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,046,021", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "0e01ab30a1b907d1b0bdfec64dcad39fdeea3475f434e1736a888d8a0f41d70d"} | ||||
| 2048 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "53ac75289ce51b4ddf9df297", "attempt_id": "7581b952b819", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:57.015829Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.28299995325506, "ttft_ms": 13.949915999546647, "decode_ms": 68.82554199546576}, "total_wall_ms": 170.21808307617903, "ttft_ms": 13.949915999546647, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1094877184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13073571372, "mlx_cache_bytes": 12538975916, "process_rss_bytes": 1094877184}, "peak_prefill_memory": null, "peak_decode_memory": 13073571372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "38,900,000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "a6c77259a919de85de4006e2673b06e2e0bbbec2eed9a825ebc93a664307cc3f"} | ||||
| 2049 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "44083fd7db184c1d5bf44aa5", "attempt_id": "8330952a7fe2", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:57.214949Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 623, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.00408292841166, "ttft_ms": 13.911707908846438, "decode_ms": 14.068165910430253}, "total_wall_ms": 115.08150002919137, "ttft_ms": 13.911707908846438, "input_usage": {"receiver_prompt_tokens": 623, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094877184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043424812, "mlx_cache_bytes": 12538975916, "process_rss_bytes": 1094877184}, "peak_prefill_memory": null, "peak_decode_memory": 13043424812, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2050 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "de80ea5794334b606af6ee6a", "attempt_id": "50b8a59eebcd", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:01:57.359161Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 1912, "cache_tensor_bytes": null, "serialized_payload_bytes": 1912, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10119.894542032853, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.37416698224843, "ttft_ms": 14.01691697537899, "decode_ms": 13.828374911099672}, "total_wall_ms": 117.4455831060186, "ttft_ms": 14.01691697537899, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 10960, "sender_output_tokens": 512, "sender_prefill_ms": 1912.8619589610025, "sender_ttft_ms": 17.134458059445024, "sender_decode_ms": 8181.720541091636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094877184, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13076831788, "mlx_cache_bytes": 12761896620, "process_rss_bytes": 1094877184}, "peak_prefill_memory": null, "peak_decode_memory": 13076831788, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "88fc00d9f9288a13e6cf68dabc12373b8db1781774b05e84f22640a79d202380", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2051 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "67a8d854f03b94644de20143", "attempt_id": "84b35604db5c", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:07.904890Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 508, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 59.35008404776454, "ttft_ms": 13.924833037890494, "decode_ms": 13.656207942403853}, "total_wall_ms": 87.96399994753301, "ttft_ms": 13.924833037890494, "input_usage": {"receiver_prompt_tokens": 508, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094942720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12948757592, "mlx_cache_bytes": 13422991020, "process_rss_bytes": 1094942720}, "peak_prefill_memory": null, "peak_decode_memory": 12948757592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2052 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1ee01ee424aa84919596b2d1", "attempt_id": "217892e0f132", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.022489Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 503, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 60.049416963011026, "ttft_ms": 13.879082980565727, "decode_ms": 14.858125010505319}, "total_wall_ms": 89.76341597735882, "ttft_ms": 13.879082980565727, "input_usage": {"receiver_prompt_tokens": 503, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12945857624, "mlx_cache_bytes": 13704189612, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12945857624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2053 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5bc64d6825bd13c51e4189df", "attempt_id": "eb3c7daad134", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.142011Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 503, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 62.637959024868906, "ttft_ms": 13.928249944001436, "decode_ms": 13.87808402068913}, "total_wall_ms": 91.40204102732241, "ttft_ms": 13.928249944001436, "input_usage": {"receiver_prompt_tokens": 503, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12945857624, "mlx_cache_bytes": 13704189612, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12945857624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2054 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a92547739cbc32183a0d3d5e", "attempt_id": "3f04cb99ba3d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.261711Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 519, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.58829095494002, "ttft_ms": 13.904249994084239, "decode_ms": 13.97149998228997}, "total_wall_ms": 107.50820802059025, "ttft_ms": 13.904249994084239, "input_usage": {"receiver_prompt_tokens": 519, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983279104, "mlx_cache_bytes": 13962581676, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12983279104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2055 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25e96eb4e9c879ce66420aa0", "attempt_id": "673aac5d0d41", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.397808Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 512, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 67.71583296358585, "ttft_ms": 13.853834010660648, "decode_ms": 14.567708014510572}, "total_wall_ms": 97.03158296179026, "ttft_ms": 13.853834010660648, "input_usage": {"receiver_prompt_tokens": 512, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950756440, "mlx_cache_bytes": 14102042284, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12950756440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2056 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "61f0c25da8ac47a29be9b433", "attempt_id": "78a9df7a1bdd", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.523400Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 520, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 83.24625005479902, "ttft_ms": 14.105500071309507, "decode_ms": 14.144457993097603}, "total_wall_ms": 112.45595896616578, "ttft_ms": 14.105500071309507, "input_usage": {"receiver_prompt_tokens": 520, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983524864, "mlx_cache_bytes": 14204081836, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12983524864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2057 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7275985a796318ff5e961de1", "attempt_id": "6db78287e2bc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.664266Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 514, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.06712492089719, "ttft_ms": 14.29374993313104, "decode_ms": 41.91749996971339}, "total_wall_ms": 142.28949998505414, "ttft_ms": 14.29374993313104, "input_usage": {"receiver_prompt_tokens": 514, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12980575744, "mlx_cache_bytes": 14440912556, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12980575744, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346,160", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "7698b4445f241e65973d5ae6217199e601bc748a46f9bb2374e0a1479d716439"} | ||||
| 2058 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff519b6c0f7a046520a57033", "attempt_id": "ebe778b7a481", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.834939Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 510, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.15399995725602, "ttft_ms": 14.243291923776269, "decode_ms": 14.066708972677588}, "total_wall_ms": 99.68541690614074, "ttft_ms": 14.243291923776269, "input_usage": {"receiver_prompt_tokens": 510, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12949511256, "mlx_cache_bytes": 14540986028, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12949511256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2059 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "495d0ac6d4038aa832e79f6d", "attempt_id": "7eb3794c3a51", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:08.963261Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 512, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.4641660451889, "ttft_ms": 13.9795410213992, "decode_ms": 14.663791982457042}, "total_wall_ms": 101.00091702770442, "ttft_ms": 13.9795410213992, "input_usage": {"receiver_prompt_tokens": 512, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950756440, "mlx_cache_bytes": 14540986028, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12950756440, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2060 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "15a1dba3a81ceb134be29b52", "attempt_id": "dfe69f35655a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:09.092660Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 515, "message_tokens": 390, "message_utf8_bytes": 1188, "cache_tensor_bytes": null, "serialized_payload_bytes": 1188, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10399.436749983579, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.13166606705636, "ttft_ms": 14.255499932914972, "decode_ms": 14.010708080604672}, "total_wall_ms": 117.34395800158381, "ttft_ms": 14.255499932914972, "input_usage": {"receiver_prompt_tokens": 515, "sender_input_tokens": 10990, "sender_output_tokens": 512, "sender_prefill_ms": 2159.0255829505622, "sender_ttft_ms": 17.22333300858736, "sender_decode_ms": 8215.436541941017}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094959104, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12980755968, "mlx_cache_bytes": 14642042540, "process_rss_bytes": 1094959104}, "peak_prefill_memory": null, "peak_decode_memory": 12980755968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 12, "unresolved_quotes": 11, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3fd69ae0cce61a50389db2984211ffa6dd2266e54c1029c9f82db215cf94563b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2061 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "64ed4ce6558787beffdcc3b9", "attempt_id": "39a0a0934580", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:09.246731Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 605, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 91.37258399277925, "ttft_ms": 14.331958023831248, "decode_ms": 14.2137500224635}, "total_wall_ms": 120.90816698037088, "ttft_ms": 14.331958023831248, "input_usage": {"receiver_prompt_tokens": 605}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1094991872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032889856, "mlx_cache_bytes": 15002506924, "process_rss_bytes": 1094991872}, "peak_prefill_memory": null, "peak_decode_memory": 13032889856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2062 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d00e1375bd93a0face89a800", "attempt_id": "b7e2d0b4fb82", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:09.395793Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 600, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 92.16558304615319, "ttft_ms": 14.396792044863105, "decode_ms": 28.365416917949915}, "total_wall_ms": 135.96254191361368, "ttft_ms": 14.396792044863105, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1094991872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13030186496, "mlx_cache_bytes": 15337772716, "process_rss_bytes": 1094991872}, "peak_prefill_memory": null, "peak_decode_memory": 13030186496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2063 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7ef394dd52289e3b61093e77", "attempt_id": "2ca3ef034030", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:09.560453Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 600, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 91.26883302815259, "ttft_ms": 14.40308301243931, "decode_ms": 28.372665983624756}, "total_wall_ms": 135.1165830856189, "ttft_ms": 14.40308301243931, "input_usage": {"receiver_prompt_tokens": 600}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1094991872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13030186496, "mlx_cache_bytes": 15337772716, "process_rss_bytes": 1094991872}, "peak_prefill_memory": null, "peak_decode_memory": 13030186496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2064 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28abb1acd15586e93242aaf6", "attempt_id": "2e9ecd882913", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:09.723872Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 616, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 93.92933396156877, "ttft_ms": 14.176041935570538, "decode_ms": 69.20850009191781}, "total_wall_ms": 178.39187500067055, "ttft_ms": 14.176041935570538, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1094991872, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13070605824, "mlx_cache_bytes": 15496533676, "process_rss_bytes": 1094991872}, "peak_prefill_memory": null, "peak_decode_memory": 13070605824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,189,710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "ff417a83395173e23eed2697e98ab63bb3a64e131460a4db313ac16229470c5f"} | ||||
| 2065 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0afa093cef9d71fb825665f1", "attempt_id": "1b278e04a806", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:09.930267Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 609, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.01541600748897, "ttft_ms": 14.261959004215896, "decode_ms": 69.63454105425626}, "total_wall_ms": 172.08254092838615, "ttft_ms": 14.261959004215896, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1095008256, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708480, "mlx_cache_bytes": 15836468908, "process_rss_bytes": 1095008256}, "peak_prefill_memory": null, "peak_decode_memory": 13034708480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,158,050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "8c80358f14d921b81d20c940c224ae164772302b2105ab0a1ad0713b9470b015"} | ||||
| 2066 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8c209de0daf1f0e4c49e558a", "attempt_id": "5b9809c4c839", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:10.131734Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 617, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.49770896974951, "ttft_ms": 14.143417007289827, "decode_ms": 69.15883393958211}, "total_wall_ms": 171.88929207623005, "ttft_ms": 14.143417007289827, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1095008256, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13040377344, "mlx_cache_bytes": 15957579436, "process_rss_bytes": 1095008256}, "peak_prefill_memory": null, "peak_decode_memory": 13040377344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Drapratis-19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "d16129495492fc816bf31da116e8c9b11f7f3c42b8035f38fd128c983cd567eb"} | ||||
| 2067 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ce903e116c3a412de8e68875", "attempt_id": "fb1555d8b491", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:10.333067Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 611, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.02458296809345, "ttft_ms": 14.146708999760449, "decode_ms": 494.62741694878787}, "total_wall_ms": 595.9543749922886, "ttft_ms": 14.146708999760449, "input_usage": {"receiver_prompt_tokens": 611}, "output_usage": {"output_tokens": 36}, "provider_cached_usage": null, "process_memory": 1095073792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067247104, "mlx_cache_bytes": 16174995116, "process_rss_bytes": 1095073792}, "peak_prefill_memory": null, "peak_decode_memory": 13067247104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346,160 + 302,390 + 9,487,300 + 8,158,050 + 8,189,710 = 11,286,390", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "88a0fdfb271170f77a3bfe0c937fa598c34036d422b632b354bf6dc805e5bb4e"} | ||||
| 2068 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27df60123f1cf716d6937322", "attempt_id": "e846f48bc90b", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:10.957784Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 607, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.43300005979836, "ttft_ms": 13.82779108826071, "decode_ms": 13.985582976602018}, "total_wall_ms": 103.34345803130418, "ttft_ms": 13.82779108826071, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1095073792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034348032, "mlx_cache_bytes": 16294139564, "process_rss_bytes": 1095073792}, "peak_prefill_memory": null, "peak_decode_memory": 13034348032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2069 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "03aff475f46e279980db096f", "attempt_id": "a405b56dec21", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:11.090478Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 609, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.77954104635864, "ttft_ms": 14.096333994530141, "decode_ms": 13.72533303219825}, "total_wall_ms": 104.67237501870841, "ttft_ms": 14.096333994530141, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1095073792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708480, "mlx_cache_bytes": 16294139564, "process_rss_bytes": 1095073792}, "peak_prefill_memory": null, "peak_decode_memory": 13034708480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2070 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c312074a07f5868414f35530", "attempt_id": "8c5874c793e4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:11.223738Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 501, "n_sentences": 17}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 612, "message_tokens": 501, "message_utf8_bytes": 1486, "cache_tensor_bytes": null, "serialized_payload_bytes": 1486, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8.258332964032888, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.07570896390826, "ttft_ms": 14.235166949220002, "decode_ms": 14.102458022534847}, "total_wall_ms": 110.4914580937475, "ttft_ms": 14.235166949220002, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1095073792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037837824, "mlx_cache_bytes": 16414267052, "process_rss_bytes": 1095073792}, "peak_prefill_memory": null, "peak_decode_memory": 13037837824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2251cefa765696ffe3e8f6e4e5a5b24088ac74488ff6622562f90b32eb42b1d6", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2071 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fef20bbc0455a3197383bc68", "attempt_id": "6c67a3c30ab5", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:13.667258Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 43, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.1005839807912707, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.75479105953127, "ttft_ms": 29.75479105953127, "decode_ms": 415.21641705185175}, "total_wall_ms": 455.305999959819, "ttft_ms": 29.75479105953127, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1482817536, "backend_memory": {"mlx_active_bytes": 14491374600, "mlx_peak_bytes": 14578848996, "mlx_cache_bytes": 15981582341, "process_rss_bytes": 1482817536}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14578848996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "AW-34Y-5883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "996159e95445ba10a0dc8d4d34936f8c6daa6ab431609552beed8912d42e39d4"} | ||||
| 2072 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "195d43327d76fb58f0552842", "attempt_id": "e62e5885f818", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:14.156044Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 38, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.068583038635552, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.903958038426936, "ttft_ms": 28.903958038426936, "decode_ms": 15.928750042803586}, "total_wall_ms": 55.4462909931317, "ttft_ms": 28.903958038426936, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482440704, "backend_memory": {"mlx_active_bytes": 14490457096, "mlx_peak_bytes": 14576456932, "mlx_cache_bytes": 16009795589, "process_rss_bytes": 1482440704}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14576456932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 2073 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a030382437d55a616e1c13b", "attempt_id": "773ed9a1fc5e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:14.244421Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 38, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.598457969725132, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.084624976851046, "ttft_ms": 27.084624976851046, "decode_ms": 15.534750069491565}, "total_wall_ms": 53.03516692947596, "ttft_ms": 27.084624976851046, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1482440704, "backend_memory": {"mlx_active_bytes": 14490457096, "mlx_peak_bytes": 14576456932, "mlx_cache_bytes": 16009795589, "process_rss_bytes": 1482440704}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14576456932, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2074 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1757f71e78a2e1cc2412a4ff", "attempt_id": "d5d71fec53c2", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:14.327954Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 54, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.6303749764338136, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.98583300318569, "ttft_ms": 27.98583300318569, "decode_ms": 1052.5337910512462}, "total_wall_ms": 1090.5340829631314, "ttft_ms": 27.98583300318569, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1175519232, "backend_memory": {"mlx_active_bytes": 14492161032, "mlx_peak_bytes": 14586582280, "mlx_cache_bytes": 16391267609, "process_rss_bytes": 1175519232}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14586582280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,787,510", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "2679a106ca3e035ebf02f12876ed74ef56ee1c11d6328e126e05f3cc753edc32"} | ||||
| 2075 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0bd342bba18dca1ea776d31d", "attempt_id": "16c977475372", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:15.446852Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 47, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 4.102915991097689, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.51737493276596, "ttft_ms": 29.51737493276596, "decode_ms": 33.55712501797825}, "total_wall_ms": 75.35120798274875, "ttft_ms": 29.51737493276596, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 47}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1176584192, "backend_memory": {"mlx_active_bytes": 14491374600, "mlx_peak_bytes": 14581224712, "mlx_cache_bytes": 16425739545, "process_rss_bytes": 1176584192}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14581224712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 2076 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3961521e79cbe10d36f66023", "attempt_id": "ca2b52026f71", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:15.558113Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 55, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.453666995279491, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.056583927944303, "ttft_ms": 30.056583927944303, "decode_ms": 99.80470791924745}, "total_wall_ms": 143.2010419666767, "ttft_ms": 30.056583927944303, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1177010176, "backend_memory": {"mlx_active_bytes": 14492161032, "mlx_peak_bytes": 14587958540, "mlx_cache_bytes": 16450056866, "process_rss_bytes": 1177010176}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14587958540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 2077 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5adfa7cf74539eb1bf39f8fc", "attempt_id": "8c0a882ce13f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:15.735915Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 49, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.565499977208674, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.616417061537504, "ttft_ms": 30.616417061537504, "decode_ms": 90.62999999150634}, "total_wall_ms": 135.14937495347112, "ttft_ms": 30.616417061537504, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 49}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1183940608, "backend_memory": {"mlx_active_bytes": 14491309064, "mlx_peak_bytes": 14583076104, "mlx_cache_bytes": 16473617058, "process_rss_bytes": 1183940608}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14583076104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,821,450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "0b501c83b073e05a3ff616808c001fe11265aa10c7969697da16df9820450cea"} | ||||
| 2078 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c02b6256d59d463cf5a0f731", "attempt_id": "5c7ed57a5598", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:15.912474Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 45, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.451166044920683, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.00583399645984, "ttft_ms": 31.00583399645984, "decode_ms": 34.06137495767325}, "total_wall_ms": 80.41962492279708, "ttft_ms": 31.00583399645984, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1185595392, "backend_memory": {"mlx_active_bytes": 14491243528, "mlx_peak_bytes": 14579078416, "mlx_cache_bytes": 16494080674, "process_rss_bytes": 1185595392}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14579078416, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 2079 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "824747a977902547308be885", "attempt_id": "805e60f0537b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:16.040387Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 47, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.572915982455015, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.638416996225715, "ttft_ms": 30.638416996225715, "decode_ms": 115.96729105804116}, "total_wall_ms": 161.01662500295788, "ttft_ms": 30.638416996225715, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1185923072, "backend_memory": {"mlx_active_bytes": 14491374600, "mlx_peak_bytes": 14581224712, "mlx_cache_bytes": 16493949602, "process_rss_bytes": 1185923072}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14581224712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "AW-34Y-5883", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "996159e95445ba10a0dc8d4d34936f8c6daa6ab431609552beed8912d42e39d4"} | ||||
| 2080 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "106394c58110f07e5ed9819c", "attempt_id": "337213cce45b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:16.248254Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14172869640}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10886, "keep": 2722, "compress_ms": 14.272583997808397}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 50, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193943, "side_information_bytes": 13207, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2304.980000015348, "doc_prefill_ms": 2135.909999953583, "compress_ms": 14.319542096927762, "serialize_ms": 139.08075005747378, "load_ms": 2.868209034204483, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.748874970711768, "ttft_ms": 27.748874970711768, "decode_ms": 77.7079580584541}, "total_wall_ms": 118.46420797519386, "ttft_ms": 27.748874970711768, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 50}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1185955840, "backend_memory": {"mlx_active_bytes": 14492161032, "mlx_peak_bytes": 14583518472, "mlx_cache_bytes": 16515822242, "process_rss_bytes": 1185955840}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14583518472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Baie-Comeau", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e9d2968ed0e063f132ca00343936768942512699670dff53ed6cb74c06630f80", "output_hash": "2ca654792bfbba33910b96d8a5d44d284aae85e5d60461e6e534f82664aa1fe3"} | ||||
| 2081 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "75cfc232ca01a160eb15376c", "attempt_id": "c1c55bd1dd6b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:16.397288Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 43, "compress_ms": 731.587624992244}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 43, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193981, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 793.865458923392, "doc_prefill_ms": 2135.909999953583, "compress_ms": 738.8986250152811, "serialize_ms": 54.77400007657707, "load_ms": 2.056292025372386, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.11074993386865, "ttft_ms": 36.11074993386865, "decode_ms": 112.12774994783103}, "total_wall_ms": 952.2923750337213, "ttft_ms": 36.11074993386865, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 799604736, "backend_memory": {"mlx_active_bytes": 14491243528, "mlx_peak_bytes": 14578586852, "mlx_cache_bytes": 19114504970, "process_rss_bytes": 799604736}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14578586852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c563c0ff2c940f94fe3d5196258fac5918099c4732c698e3e978d43782ede9e3", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2082 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d877e45bc9610d887401441c", "attempt_id": "8035e26f61e0", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:17.380517Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 38, "compress_ms": 126.32287491578609}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 38, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193983, "side_information_bytes": 13247, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 193.24691698420793, "doc_prefill_ms": 2135.909999953583, "compress_ms": 134.4355830224231, "serialize_ms": 58.6000420153141, "load_ms": 1.9642909755930305, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.833000084385276, "ttft_ms": 30.833000084385276, "decode_ms": 31.955957994796336}, "total_wall_ms": 265.95404103863984, "ttft_ms": 30.833000084385276, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1070661632, "backend_memory": {"mlx_active_bytes": 14490326024, "mlx_peak_bytes": 14576293092, "mlx_cache_bytes": 19168637706, "process_rss_bytes": 1070661632}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14576293092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b77a58c8f8e1ed571fd21c29276d6ef90e382bee179b2da15d20bd927f94b042", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2083 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2226c9c4d54b5c59dcbe44de", "attempt_id": "dbd7043a8d1c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:17.696062Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 38, "compress_ms": 122.8358750231564}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 38, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193982, "side_information_bytes": 13246, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 178.61612502019852, "doc_prefill_ms": 2135.909999953583, "compress_ms": 131.00808300077915, "serialize_ms": 47.393874963745475, "load_ms": 2.244125003926456, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.121957978233695, "ttft_ms": 32.121957978233695, "decode_ms": 31.581916962750256}, "total_wall_ms": 252.03237496316433, "ttft_ms": 32.121957978233695, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1073414144, "backend_memory": {"mlx_active_bytes": 14490326024, "mlx_peak_bytes": 14576293092, "mlx_cache_bytes": 19168637706, "process_rss_bytes": 1073414144}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14576293092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cc7dc4b1aadd7712646ffefbb1d16fb4b3946e3fc32c82ef4f7c4b1360b7cb66", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2084 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "10b497bf7c1a0acf04c828dc", "attempt_id": "240989a346d6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:17.982022Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 54, "compress_ms": 133.37374990805984}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 54, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193983, "side_information_bytes": 13247, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 188.27225000131875, "doc_prefill_ms": 2135.909999953583, "compress_ms": 140.47720795497298, "serialize_ms": 47.60775004979223, "load_ms": 2.4550840025767684, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.95637501589954, "ttft_ms": 29.95637501589954, "decode_ms": 79.11375002004206}, "total_wall_ms": 307.2202500188723, "ttft_ms": 29.95637501589954, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1075331072, "backend_memory": {"mlx_active_bytes": 14492029960, "mlx_peak_bytes": 14586451208, "mlx_cache_bytes": 19242283786, "process_rss_bytes": 1075331072}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14586451208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,189,710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b77a58c8f8e1ed571fd21c29276d6ef90e382bee179b2da15d20bd927f94b042", "output_hash": "ff417a83395173e23eed2697e98ab63bb3a64e131460a4db313ac16229470c5f"} | ||||
| 2085 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "34e3b9d1362e59dc345ff4fd", "attempt_id": "4c954fd6f39b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:18.321292Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 47, "compress_ms": 129.20750002376735}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 47, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193983, "side_information_bytes": 13247, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 186.87483295798302, "doc_prefill_ms": 2135.909999953583, "compress_ms": 136.48341700900346, "serialize_ms": 50.20754202269018, "load_ms": 2.4688750272616744, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.04291593283415, "ttft_ms": 32.04291593283415, "decode_ms": 79.9285409739241}, "total_wall_ms": 308.7736669695005, "ttft_ms": 32.04291593283415, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1076723712, "backend_memory": {"mlx_active_bytes": 14491177992, "mlx_peak_bytes": 14581093640, "mlx_cache_bytes": 19296383754, "process_rss_bytes": 1076723712}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14581093640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,189,050", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b77a58c8f8e1ed571fd21c29276d6ef90e382bee179b2da15d20bd927f94b042", "output_hash": "e5af33f6a9b7b4f5d699112fecea13fa07461a27f66916993c73532e6214637c"} | ||||
| 2086 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "44efaac16ea5f2f4ce4db3eb", "attempt_id": "24d5e640dbfa", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:18.661907Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 55, "compress_ms": 133.38583405129611}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 55, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193983, "side_information_bytes": 13247, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 190.0380839360878, "doc_prefill_ms": 2135.909999953583, "compress_ms": 140.63729101326317, "serialize_ms": 49.201915971934795, "load_ms": 2.2184590343385935, "receiver_prefill_ms": 0.0, "query_prefill_ms": 32.050375011749566, "ttft_ms": 32.050375011749566, "decode_ms": 79.29283299017698}, "total_wall_ms": 311.18512502871454, "ttft_ms": 32.050375011749566, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 55}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1077592064, "backend_memory": {"mlx_active_bytes": 14492029960, "mlx_peak_bytes": 14587827468, "mlx_cache_bytes": 19353383690, "process_rss_bytes": 1077592064}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14587827468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Drapratis-19", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b77a58c8f8e1ed571fd21c29276d6ef90e382bee179b2da15d20bd927f94b042", "output_hash": "d16129495492fc816bf31da116e8c9b11f7f3c42b8035f38fd128c983cd567eb"} | ||||
| 2087 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3695de223ab03662941fe96c", "attempt_id": "a852d6603dd6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:19.004801Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 49, "compress_ms": 129.49783296789974}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 49, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193983, "side_information_bytes": 13247, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 185.5010000290349, "doc_prefill_ms": 2135.909999953583, "compress_ms": 136.79970905650407, "serialize_ms": 48.50074998103082, "load_ms": 2.366208005696535, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.125207987613976, "ttft_ms": 28.125207987613976, "decode_ms": 1583.1813329132274}, "total_wall_ms": 1808.773041004315, "ttft_ms": 28.125207987613976, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 49}, "output_usage": {"output_tokens": 43}, "provider_cached_usage": null, "process_memory": 1078050816, "backend_memory": {"mlx_active_bytes": 14495699976, "mlx_peak_bytes": 14582945032, "mlx_cache_bytes": 20104885002, "process_rss_bytes": 1078050816}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14582945032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346,160 + 302,390 + 2,046,021 + 9,402,200 + 9,821,832 + 8,821,450 = 12,187,033", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b77a58c8f8e1ed571fd21c29276d6ef90e382bee179b2da15d20bd927f94b042", "output_hash": "9fa6e3bb626144321f5438f1c4d22f0870de6e5d6edf3d533a1ff9062e2434b0"} | ||||
| 2088 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae4468c471c0182b87a468af", "attempt_id": "ad047f8f0b37", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:20.845026Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 45, "compress_ms": 151.99995902366936}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 45, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193983, "side_information_bytes": 13247, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 213.45199993811548, "doc_prefill_ms": 2135.909999953583, "compress_ms": 159.20420899055898, "serialize_ms": 54.05004194471985, "load_ms": 2.5909999385476112, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.744290958158672, "ttft_ms": 31.744290958158672, "decode_ms": 47.60220798198134}, "total_wall_ms": 302.9851249884814, "ttft_ms": 31.744290958158672, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1078181888, "backend_memory": {"mlx_active_bytes": 14491243528, "mlx_peak_bytes": 14578947344, "mlx_cache_bytes": 20156936970, "process_rss_bytes": 1078181888}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14578947344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2.15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b77a58c8f8e1ed571fd21c29276d6ef90e382bee179b2da15d20bd927f94b042", "output_hash": "b720401fc5f0a1962c830b14132f12c2b376f2cca823b2efbaf226167720251e"} | ||||
| 2089 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ece681948591c65daa1d3eb2", "attempt_id": "e6beb796a4ca", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:21.179440Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 47, "compress_ms": 129.5288329711184}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 47, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193982, "side_information_bytes": 13246, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 192.46962491888553, "doc_prefill_ms": 2135.909999953583, "compress_ms": 136.92337507382035, "serialize_ms": 55.347624933347106, "load_ms": 2.3310419637709856, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.04141608066857, "ttft_ms": 28.04141608066857, "decode_ms": 15.606458997353911}, "total_wall_ms": 246.0653749294579, "ttft_ms": 28.04141608066857, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1078165504, "backend_memory": {"mlx_active_bytes": 14491243528, "mlx_peak_bytes": 14581093640, "mlx_cache_bytes": 20156936970, "process_rss_bytes": 1078165504}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14581093640, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cc7dc4b1aadd7712646ffefbb1d16fb4b3946e3fc32c82ef4f7c4b1360b7cb66", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2090 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "12701ea2475401619f9715a3", "attempt_id": "8e508c184931", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:21.457369Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10886, "keep": 2722, "window_tokens": 50, "compress_ms": 132.2322500636801}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 50, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 312180736, "serialized_payload_bytes": 312193982, "side_information_bytes": 13246, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 189.48974995873868, "doc_prefill_ms": 2135.909999953583, "compress_ms": 139.59541695658118, "serialize_ms": 49.69904094468802, "load_ms": 2.30470800306648, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.841667015105486, "ttft_ms": 26.841667015105486, "decode_ms": 15.855000005103648}, "total_wall_ms": 241.9804580276832, "ttft_ms": 26.841667015105486, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1078247424, "backend_memory": {"mlx_active_bytes": 14491243528, "mlx_peak_bytes": 14583387400, "mlx_cache_bytes": 20209201930, "process_rss_bytes": 1078247424}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 14583387400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cc7dc4b1aadd7712646ffefbb1d16fb4b3946e3fc32c82ef4f7c4b1360b7cb66", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2091 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cbc461108690239812c8ae28", "attempt_id": "2b35d2415f4d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:21.885781Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 43, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 12.499415897764266, "receiver_prefill_ms": 0.0, "query_prefill_ms": 60.82195893395692, "ttft_ms": 60.82195893395692, "decode_ms": 140.83433302585036}, "total_wall_ms": 222.3964580334723, "ttft_ms": 60.82195893395692, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 43}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2400239616, "backend_memory": {"mlx_active_bytes": 15193003016, "mlx_peak_bytes": 15495498384, "mlx_cache_bytes": 21747543626, "process_rss_bytes": 2400239616}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15495498384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "WP-40Y-7463", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "2c4a118103fe4aa1bdf6e153366a5b3404d9e7829f282ef6a753f6689f3b7694"} | ||||
| 2092 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4f03aa095b8abb659d7eadad", "attempt_id": "75f4e22bd93e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:22.141460Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 38, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 3.841790952719748, "receiver_prefill_ms": 0.0, "query_prefill_ms": 442.90150003507733, "ttft_ms": 442.90150003507733, "decode_ms": 36.625999957323074}, "total_wall_ms": 490.91804202180356, "ttft_ms": 442.90150003507733, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2400256000, "backend_memory": {"mlx_active_bytes": 15192871944, "mlx_peak_bytes": 15477110844, "mlx_cache_bytes": 21868167498, "process_rss_bytes": 2400256000}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15477110844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2093 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b51ed6bea383be11d54a0867", "attempt_id": "0177e825da8b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:22.663405Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 38, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 4.175208974629641, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.83208308555186, "ttft_ms": 35.83208308555186, "decode_ms": 36.55554202850908}, "total_wall_ms": 84.03425000142306, "ttft_ms": 35.83208308555186, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2400256000, "backend_memory": {"mlx_active_bytes": 15192871944, "mlx_peak_bytes": 15477110844, "mlx_cache_bytes": 21868167498, "process_rss_bytes": 2400256000}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15477110844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2094 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "897dadadaff831c7a4fb1769", "attempt_id": "124f7cdd49ed", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:22.776686Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 54, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 4.267957992851734, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.92279108893126, "ttft_ms": 37.92279108893126, "decode_ms": 252.02050001826137}, "total_wall_ms": 301.67791608255357, "ttft_ms": 37.92279108893126, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 54}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1737736192, "backend_memory": {"mlx_active_bytes": 15193920520, "mlx_peak_bytes": 15535314848, "mlx_cache_bytes": 22667256586, "process_rss_bytes": 1737736192}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15535314848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,189,710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "ff417a83395173e23eed2697e98ab63bb3a64e131460a4db313ac16229470c5f"} | ||||
| 2095 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "43fd78091c2b0388c5fb538e", "attempt_id": "807a6ab9a9c7", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:23.108036Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 47, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 4.042457905597985, "receiver_prefill_ms": 0.0, "query_prefill_ms": 107.5092499377206, "ttft_ms": 107.5092499377206, "decode_ms": 95.60179198160768}, "total_wall_ms": 215.1742089772597, "ttft_ms": 107.5092499377206, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 47}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1732689920, "backend_memory": {"mlx_active_bytes": 15193003016, "mlx_peak_bytes": 15509738012, "mlx_cache_bytes": 22816221418, "process_rss_bytes": 1732689920}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15509738012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,189,710", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "ff417a83395173e23eed2697e98ab63bb3a64e131460a4db313ac16229470c5f"} | ||||
| 2096 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c2ddf8477bd944e8aca5118c", "attempt_id": "e3c6e1fcf565", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:23.359312Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 55, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 3.932833089493215, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.72287506237626, "ttft_ms": 38.72287506237626, "decode_ms": 111.47541704121977}, "total_wall_ms": 162.4195830663666, "ttft_ms": 38.72287506237626, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1732755456, "backend_memory": {"mlx_active_bytes": 15193920520, "mlx_peak_bytes": 15538624580, "mlx_cache_bytes": 22995012426, "process_rss_bytes": 1732755456}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15538624580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pralithri-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "85752fcd9ca4e39a9cc943b22c72186edfdb50dfa4f64edd17926534c986227f"} | ||||
| 2097 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9df1017306b998225bc1bc57", "attempt_id": "72c5c9155c7a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:23.553829Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 49, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 4.138792050071061, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.082415936514735, "ttft_ms": 38.082415936514735, "decode_ms": 727.5640410371125}, "total_wall_ms": 777.2336250636727, "ttft_ms": 38.082415936514735, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 49}, "output_usage": {"output_tokens": 36}, "provider_cached_usage": null, "process_memory": 1732788224, "backend_memory": {"mlx_active_bytes": 15194838024, "mlx_peak_bytes": 15517813064, "mlx_cache_bytes": 22993390410, "process_rss_bytes": 1732788224}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15517813064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "346,160 + 302,390 + 2,046,021 + 9,842,832 + 9,487,300 = 12,172,743", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "ce522689feac7ee9a3cab38eb401efe60ad6652fa9960443679d29b396fbb521"} | ||||
| 2098 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3cd27c8037e64c446eea79f5", "attempt_id": "8610ac134a24", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:24.359838Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 45, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 4.141916986554861, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.16062496136874, "ttft_ms": 39.16062496136874, "decode_ms": 54.74066606257111}, "total_wall_ms": 105.59087491128594, "ttft_ms": 39.16062496136874, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1732788224, "backend_memory": {"mlx_active_bytes": 15193003016, "mlx_peak_bytes": 15502296872, "mlx_cache_bytes": 22997109578, "process_rss_bytes": 1732788224}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15502296872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2.15", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "b720401fc5f0a1962c830b14132f12c2b376f2cca823b2efbaf226167720251e"} | ||||
| 2099 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d8ee5595213670e71bdcb458", "attempt_id": "195aaab2fa16", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:24.495353Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 47, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 3.8477079942822456, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.06041700206697, "ttft_ms": 37.06041700206697, "decode_ms": 18.364124931395054}, "total_wall_ms": 66.93033291958272, "ttft_ms": 37.06041700206697, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 47}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1732788224, "backend_memory": {"mlx_active_bytes": 15193003016, "mlx_peak_bytes": 15509735208, "mlx_cache_bytes": 22997109578, "process_rss_bytes": 1732788224}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15509735208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2100 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "589284177bab188bdaec3e1d", "attempt_id": "873e54221d76", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:24.592096Z", "task_family": "synthetic", "document_id": "syn_03014_16000", "document_hash": "7e9ddaa0641ea0d459d7b77775f4e03ca9f48e86d5eae0d040817452e8a60de4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03014_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14525060104}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10826, "source_tokens_receiver": 10826, "query_tokens": 50, "message_tokens": 10886, "message_utf8_bytes": 58447, "cache_tensor_bytes": 663262208, "serialized_payload_bytes": 663290049, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 155.67791601642966, "doc_prefill_ms": 2135.909999953583, "compress_ms": 28.543499996885657, "serialize_ms": 126.83695799205452, "load_ms": 4.330583033151925, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.62349996436387, "ttft_ms": 39.62349996436387, "decode_ms": 18.41291703749448}, "total_wall_ms": 69.86545806284994, "ttft_ms": 39.62349996436387, "input_usage": {"receiver_prefix_tokens": 10886, "dense_cache_bytes": 1248493568, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1732788224, "backend_memory": {"mlx_active_bytes": 15193003016, "mlx_peak_bytes": 15521155400, "mlx_cache_bytes": 22993029962, "process_rss_bytes": 1732788224}, "peak_prefill_memory": 14284936256, "peak_decode_memory": 15521155400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03014_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c344b401986d87361183f7633729aaa891e2f1cdc9acc76737d0d644bae8b1fb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2101 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "548bf4e5f7563aed9164c29b", "attempt_id": "fb0feaff7bfc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:25.345796Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2006, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 9650.998041033745, "ttft_ms": 50.592291983775795, "decode_ms": 134.2109590768814}, "total_wall_ms": 9840.158625040203, "ttft_ms": 50.592291983775795, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1148026880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13472068500, "mlx_cache_bytes": 2810762508, "process_rss_bytes": 1148026880}, "peak_prefill_memory": null, "peak_decode_memory": 13472068500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 2102 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3fc6218cd4d4defc27aaa19d", "attempt_id": "e8278871d0a3", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:35.215158Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1998, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 209.79812508448958, "ttft_ms": 13.637208961881697, "decode_ms": 13.667333987541497}, "total_wall_ms": 244.62775001302361, "ttft_ms": 13.637208961881697, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1148092416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13468890004, "mlx_cache_bytes": 3596473612, "process_rss_bytes": 1148092416}, "peak_prefill_memory": null, "peak_decode_memory": 13468890004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 2103 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3a251974a7c5d5f7f160038a", "attempt_id": "8c9223faa09f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:35.475775Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 1998, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 208.3279590588063, "ttft_ms": 13.686457998119295, "decode_ms": 13.872541021555662}, "total_wall_ms": 238.75791602768004, "ttft_ms": 13.686457998119295, "input_usage": {"receiver_prompt_tokens": 1998}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1148092416, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13468890004, "mlx_cache_bytes": 3596473612, "process_rss_bytes": 1148092416}, "peak_prefill_memory": null, "peak_decode_memory": 13468890004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2104 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5872542680dfed5ae34324e7", "attempt_id": "e8fd9960ff07", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:35.730203Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2012, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 265.4678749386221, "ttft_ms": 14.284417033195496, "decode_ms": 123.34291695151478}, "total_wall_ms": 406.3320419518277, "ttft_ms": 14.284417033195496, "input_usage": {"receiver_prompt_tokens": 2012}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1148141568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13474182208, "mlx_cache_bytes": 4387476748, "process_rss_bytes": 1148141568}, "peak_prefill_memory": null, "peak_decode_memory": 13474182208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2105 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "20e852fd3f26e2ee9f5c19ef", "attempt_id": "2f0ef2315362", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:36.152528Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2006, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 267.5474579446018, "ttft_ms": 14.242083067074418, "decode_ms": 97.15408296324313}, "total_wall_ms": 381.83950004167855, "ttft_ms": 14.242083067074418, "input_usage": {"receiver_prompt_tokens": 2006}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1148141568, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13472068500, "mlx_cache_bytes": 4387476748, "process_rss_bytes": 1148141568}, "peak_prefill_memory": null, "peak_decode_memory": 13472068500, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8377480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "eedcb3ec2bdef623b3fb1b0d8a045a8680babcb6cf46ed7f48d4d0c430347e5c"} | ||||
| 2106 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "edad7f371dab8b3af5df15a2", "attempt_id": "5ad21d24abcb", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:36.551351Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2015, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 265.87583392392844, "ttft_ms": 13.786875060759485, "decode_ms": 81.56070800032467}, "total_wall_ms": 364.15745806880295, "ttft_ms": 13.786875060759485, "input_usage": {"receiver_prompt_tokens": 2015}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1148157952, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13475443776, "mlx_cache_bytes": 5179741452, "process_rss_bytes": 1148157952}, "peak_prefill_memory": null, "peak_decode_memory": 13475443776, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2107 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8c9fc930c0a8a04c7d8079c8", "attempt_id": "30077481a0a3", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:36.932525Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2008, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 273.8570839865133, "ttft_ms": 13.733375002630055, "decode_ms": 95.06112488452345}, "total_wall_ms": 385.4688750579953, "ttft_ms": 13.733375002630055, "input_usage": {"receiver_prompt_tokens": 2008}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1148174336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13472527424, "mlx_cache_bytes": 5730571532, "process_rss_bytes": 1148174336}, "peak_prefill_memory": null, "peak_decode_memory": 13472527424, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4089450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "08ce5184542022c9cee48bcf87b8f5c3168ba6324fcc28be91db0ec1731149af"} | ||||
| 2108 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f98e74203e99be3644400c22", "attempt_id": "150432499b6b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:37.334753Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2005, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 273.5518340487033, "ttft_ms": 13.892000075429678, "decode_ms": 67.69858300685883}, "total_wall_ms": 358.05691697169095, "ttft_ms": 13.892000075429678, "input_usage": {"receiver_prompt_tokens": 2005}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1148174336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13471675284, "mlx_cache_bytes": 6280549644, "process_rss_bytes": 1148174336}, "peak_prefill_memory": null, "peak_decode_memory": 13471675284, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.78", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "a613b48bf860be3904729751229f821c4082791d1c6f55636e6739c278603835"} | ||||
| 2109 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0dd8ba4cc5b2fbdb448bcf42", "attempt_id": "dd4b2be542a6", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:37.709806Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2009, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 275.25845798663795, "ttft_ms": 13.874458032660186, "decode_ms": 13.793457997962832}, "total_wall_ms": 305.8843750040978, "ttft_ms": 13.874458032660186, "input_usage": {"receiver_prompt_tokens": 2009}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1148174336, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13472855104, "mlx_cache_bytes": 6831707404, "process_rss_bytes": 1148174336}, "peak_prefill_memory": null, "peak_decode_memory": 13472855104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2110 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "743c846a96699355d52c8063", "attempt_id": "d2865cbcc4f0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:38.032734Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 2010, "message_tokens": 1922, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.01879199407994747, "decode_payload_ms": 0.0, "receiver_prefill_ms": 295.29837507288903, "ttft_ms": 14.190832967869937, "decode_ms": 13.754333020187914}, "total_wall_ms": 326.16324990522116, "ttft_ms": 14.190832967869937, "input_usage": {"receiver_prompt_tokens": 2010}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1148190720, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13473592384, "mlx_cache_bytes": 7383127308, "process_rss_bytes": 1148190720}, "peak_prefill_memory": null, "peak_decode_memory": 13473592384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2111 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "835298eaf4f09aecf6836863", "attempt_id": "8f2f08008660", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:45.671590Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.03637501131743, "ttft_ms": 13.545625028200448, "decode_ms": 13.998542097397149}, "total_wall_ms": 100.97437503281981, "ttft_ms": 13.545625028200448, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149026304, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 8777241868, "process_rss_bytes": 1149026304}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2112 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "215f9f4639d636254640d41a", "attempt_id": "147c5025b851", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:45.789202Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.339500089176, "ttft_ms": 13.45054095145315, "decode_ms": 14.321167021989822}, "total_wall_ms": 99.20112509280443, "ttft_ms": 13.45054095145315, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149026304, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 9122878732, "process_rss_bytes": 1149026304}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2113 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da8cbecd0abf9caf46bca647", "attempt_id": "14bf837239ba", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:45.905738Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.12670804094523, "ttft_ms": 13.4860830148682, "decode_ms": 13.434708002023399}, "total_wall_ms": 101.08624992426485, "ttft_ms": 13.4860830148682, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149026304, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 9122878732, "process_rss_bytes": 1149026304}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2114 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "97fedd5ca5c36676e84a4ebf", "attempt_id": "d46be99a5400", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:46.023617Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 607, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.64329099841416, "ttft_ms": 13.567124959081411, "decode_ms": 13.474915991537273}, "total_wall_ms": 103.77591592259705, "ttft_ms": 13.567124959081411, "input_usage": {"receiver_prompt_tokens": 607, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149042688, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997157976, "mlx_cache_bytes": 9492010252, "process_rss_bytes": 1149042688}, "peak_prefill_memory": null, "peak_decode_memory": 12997157976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2115 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "680bbc7f0a70543f8e2aa3ae", "attempt_id": "ef7c2e90b7c4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:46.143502Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.7614580001682, "ttft_ms": 13.400041032582521, "decode_ms": 123.1364170089364}, "total_wall_ms": 215.42504196986556, "ttft_ms": 13.400041032582521, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1149059072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 9492010252, "process_rss_bytes": 1149059072}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,377,480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "ec4c68b327a2d2427ed21821415a5f9ddf87134bd9f654bdd69c7d1301febcb0"} | ||||
| 2116 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ecaf41c5f5730d80f756252f", "attempt_id": "f30146cbcd56", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:46.376058Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.21933306008577, "ttft_ms": 13.53600004222244, "decode_ms": 13.384999940171838}, "total_wall_ms": 108.20987506303936, "ttft_ms": 13.53600004222244, "input_usage": {"receiver_prompt_tokens": 610, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149059072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12999599192, "mlx_cache_bytes": 9869202700, "process_rss_bytes": 1149059072}, "peak_prefill_memory": null, "peak_decode_memory": 12999599192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2117 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "338b72a7b9745ee0630060a5", "attempt_id": "142d78d2a1a4", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:46.501390Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.20737494714558, "ttft_ms": 13.44870903994888, "decode_ms": 93.86995807290077}, "total_wall_ms": 187.61783302761614, "ttft_ms": 13.44870903994888, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1149059072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010183256, "mlx_cache_bytes": 10139292940, "process_rss_bytes": 1149059072}, "peak_prefill_memory": null, "peak_decode_memory": 13010183256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1806025", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "9801d1840792d286693349934c9cc13fead44d82d480a42803cf6015c01431f6"} | ||||
| 2118 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8a985c69b073686fcbc7734", "attempt_id": "e00d09a0751d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:46.705293Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.01533399894834, "ttft_ms": 13.412500033155084, "decode_ms": 13.498457963578403}, "total_wall_ms": 109.02804194483906, "ttft_ms": 13.412500033155084, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149059072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992767064, "mlx_cache_bytes": 10297562380, "process_rss_bytes": 1149059072}, "peak_prefill_memory": null, "peak_decode_memory": 12992767064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2119 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8bc33f8118c51592f76a49c0", "attempt_id": "596fab9fd695", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:46.831257Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.68345797155052, "ttft_ms": 13.917000032961369, "decode_ms": 13.780125067569315}, "total_wall_ms": 113.49274998065084, "ttft_ms": 13.917000032961369, "input_usage": {"receiver_prompt_tokens": 604, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149059072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008282712, "mlx_cache_bytes": 10545976588, "process_rss_bytes": 1149059072}, "peak_prefill_memory": null, "peak_decode_memory": 13008282712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2120 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "497ccced50b461495ca6e1e3", "attempt_id": "c11e505431de", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:46.961533Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1161, "cache_tensor_bytes": null, "serialized_payload_bytes": 1161, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7295.946792000905, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.6180829256773, "ttft_ms": 13.884832966141403, "decode_ms": 13.801541994325817}, "total_wall_ms": 117.44425003416836, "ttft_ms": 13.884832966141403, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 2038, "sender_output_tokens": 512, "sender_prefill_ms": 301.3827499235049, "sender_ttft_ms": 14.139125007204711, "sender_decode_ms": 6977.834332967177}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149059072, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996125784, "mlx_cache_bytes": 10794685708, "process_rss_bytes": 1149059072}, "peak_prefill_memory": null, "peak_decode_memory": 12996125784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "52d2d6723cbb6f8139ce72290860dae098b28331488ef44459da0ce2ae9f9f72", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2121 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae7a16f551e899f0625b66ca", "attempt_id": "0a240daa7e53", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:54.384285Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 461, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.24933303240687, "ttft_ms": 13.188416953198612, "decode_ms": 13.167291996069252}, "total_wall_ms": 85.37229103967547, "ttft_ms": 13.188416953198612, "input_usage": {"receiver_prompt_tokens": 461, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902112136, "mlx_cache_bytes": 12014457472, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12902112136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2122 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b92bc317903d27b24bf773f6", "attempt_id": "60d2bca985c7", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:54.486629Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 453, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.443375022150576, "ttft_ms": 13.44624999910593, "decode_ms": 13.346040970645845}, "total_wall_ms": 83.12924997881055, "ttft_ms": 13.44624999910593, "input_usage": {"receiver_prompt_tokens": 453, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12976380832, "mlx_cache_bytes": 12373545600, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12976380832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2123 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a477c5dbcb289469b7e6c4e", "attempt_id": "028823df67c7", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:54.586143Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 453, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.44166697654873, "ttft_ms": 13.189874938689172, "decode_ms": 13.457332970574498}, "total_wall_ms": 82.9666251083836, "ttft_ms": 13.189874938689172, "input_usage": {"receiver_prompt_tokens": 453, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12976380832, "mlx_cache_bytes": 12373545600, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12976380832, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2124 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9f398d81abd25dfb1f06e5df", "attempt_id": "ece06c8f391b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:54.685387Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 467, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.27966597583145, "ttft_ms": 13.19487497676164, "decode_ms": 13.417416950687766}, "total_wall_ms": 82.79675000812858, "ttft_ms": 13.19487497676164, "input_usage": {"receiver_prompt_tokens": 467, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12906175392, "mlx_cache_bytes": 12659562952, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12906175392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2125 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "059f84867cd60489676a53be", "attempt_id": "c3ac8a77300e", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:54.784473Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 461, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.385207990184426, "ttft_ms": 13.483708025887609, "decode_ms": 119.5952909765765}, "total_wall_ms": 189.350749948062, "ttft_ms": 13.483708025887609, "input_usage": {"receiver_prompt_tokens": 461, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902112136, "mlx_cache_bytes": 12659562952, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12902112136, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,028,925", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "e83edb3f38a69e604be343e63e2e84442156fcb2bb30f36ba9716575d5ffd57a"} | ||||
| 2126 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ca5f61f9c3580424548dbf6b", "attempt_id": "b9a768528eb4", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:54.990023Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 470, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.09429099038243, "ttft_ms": 13.299333048053086, "decode_ms": 13.490917044691741}, "total_wall_ms": 82.81229203566909, "ttft_ms": 13.299333048053086, "input_usage": {"receiver_prompt_tokens": 470, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12908157868, "mlx_cache_bytes": 12935962908, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12908157868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2127 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b4113ff03a8098d4a0ef67c7", "attempt_id": "abab6acc96d1", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.088967Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 463, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.888500017113984, "ttft_ms": 13.250249903649092, "decode_ms": 13.202292029745877}, "total_wall_ms": 82.19620806630701, "ttft_ms": 13.250249903649092, "input_usage": {"receiver_prompt_tokens": 463, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12919397280, "mlx_cache_bytes": 13143286044, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12919397280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2128 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c733920f615c4d1aa481033b", "attempt_id": "f2d22fa574a8", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.187046Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 460, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.578417028300464, "ttft_ms": 13.644665945321321, "decode_ms": 66.57191610429436}, "total_wall_ms": 136.66416704654694, "ttft_ms": 13.644665945321321, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12901718920, "mlx_cache_bytes": 13264593180, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12901718920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "18300", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "5fab5bd05f98260a1f33ff741eee56f962974eae8eba07a27b24ad12458a8d45"} | ||||
| 2129 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e71dcc23f9e56f774699e7b", "attempt_id": "f9ef2f028e69", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.339725Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 464, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.37608400825411, "ttft_ms": 13.485749950632453, "decode_ms": 13.271708972752094}, "total_wall_ms": 82.01162505429238, "ttft_ms": 13.485749950632453, "input_usage": {"receiver_prompt_tokens": 464, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12919987104, "mlx_cache_bytes": 13455401244, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12919987104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2130 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c3953f850279b761afe9c75a", "attempt_id": "5f52e6bbffb6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.437836Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 465, "message_tokens": 361, "message_utf8_bytes": 849, "cache_tensor_bytes": null, "serialized_payload_bytes": 849, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7288.479125010781, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.61887503042817, "ttft_ms": 13.587292050942779, "decode_ms": 13.079666998237371}, "total_wall_ms": 82.17029203660786, "ttft_ms": 13.587292050942779, "input_usage": {"receiver_prompt_tokens": 465, "sender_input_tokens": 2066, "sender_output_tokens": 512, "sender_prefill_ms": 315.1880418881774, "sender_ttft_ms": 14.097042032517493, "sender_decode_ms": 6955.976750003174}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149698048, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904946592, "mlx_cache_bytes": 13646504220, "process_rss_bytes": 1149698048}, "peak_prefill_memory": null, "peak_decode_memory": 12904946592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "652a509b18693f3866263312e5d38c5da11dd62f1f2d05b953daf4137e4a4621", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2131 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2282d127c6217e24f49c81cc", "attempt_id": "0738c5d79b1c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.537579Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 595, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.02349998988211, "ttft_ms": 13.604125007987022, "decode_ms": 13.528874958865345}, "total_wall_ms": 100.14500003308058, "ttft_ms": 13.604125007987022, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012673624, "mlx_cache_bytes": 13913153820, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 13012673624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2132 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1a2fe5639bf090426fc21981", "attempt_id": "bdc196e73f00", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.653946Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 587, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.05862498469651, "ttft_ms": 13.548292103223503, "decode_ms": 13.42233398463577}, "total_wall_ms": 101.07695800252259, "ttft_ms": 13.548292103223503, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 14176166172, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2133 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4fbab193e0fe0f34b39a304c", "attempt_id": "3bf4099519ef", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.770950Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 587, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.34395800717175, "ttft_ms": 13.578249956481159, "decode_ms": 13.796875020489097}, "total_wall_ms": 101.77279205527157, "ttft_ms": 13.578249956481159, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13005268056, "mlx_cache_bytes": 14176166172, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 13005268056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2134 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e662a35a17be53c943d20d7a", "attempt_id": "135dee3fb885", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:55.888975Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 601, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.75558295845985, "ttft_ms": 13.795707956887782, "decode_ms": 95.80008394550532}, "total_wall_ms": 185.35608297679573, "ttft_ms": 13.795707956887782, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 14176166172, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3199125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "cf9a38c1e0ee9fd29d21948a185e19195595b5a7459cd14622cda0879ee474c8"} | ||||
| 2135 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ac7d89766586339c9d6a937f", "attempt_id": "3d57b6baa0f4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:56.090954Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 595, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.6253330251202, "ttft_ms": 13.68762506172061, "decode_ms": 94.93870800361037}, "total_wall_ms": 183.2252088934183, "ttft_ms": 13.68762506172061, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010216024, "mlx_cache_bytes": 14176166172, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 13010216024, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7028925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "e966a398855c104a86bce07742c3ce8108a432926bc704940ecfd07e44596774"} | ||||
| 2136 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cdb1c32240d55026ad4205bb", "attempt_id": "aef6f7deb7c8", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:56.290637Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 604, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.35474994033575, "ttft_ms": 13.844291912391782, "decode_ms": 82.0757090114057}, "total_wall_ms": 170.266916975379, "ttft_ms": 13.844291912391782, "input_usage": {"receiver_prompt_tokens": 604}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008282712, "mlx_cache_bytes": 14176166172, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 13008282712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2137 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "42ef82760d3c5703d1235da7", "attempt_id": "791ed518c23e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:56.477192Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 597, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.65154197718948, "ttft_ms": 13.805708033032715, "decode_ms": 95.62991699203849}, "total_wall_ms": 182.1299169678241, "ttft_ms": 13.805708033032715, "input_usage": {"receiver_prompt_tokens": 597}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993700952, "mlx_cache_bytes": 14421532956, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 12993700952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4041253", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "eeca851a24e5a339621b253cb458baf67c05245b688f2f37b98b70d7cfaa0093"} | ||||
| 2138 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ef04c33286fe84b2336c109b", "attempt_id": "5f108ab18161", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:56.675665Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 594, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.2179170222953, "ttft_ms": 13.613041955977678, "decode_ms": 94.78308400139213}, "total_wall_ms": 180.57941691949964, "ttft_ms": 13.613041955977678, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13009822808, "mlx_cache_bytes": 14578229532, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 13009822808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2104225", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "1458a16b7224725bafa9d3d17a1e11d73f3d07fde88a7a1bdf7344b8166f7e0b"} | ||||
| 2139 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5fb26ef90aa0b7557ab2eae", "attempt_id": "844fae7a3e64", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:56.872046Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 598, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.91220903769135, "ttft_ms": 14.073959086090326, "decode_ms": 13.595124939456582}, "total_wall_ms": 100.5712499609217, "ttft_ms": 14.073959086090326, "input_usage": {"receiver_prompt_tokens": 598}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994438232, "mlx_cache_bytes": 14824186140, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 12994438232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2140 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3703c9605bb112456e68cd8e", "attempt_id": "73c1da03acda", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:56.988806Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 599, "message_tokens": 510, "message_utf8_bytes": 1272, "cache_tensor_bytes": null, "serialized_payload_bytes": 1272, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.5730829909443855, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.38687502872199, "ttft_ms": 13.638624921441078, "decode_ms": 13.40237504336983}, "total_wall_ms": 102.43591701146215, "ttft_ms": 13.638624921441078, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1149747200, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994929752, "mlx_cache_bytes": 14912364828, "process_rss_bytes": 1149747200}, "peak_prefill_memory": null, "peak_decode_memory": 12994929752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e2564705fe8f40e9bcab4c89613ea028ae20f00762a230d3c81e35a3f0fbce18", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2141 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3d09796adb68dc22ef16dca2", "attempt_id": "75b7e2c82eab", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:57.366764Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.351832994259894, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.645624957978725, "ttft_ms": 20.645624957978725, "decode_ms": 40.56512506213039}, "total_wall_ms": 63.97604092489928, "ttft_ms": 20.645624957978725, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 15656303038, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NotProvided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "a8da256cab6983d83636f7a669ac93f2dde30127260d7d17103e68ec8141c0e4"} | ||||
| 2142 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0e5288321a6f613d1ba2ed9b", "attempt_id": "27ee0f3e0225", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:57.446790Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.4942080015316606, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.5780829526484, "ttft_ms": 19.5780829526484, "decode_ms": 13.621125021018088}, "total_wall_ms": 36.0939169768244, "ttft_ms": 19.5780829526484, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 15692626366, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2143 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ad74b7ea9be138af176365c9", "attempt_id": "0c4d48c38476", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:57.499174Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.4622920425608754, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.539332948625088, "ttft_ms": 19.539332948625088, "decode_ms": 13.429917045868933}, "total_wall_ms": 35.780124948360026, "ttft_ms": 19.539332948625088, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 15692659134, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2144 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2429b93661ee3f50c781ceba", "attempt_id": "ac33931ef8c1", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:57.551199Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 51, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.4399170177057385, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.0294170062989, "ttft_ms": 20.0294170062989, "decode_ms": 120.69616699591279}, "total_wall_ms": 143.55895796325058, "ttft_ms": 20.0294170062989, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 51}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12713251848, "mlx_peak_bytes": 12760864012, "mlx_cache_bytes": 15761718102, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12760864012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2145 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2a3a299af0aab7325ca879bc", "attempt_id": "98d438d88904", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:57.710870Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.2962089385837317, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.25350003875792, "ttft_ms": 19.25350003875792, "decode_ms": 81.02354104630649}, "total_wall_ms": 102.9552499530837, "ttft_ms": 19.25350003875792, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 45}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 15763159894, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "120000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "4f9f73b34c5b89879aad65a48025f3187dd9ce6dc3d4e88eecb2fc79227350f1"} | ||||
| 2146 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0a9b4ceab48f68a73dd38dcb", "attempt_id": "76edec466d2d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:57.829954Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 54, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.3577500358223915, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.59308290295303, "ttft_ms": 18.59308290295303, "decode_ms": 79.77116608526558}, "total_wall_ms": 101.14262497518212, "ttft_ms": 18.59308290295303, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12712989704, "mlx_peak_bytes": 12764566808, "mlx_cache_bytes": 15811165446, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12764566808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2147 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "50cb02b2c1d8e44aa41f58f3", "attempt_id": "9872404c5217", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:57.947231Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 47, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.2754580238834023, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.305249977856874, "ttft_ms": 18.305249977856874, "decode_ms": 93.30375003628433}, "total_wall_ms": 114.2699170159176, "ttft_ms": 18.305249977856874, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12757488908, "mlx_cache_bytes": 15832923398, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12757488908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2054989", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "3533db7c407eb27331580538d8fd03621a1344a54ceccbaf823a3cf5e8009108"} | ||||
| 2148 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fd151ad6d2a4df72ef009753", "attempt_id": "07d12d51dfce", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.077765Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 44, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.5614170115441084, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.281124997884035, "ttft_ms": 18.281124997884035, "decode_ms": 53.386540967039764}, "total_wall_ms": 74.65520803816617, "ttft_ms": 18.281124997884035, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 44}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12755801332, "mlx_cache_bytes": 15846309126, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12755801332, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "b902cc4550838229a710bfec4c38cbc7eb11082367a409df9135e7f007a96bda"} | ||||
| 2149 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ee86f8fe4b90c1d1bec0dbd", "attempt_id": "8d049c33ec9b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.168340Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 48, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.4962500426918268, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.492667004466057, "ttft_ms": 18.492667004466057, "decode_ms": 13.33608292043209}, "total_wall_ms": 34.7047500545159, "ttft_ms": 18.492667004466057, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12758062348, "mlx_cache_bytes": 15865478406, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12758062348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2150 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "07806bb285c940ca9c6854d3", "attempt_id": "90b579c7ff64", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.219055Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12691756040}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1961, "keep": 490, "compress_ms": 8.75708309467882}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 49, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079274, "side_information_bytes": 15914, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 259.3138749944046, "doc_prefill_ms": 242.00766708236188, "compress_ms": 8.797334041446447, "serialize_ms": 5.766791058704257, "load_ms": 1.4561660354956985, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.563083023764193, "ttft_ms": 18.563083023764193, "decode_ms": 13.262375025078654}, "total_wall_ms": 34.69754208344966, "ttft_ms": 18.563083023764193, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1186938880, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12759471372, "mlx_cache_bytes": 15884942598, "process_rss_bytes": 1186938880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12759471372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a696f4c8978bce5d08b44f8a46589d647eb5f815882952eb820f657f01267e65", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2151 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9c1ca2854430f01a227ea0ea", "attempt_id": "a5faa96272a5", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.269972Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 45, "compress_ms": 43.70200005359948}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079315, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 49.48874993715435, "doc_prefill_ms": 242.00766708236188, "compress_ms": 45.02287495415658, "serialize_ms": 4.254500032402575, "load_ms": 1.2457080883905292, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.205834086984396, "ttft_ms": 18.205834086984396, "decode_ms": 66.7287081014365}, "total_wall_ms": 137.22249993588775, "ttft_ms": 18.205834086984396, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1187692544, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 16039328470, "process_rss_bytes": 1187692544}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-732", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4121fce92686814115a5be4d516768192c276147d22acb8a75ad103bc7cc4e0f", "output_hash": "31dece6f034462d2200457b3f9f4b6c5a23822eee0dee5fa83c932361931bc46"} | ||||
| 2152 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ae816c1408cc0aeebf8cf6a", "attempt_id": "59d930927b99", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.423265Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 37, "compress_ms": 41.480124928057194}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079316, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.41970798932016, "doc_prefill_ms": 242.00766708236188, "compress_ms": 42.800999945029616, "serialize_ms": 4.413458053022623, "load_ms": 0.4689169581979513, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.148832954466343, "ttft_ms": 18.148832954466343, "decode_ms": 13.227583025582135}, "total_wall_ms": 80.8341249357909, "ttft_ms": 18.148832954466343, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1206566912, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 16057252566, "process_rss_bytes": 1206566912}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a355e37f2cf1c5c08f781eb29bcc6b3b3660082ec498580416a592a71f25a6f", "output_hash": "8a798890fe93817163b10b5f7bd2ca4d25d84c52739a645a889c173eee7d9d3d"} | ||||
| 2153 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4e1a4bd9f2567a391b6674c5", "attempt_id": "c480ae2cf550", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.520718Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 37, "compress_ms": 41.0683749942109}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079314, "side_information_bytes": 15954, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.54991708230227, "doc_prefill_ms": 242.00766708236188, "compress_ms": 42.43441601283848, "serialize_ms": 3.9004170102998614, "load_ms": 1.1647080536931753, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.993750050663948, "ttft_ms": 17.993750050663948, "decode_ms": 13.505041017197073}, "total_wall_ms": 80.7436250615865, "ttft_ms": 17.993750050663948, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1206566912, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12749083892, "mlx_cache_bytes": 16057252566, "process_rss_bytes": 1206566912}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12749083892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "26ff79a272b30eed52e5f373577e4c5ab9fcd6b9b4092e64e7ff557c12949fe0", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2154 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9652b533fe3e726969a527e9", "attempt_id": "76ef56bfdc27", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.618317Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 51, "compress_ms": 40.983582963235676}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 51, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079316, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.45408294163644, "doc_prefill_ms": 242.00766708236188, "compress_ms": 42.334375088103116, "serialize_ms": 3.901874995790422, "load_ms": 1.1114999651908875, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.467833012342453, "ttft_ms": 22.467833012342453, "decode_ms": 94.25529092550278}, "total_wall_ms": 165.80516600515693, "ttft_ms": 22.467833012342453, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 51}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1206616064, "backend_memory": {"mlx_active_bytes": 12713284616, "mlx_peak_bytes": 12760864012, "mlx_cache_bytes": 16070277846, "process_rss_bytes": 1206616064}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12760864012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3199125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a355e37f2cf1c5c08f781eb29bcc6b3b3660082ec498580416a592a71f25a6f", "output_hash": "cf9a38c1e0ee9fd29d21948a185e19195595b5a7459cd14622cda0879ee474c8"} | ||||
| 2155 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b469e4eee6f437c0004e328e", "attempt_id": "36c165cc789b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:58.800502Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 45, "compress_ms": 41.43287497572601}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079315, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.0075000775978, "doc_prefill_ms": 242.00766708236188, "compress_ms": 42.74549998808652, "serialize_ms": 4.050416988320649, "load_ms": 1.1410409351810813, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.09370901901275, "ttft_ms": 18.09370901901275, "decode_ms": 120.49779202789068}, "total_wall_ms": 188.24883294291794, "ttft_ms": 18.09370901901275, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 45}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1206632448, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12756096244, "mlx_cache_bytes": 16071752406, "process_rss_bytes": 1206632448}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12756096244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,372,250", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4121fce92686814115a5be4d516768192c276147d22acb8a75ad103bc7cc4e0f", "output_hash": "1d2f17b4c0af7317b9f994ce495335005f3d064d15fa5d2cc2e769ff937876f2"} | ||||
| 2156 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "92cc95a233f153338ee359af", "attempt_id": "8c4d18acbf66", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.005278Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 54, "compress_ms": 41.90537496469915}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 54, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079315, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.31195804197341, "doc_prefill_ms": 242.00766708236188, "compress_ms": 43.25462493579835, "serialize_ms": 3.838125034235418, "load_ms": 1.147374976426363, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.774958978407085, "ttft_ms": 17.774958978407085, "decode_ms": 80.72399999946356}, "total_wall_ms": 148.5109169734642, "ttft_ms": 17.774958978407085, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1206632448, "backend_memory": {"mlx_active_bytes": 12712989704, "mlx_peak_bytes": 12763682072, "mlx_cache_bytes": 16095689430, "process_rss_bytes": 1206632448}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12763682072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4121fce92686814115a5be4d516768192c276147d22acb8a75ad103bc7cc4e0f", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2157 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2c6989183fc7583d2f7fad69", "attempt_id": "00cac652141e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.169956Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 47, "compress_ms": 40.76216591056436}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 47, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079315, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.17716697975993, "doc_prefill_ms": 242.00766708236188, "compress_ms": 42.12962498422712, "serialize_ms": 3.8452090229839087, "load_ms": 1.077583059668541, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.261542078107595, "ttft_ms": 18.261542078107595, "decode_ms": 93.10187504161149}, "total_wall_ms": 160.17637494951487, "ttft_ms": 18.261542078107595, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1206648832, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12757488908, "mlx_cache_bytes": 16102783702, "process_rss_bytes": 1206648832}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12757488908, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4089479", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4121fce92686814115a5be4d516768192c276147d22acb8a75ad103bc7cc4e0f", "output_hash": "5ae6e80276895e83f4e4eaee23dd09d6a3129f8aee2ffd9f691ca2cd2bdc0025"} | ||||
| 2158 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c49dc872e2785b911dd44e6c", "attempt_id": "e43db7313b51", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.346509Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 44, "compress_ms": 41.32587497588247}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 44, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079315, "side_information_bytes": 15955, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.66991694830358, "doc_prefill_ms": 242.00766708236188, "compress_ms": 42.71966696251184, "serialize_ms": 3.74195899348706, "load_ms": 1.1246249778196216, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.05729209445417, "ttft_ms": 18.05729209445417, "decode_ms": 66.87816698104143}, "total_wall_ms": 134.2647080309689, "ttft_ms": 18.05729209445417, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1206665216, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12754998516, "mlx_cache_bytes": 16118954710, "process_rss_bytes": 1206665216}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12754998516, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4121fce92686814115a5be4d516768192c276147d22acb8a75ad103bc7cc4e0f", "output_hash": "36a73d54c5377da4b3b3bd91e53f64a80885fd6372bc141a99fb6d520f2a4518"} | ||||
| 2159 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8763be51fe1f0c64dcd36eb8", "attempt_id": "5292016d4844", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.497267Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 48, "compress_ms": 41.888208012096584}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 48, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079316, "side_information_bytes": 15956, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 47.410208033397794, "doc_prefill_ms": 242.00766708236188, "compress_ms": 43.24274999089539, "serialize_ms": 3.954540938138962, "load_ms": 0.4723749589174986, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.045332981273532, "ttft_ms": 18.045332981273532, "decode_ms": 13.341874931938946}, "total_wall_ms": 80.76341706328094, "ttft_ms": 18.045332981273532, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1206665216, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12758062348, "mlx_cache_bytes": 16124984022, "process_rss_bytes": 1206665216}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12758062348, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "7a355e37f2cf1c5c08f781eb29bcc6b3b3660082ec498580416a592a71f25a6f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2160 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d4c37bd55a6c9cb8fefb872d", "attempt_id": "af8739efba42", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.594292Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12672881672}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1961, "keep": 490, "window_tokens": 49, "compress_ms": 41.5167500032112}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 49, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 18063360, "serialized_payload_bytes": 18079314, "side_information_bytes": 15954, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 46.5280000353232, "doc_prefill_ms": 242.00766708236188, "compress_ms": 42.86825004965067, "serialize_ms": 3.4396660048514605, "load_ms": 1.130749937146902, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.240167060866952, "ttft_ms": 18.240167060866952, "decode_ms": 13.420708943158388}, "total_wall_ms": 80.85387502796948, "ttft_ms": 18.240167060866952, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1206665216, "backend_memory": {"mlx_active_bytes": 12711810056, "mlx_peak_bytes": 12759471372, "mlx_cache_bytes": 16131144406, "process_rss_bytes": 1206665216}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12759471372, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "26ff79a272b30eed52e5f373577e4c5ab9fcd6b9b4092e64e7ff557c12949fe0", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2161 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5fdda1ee7fe7c16e7afb7f9", "attempt_id": "fce90f4437e5", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.709916Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 2.411582972854376, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.24295791145414, "ttft_ms": 21.24295791145414, "decode_ms": 146.74583298619837}, "total_wall_ms": 171.78687499836087, "ttft_ms": 21.24295791145414, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1285095424, "backend_memory": {"mlx_active_bytes": 12751928456, "mlx_peak_bytes": 12822252496, "mlx_cache_bytes": 16263435518, "process_rss_bytes": 1285095424}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12822252496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 2162 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35e4919721d2f3d7140f002d", "attempt_id": "56fea0783519", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.898067Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.808249973692, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.789916976355016, "ttft_ms": 20.789916976355016, "decode_ms": 14.777000062167645}, "total_wall_ms": 38.76791591756046, "ttft_ms": 20.789916976355016, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1285242880, "backend_memory": {"mlx_active_bytes": 12751917224, "mlx_peak_bytes": 12811324976, "mlx_cache_bytes": 16284827870, "process_rss_bytes": 1285242880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12811324976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 2163 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78737803d4b9dd22f7e45b69", "attempt_id": "19db7bc02681", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:02:59.953011Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 37, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.8331249011680484, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.62866697087884, "ttft_ms": 20.62866697087884, "decode_ms": 15.05137502681464}, "total_wall_ms": 38.920416962355375, "ttft_ms": 20.62866697087884, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1285242880, "backend_memory": {"mlx_active_bytes": 12751917224, "mlx_peak_bytes": 12811324976, "mlx_cache_bytes": 16284827870, "process_rss_bytes": 1285242880}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12811324976, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2164 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2f733ef342fab3a870003a40", "attempt_id": "2cbbb0b55461", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.008096Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 51, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.7040830571204424, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.151416935026646, "ttft_ms": 21.151416935026646, "decode_ms": 136.90108398441225}, "total_wall_ms": 161.15804202854633, "ttft_ms": 21.151416935026646, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 51}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1285849088, "backend_memory": {"mlx_active_bytes": 12751934216, "mlx_peak_bytes": 12829960952, "mlx_cache_bytes": 16326086318, "process_rss_bytes": 1285849088}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12829960952, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2165 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1524be9d3ce810689b90c47f", "attempt_id": "3d52fabaceea", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.185594Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 45, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 2.0213329698890448, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.96583298407495, "ttft_ms": 20.96583298407495, "decode_ms": 104.38070795498788}, "total_wall_ms": 128.89604200609028, "ttft_ms": 20.96583298407495, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1285849088, "backend_memory": {"mlx_active_bytes": 12751925000, "mlx_peak_bytes": 12822251232, "mlx_cache_bytes": 16326095534, "process_rss_bytes": 1285849088}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12822251232, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8377480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "eedcb3ec2bdef623b3fb1b0d8a045a8680babcb6cf46ed7f48d4d0c430347e5c"} | ||||
| 2166 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "41d993a2c8a981a67f14b256", "attempt_id": "520550fc29a5", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.331189Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 54, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.362374983727932, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.449249936267734, "ttft_ms": 21.449249936267734, "decode_ms": 89.10574996843934}, "total_wall_ms": 113.35345893166959, "ttft_ms": 21.449249936267734, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1285865472, "backend_memory": {"mlx_active_bytes": 12751934216, "mlx_peak_bytes": 12834273956, "mlx_cache_bytes": 16357502222, "process_rss_bytes": 1285865472}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12834273956, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2167 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "87f6800226e7daf7656c9f1b", "attempt_id": "2e49d0ec510f", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.460974Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 47, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.6283340519294143, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.342874970287085, "ttft_ms": 21.342874970287085, "decode_ms": 103.84825000073761}, "total_wall_ms": 128.33004200365394, "ttft_ms": 21.342874970287085, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1285865472, "backend_memory": {"mlx_active_bytes": 12751927304, "mlx_peak_bytes": 12824597960, "mlx_cache_bytes": 16384788494, "process_rss_bytes": 1285865472}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12824597960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4089479", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "5ae6e80276895e83f4e4eaee23dd09d6a3129f8aee2ffd9f691ca2cd2bdc0025"} | ||||
| 2168 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3a1b6ede4bb9c8ac5f643bdb", "attempt_id": "613aad89e37b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.605794Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 44, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.626292010769248, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.76137508265674, "ttft_ms": 20.76137508265674, "decode_ms": 74.53983300365508}, "total_wall_ms": 98.34529191721231, "ttft_ms": 20.76137508265674, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1285865472, "backend_memory": {"mlx_active_bytes": 12751921544, "mlx_peak_bytes": 12820661984, "mlx_cache_bytes": 16410304142, "process_rss_bytes": 1285865472}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12820661984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.78", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "a613b48bf860be3904729751229f821c4082791d1c6f55636e6739c278603835"} | ||||
| 2169 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f7fd7cb5d21d0dc5c94d62ca", "attempt_id": "5659cccba1ac", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.720391Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 48, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.818584045395255, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.2489579571411, "ttft_ms": 21.2489579571411, "decode_ms": 14.840916031971574}, "total_wall_ms": 39.30883400607854, "ttft_ms": 21.2489579571411, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1285881856, "backend_memory": {"mlx_active_bytes": 12751921544, "mlx_peak_bytes": 12825631304, "mlx_cache_bytes": 16438173326, "process_rss_bytes": 1285881856}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12825631304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2170 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2fd93f962e45b948b1b3a416", "attempt_id": "e6390fb20018", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.776053Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12711857288}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1922, "source_tokens_receiver": 1922, "query_tokens": 49, "message_tokens": 1961, "message_utf8_bytes": 7177, "cache_tensor_bytes": 38404224, "serialized_payload_bytes": 38438414, "side_information_bytes": 34190, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 18.69716600049287, "doc_prefill_ms": 242.00766708236188, "compress_ms": 9.601416066288948, "serialize_ms": 8.750417036935687, "load_ms": 1.838000025600195, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.306542097590864, "ttft_ms": 21.306542097590864, "decode_ms": 14.999583014287055}, "total_wall_ms": 39.53208401799202, "ttft_ms": 21.306542097590864, "input_usage": {"receiver_prefix_tokens": 1961, "dense_cache_bytes": 72290304, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1285898240, "backend_memory": {"mlx_active_bytes": 12751922696, "mlx_peak_bytes": 12827647688, "mlx_cache_bytes": 16466631182, "process_rss_bytes": 1285898240}, "peak_prefill_memory": 13454783380, "peak_decode_memory": 12827647688, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b2cd622bba075cf60ec61f1533815a7d46b80a480ddcbf4062f75b4dc844db8b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2171 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "57ba2d9c9c3cf4055427fd0b", "attempt_id": "e4e9567470c0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:00.958118Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1845, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 207.54870807286352, "ttft_ms": 14.631624915637076, "decode_ms": 100.04879196640104}, "total_wall_ms": 325.2432090230286, "ttft_ms": 14.631624915637076, "input_usage": {"receiver_prompt_tokens": 1845}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 580141056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13288648964, "mlx_cache_bytes": 818005672, "process_rss_bytes": 580141056}, "peak_prefill_memory": null, "peak_decode_memory": 13288648964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 2172 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ec13ae5b4c2438afca08ed25", "attempt_id": "456d8d92fac7", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:01.309980Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1839, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 206.13675005733967, "ttft_ms": 14.460374950431287, "decode_ms": 28.654000023379922}, "total_wall_ms": 251.7502090195194, "ttft_ms": 14.460374950431287, "input_usage": {"receiver_prompt_tokens": 1839}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 580141056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13287338244, "mlx_cache_bytes": 1247397544, "process_rss_bytes": 580141056}, "peak_prefill_memory": null, "peak_decode_memory": 13287338244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 2173 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d26487ced2393fb96fdc68f1", "attempt_id": "17a9f26b0f37", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:01.577649Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1839, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 224.35383300762624, "ttft_ms": 14.53087490517646, "decode_ms": 28.36912509519607}, "total_wall_ms": 269.7807908989489, "ttft_ms": 14.53087490517646, "input_usage": {"receiver_prompt_tokens": 1839}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 580141056, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13287338244, "mlx_cache_bytes": 1247397544, "process_rss_bytes": 580141056}, "peak_prefill_memory": null, "peak_decode_memory": 13287338244, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2174 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c604240015cbe833c5980e65", "attempt_id": "51b1c0aae489", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:01.863363Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1852, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 241.40679102856666, "ttft_ms": 14.464209089055657, "decode_ms": 71.81716605555266}, "total_wall_ms": 330.23449999745935, "ttft_ms": 14.464209089055657, "input_usage": {"receiver_prompt_tokens": 1852}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 580157440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13290565920, "mlx_cache_bytes": 1714086804, "process_rss_bytes": 580157440}, "peak_prefill_memory": null, "peak_decode_memory": 13290565920, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2175 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "45b09d0ccc5f3b8355fc466f", "attempt_id": "7ad76ef1dfbd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:02.209194Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1846, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 238.05929196532816, "ttft_ms": 14.239624957554042, "decode_ms": 70.2766670146957}, "total_wall_ms": 325.02266694791615, "ttft_ms": 14.239624957554042, "input_usage": {"receiver_prompt_tokens": 1846}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 580157440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13288747296, "mlx_cache_bytes": 1895457684, "process_rss_bytes": 580157440}, "peak_prefill_memory": null, "peak_decode_memory": 13288747296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,377,480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "ec4c68b327a2d2427ed21821415a5f9ddf87134bd9f654bdd69c7d1301febcb0"} | ||||
| 2176 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd95d340f67bbed87bdb8d2a", "attempt_id": "6acffc89217c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:02.549664Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1855, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 239.0032500261441, "ttft_ms": 14.59712500218302, "decode_ms": 84.9590830039233}, "total_wall_ms": 341.14366699941456, "ttft_ms": 14.59712500218302, "input_usage": {"receiver_prompt_tokens": 1855}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 580173824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13291221292, "mlx_cache_bytes": 2328592524, "process_rss_bytes": 580173824}, "peak_prefill_memory": null, "peak_decode_memory": 13291221292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2177 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0b5f8cdbfa45703218a66c99", "attempt_id": "a022dffd9a26", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:02.906627Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1849, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 237.72824998013675, "ttft_ms": 14.41079203505069, "decode_ms": 561.576290987432}, "total_wall_ms": 816.3569170283154, "ttft_ms": 14.41079203505069, "input_usage": {"receiver_prompt_tokens": 1849}, "output_usage": {"output_tokens": 40}, "provider_cached_usage": null, "process_memory": 580222976, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13289402656, "mlx_cache_bytes": 2760048780, "process_rss_bytes": 580222976}, "peak_prefill_memory": null, "peak_decode_memory": 13289402656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,104,225 + 1,253,225 + 1,806,025 + 1,806,025 + 3,621,302 = 9,530,802", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "a3d682dc2b8e4a3a44deb325237b4aef100854654333b589d28c8a4ae0d2f52b"} | ||||
| 2178 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c1846e355d7d47d860a2e82f", "attempt_id": "eafe8fd2c03b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:03.738829Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1846, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 201.75533404108137, "ttft_ms": 14.156709075905383, "decode_ms": 56.090167025104165}, "total_wall_ms": 274.4967920007184, "ttft_ms": 14.156709075905383, "input_usage": {"receiver_prompt_tokens": 1846}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 580239360, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13288747296, "mlx_cache_bytes": 2760048780, "process_rss_bytes": 580239360}, "peak_prefill_memory": null, "peak_decode_memory": 13288747296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.78 km", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "1ce58f692fb529015a5128c6624af329950b0f5314985326dc7df24c465cad98"} | ||||
| 2179 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "20a581f2f7727d73764f8a1f", "attempt_id": "cc2ce46ff0c4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:04.029821Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1849, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 225.4155830014497, "ttft_ms": 14.597333036363125, "decode_ms": 14.687333954498172}, "total_wall_ms": 257.1731249336153, "ttft_ms": 14.597333036363125, "input_usage": {"receiver_prompt_tokens": 1849}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580255744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13289402656, "mlx_cache_bytes": 2760048780, "process_rss_bytes": 580255744}, "peak_prefill_memory": null, "peak_decode_memory": 13289402656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2180 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3d66fce1645015e7a005fde", "attempt_id": "bab528feb469", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:04.302758Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 1851, "message_tokens": 1741, "message_utf8_bytes": 7177, "cache_tensor_bytes": null, "serialized_payload_bytes": 7177, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 254.59324999246746, "ttft_ms": 14.727042056620121, "decode_ms": 14.150707982480526}, "total_wall_ms": 285.999667015858, "ttft_ms": 14.727042056620121, "input_usage": {"receiver_prompt_tokens": 1851}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580255744, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13327642924, "mlx_cache_bytes": 2816901260, "process_rss_bytes": 580255744}, "peak_prefill_memory": null, "peak_decode_memory": 13327642924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2181 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e0635f9900cfd8255e2f5156", "attempt_id": "8ca0f8b837c9", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:12.099009Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.26520800497383, "ttft_ms": 13.572916970588267, "decode_ms": 13.491833000443876}, "total_wall_ms": 105.45625002123415, "ttft_ms": 13.572916970588267, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042163208, "mlx_cache_bytes": 4306710404, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13042163208, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2182 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "672e693aba398fad1f22da12", "attempt_id": "9c2e152bbd40", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:12.221254Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.53099996969104, "ttft_ms": 13.85524997022003, "decode_ms": 27.625124901533127}, "total_wall_ms": 119.14612492546439, "ttft_ms": 13.85524997022003, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046783496, "mlx_cache_bytes": 4593758084, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13046783496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2183 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "645829e51ee2ebb234f4ffd3", "attempt_id": "8a84affd514f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:12.356282Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 615, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.82070892769843, "ttft_ms": 13.752292026765645, "decode_ms": 13.4935830719769}, "total_wall_ms": 105.09120800998062, "ttft_ms": 13.752292026765645, "input_usage": {"receiver_prompt_tokens": 615, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13050584584, "mlx_cache_bytes": 4593758084, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13050584584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2184 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6793eda9361d9434f23ea950", "attempt_id": "26f2a44be4e0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:12.478059Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 628, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.5380830746144, "ttft_ms": 13.658083975315094, "decode_ms": 13.59116705134511}, "total_wall_ms": 105.83816701546311, "ttft_ms": 13.658083975315094, "input_usage": {"receiver_prompt_tokens": 628, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046619684, "mlx_cache_bytes": 4968331600, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13046619684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2185 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bc346d64647d40e884c80c8c", "attempt_id": "0f454430b287", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:12.599963Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.65966700389981, "ttft_ms": 14.223415986634791, "decode_ms": 13.883583946153522}, "total_wall_ms": 106.86666599940509, "ttft_ms": 14.223415986634791, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540068, "mlx_cache_bytes": 5151570256, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13042540068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2186 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "87f16df07a74bcfb11388083", "attempt_id": "39dc41ec8b34", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:12.722282Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 631, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.37245904374868, "ttft_ms": 13.73320899438113, "decode_ms": 13.508291100151837}, "total_wall_ms": 106.66350007522851, "ttft_ms": 13.73320899438113, "input_usage": {"receiver_prompt_tokens": 631, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13048061488, "mlx_cache_bytes": 5504336680, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13048061488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2187 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "37483973caa02f8bc3ee92e1", "attempt_id": "4985c7f137e7", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:12.845041Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.2714580418542, "ttft_ms": 13.754375046119094, "decode_ms": 68.87641607318074}, "total_wall_ms": 161.97062493301928, "ttft_ms": 13.754375046119094, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13044129316, "mlx_cache_bytes": 5818712872, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13044129316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,806,025", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "4de10b23990757532ff215b6a27f5f805aa6f751cc9757418279cc7ab85aa1a9"} | ||||
| 2188 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a53dbd64f2d4013a9c968f4d", "attempt_id": "b44b12ceca73", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:13.023079Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.94695796817541, "ttft_ms": 13.743708026595414, "decode_ms": 13.57537496369332}, "total_wall_ms": 105.28116603381932, "ttft_ms": 13.743708026595414, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580714496, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540068, "mlx_cache_bytes": 5818712872, "process_rss_bytes": 580714496}, "peak_prefill_memory": null, "peak_decode_memory": 13042540068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2189 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9fe7b3459b5e6db66a265348", "attempt_id": "b2110ae2b7b5", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:13.144668Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 625, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.36204203683883, "ttft_ms": 13.667499995790422, "decode_ms": 13.769916957244277}, "total_wall_ms": 105.83558306097984, "ttft_ms": 13.667499995790422, "input_usage": {"receiver_prompt_tokens": 625, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13044129316, "mlx_cache_bytes": 5818712872, "process_rss_bytes": 580730880}, "peak_prefill_memory": null, "peak_decode_memory": 13044129316, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2190 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b1490fc8add4f6ce0a3f7066", "attempt_id": "45a62ef6cb7f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:13.266186Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 627, "message_tokens": 512, "message_utf8_bytes": 1659, "cache_tensor_bytes": null, "serialized_payload_bytes": 1659, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7494.141458068043, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.15724993310869, "ttft_ms": 13.768207980319858, "decode_ms": 13.715291977860034}, "total_wall_ms": 108.74266701284796, "ttft_ms": 13.768207980319858, "input_usage": {"receiver_prompt_tokens": 627, "sender_input_tokens": 1875, "sender_output_tokens": 512, "sender_prefill_ms": 269.20399989467114, "sender_ttft_ms": 14.930916018784046, "sender_decode_ms": 7202.54937489517}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 580730880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13085122084, "mlx_cache_bytes": 5822563112, "process_rss_bytes": 580730880}, "peak_prefill_memory": null, "peak_decode_memory": 13085122084, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "90706f6f07a1c89a7eacc1b9ce96fc77f8d3dcfbec434c0ec0d23e356077d970", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2191 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "527c1a2cdbc17d0d7913b4a0", "attempt_id": "14eed6943ccc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:20.819509Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 390, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.78608300816268, "ttft_ms": 13.396083028055727, "decode_ms": 13.536541955545545}, "total_wall_ms": 86.52837504632771, "ttft_ms": 13.396083028055727, "input_usage": {"receiver_prompt_tokens": 390, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581009408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12879764568, "mlx_cache_bytes": 6534324456, "process_rss_bytes": 581009408}, "peak_prefill_memory": null, "peak_decode_memory": 12879764568, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2192 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4db62c54cf2734aaaa532782", "attempt_id": "3068ac432fd6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:20.922373Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 384, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.49825003556907, "ttft_ms": 13.6234579840675, "decode_ms": 13.401584001258016}, "total_wall_ms": 80.32958302646875, "ttft_ms": 13.6234579840675, "input_usage": {"receiver_prompt_tokens": 384, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581009408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12876684376, "mlx_cache_bytes": 6748823784, "process_rss_bytes": 581009408}, "peak_prefill_memory": null, "peak_decode_memory": 12876684376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2193 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "55dece17745dec4dbdf46db3", "attempt_id": "1a6870223edd", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.018539Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 384, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.20758297946304, "ttft_ms": 13.455332955345511, "decode_ms": 13.369582942686975}, "total_wall_ms": 79.84174997545779, "ttft_ms": 13.455332955345511, "input_usage": {"receiver_prompt_tokens": 384, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581009408, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12876684376, "mlx_cache_bytes": 6748823784, "process_rss_bytes": 581009408}, "peak_prefill_memory": null, "peak_decode_memory": 12876684376, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2194 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "72153c6b8ab408904531f3d5", "attempt_id": "9666863df2d0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.114597Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 397, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.191957995295525, "ttft_ms": 13.685374986380339, "decode_ms": 13.53658305015415}, "total_wall_ms": 81.4234169665724, "ttft_ms": 13.685374986380339, "input_usage": {"receiver_prompt_tokens": 397, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12884024408, "mlx_cache_bytes": 6985326824, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 12884024408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2195 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "87dde31acfca0b5a79074f17", "attempt_id": "25e4fc61a9d0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.211747Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 391, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.55283408425748, "ttft_ms": 13.805250055156648, "decode_ms": 68.430042010732}, "total_wall_ms": 136.61712501198053, "ttft_ms": 13.805250055156648, "input_usage": {"receiver_prompt_tokens": 391, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12880649304, "mlx_cache_bytes": 7165567208, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 12880649304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,028,925", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "e83edb3f38a69e604be343e63e2e84442156fcb2bb30f36ba9716575d5ffd57a"} | ||||
| 2196 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bbab6c2ef206d5b92e421b06", "attempt_id": "3243d50f3913", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.364239Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 400, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.31637500785291, "ttft_ms": 13.558499980717897, "decode_ms": 13.902334030717611}, "total_wall_ms": 81.56341593712568, "ttft_ms": 13.558499980717897, "input_usage": {"receiver_prompt_tokens": 400, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12885662808, "mlx_cache_bytes": 7389012200, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 12885662808, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2197 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "466ce97b56d1452fe679c8f2", "attempt_id": "c01c684d0a5d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.461617Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 394, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.42791706789285, "ttft_ms": 13.584625092335045, "decode_ms": 13.500625034794211}, "total_wall_ms": 81.29191701300442, "ttft_ms": 13.584625092335045, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902849624, "mlx_cache_bytes": 7490527464, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 12902849624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2198 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7850e5ae2e4a920068aa2585", "attempt_id": "41112957112d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.558592Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 391, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.222790990024805, "ttft_ms": 13.55091598816216, "decode_ms": 13.782041962258518}, "total_wall_ms": 82.35120796598494, "ttft_ms": 13.55091598816216, "input_usage": {"receiver_prompt_tokens": 391, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12880649304, "mlx_cache_bytes": 7490527464, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 12880649304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2199 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5dfc054c424ee8243f5f9bab", "attempt_id": "e3f2e0f59876", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.656482Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 394, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.683375008404255, "ttft_ms": 13.61229200847447, "decode_ms": 13.539083069190383}, "total_wall_ms": 81.62766706664115, "ttft_ms": 13.61229200847447, "input_usage": {"receiver_prompt_tokens": 394, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907732056, "mlx_cache_bytes": 7490527464, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 12907732056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2200 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1393ca98a9889e47895c211b", "attempt_id": "f3e849964435", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.754288Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 396, "message_tokens": 270, "message_utf8_bytes": 754, "cache_tensor_bytes": null, "serialized_payload_bytes": 754, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7428.923415951431, "decode_payload_ms": 0.0, "receiver_prefill_ms": 52.98054206650704, "ttft_ms": 13.448167010210454, "decode_ms": 13.796709012240171}, "total_wall_ms": 81.03116601705551, "ttft_ms": 13.448167010210454, "input_usage": {"receiver_prompt_tokens": 396, "sender_input_tokens": 1905, "sender_output_tokens": 512, "sender_prefill_ms": 220.0228750007227, "sender_ttft_ms": 14.61149996612221, "sender_decode_ms": 7192.646374925971}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12884024408, "mlx_cache_bytes": 7490527464, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 12884024408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 7, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "da2ebb4f0e322f420a5282660d529894fc24a35d4ed2493ee47fb7ea2c0bc4f2", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2201 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5746524343a69168469803ba", "attempt_id": "ee7d55bb72d0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.852844Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 602, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.53174993861467, "ttft_ms": 13.82945803925395, "decode_ms": 13.487834017723799}, "total_wall_ms": 102.83400001935661, "ttft_ms": 13.82945803925395, "input_usage": {"receiver_prompt_tokens": 602}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031448072, "mlx_cache_bytes": 7849500904, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13031448072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2202 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e7ad63116b361e7470d18696", "attempt_id": "cd832b4b9e83", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:21.971573Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 596, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.68195795081556, "ttft_ms": 13.577292091213167, "decode_ms": 26.924500009045005}, "total_wall_ms": 116.18295894004405, "ttft_ms": 13.577292091213167, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13028367880, "mlx_cache_bytes": 8182882536, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13028367880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2203 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e921e99f39ed660e52f78fb", "attempt_id": "e23242cf254e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:22.103740Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 596, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.143375037238, "ttft_ms": 13.719958020374179, "decode_ms": 26.973166968673468}, "total_wall_ms": 115.8472920069471, "ttft_ms": 13.719958020374179, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13028367880, "mlx_cache_bytes": 8182882536, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13028367880, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2204 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7dbeae214331113179212b35", "attempt_id": "c7f531cfa4e4", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:22.235425Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 609, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.83204209711403, "ttft_ms": 13.819167041219771, "decode_ms": 67.97774997539818}, "total_wall_ms": 157.64816699083894, "ttft_ms": 13.819167041219771, "input_usage": {"receiver_prompt_tokens": 609}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708488, "mlx_cache_bytes": 8522817768, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13034708488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2205 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25aa9f6de9ac4393cc0285f0", "attempt_id": "058c3b4d0633", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:22.408930Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 603, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.07779200002551, "ttft_ms": 13.628458022139966, "decode_ms": 67.80054094269872}, "total_wall_ms": 156.54891694430262, "ttft_ms": 13.628458022139966, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628296, "mlx_cache_bytes": 8641175784, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13031628296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,377,480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "ec4c68b327a2d2427ed21821415a5f9ddf87134bd9f654bdd69c7d1301febcb0"} | ||||
| 2206 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5a1284b234fda513950d0e9a", "attempt_id": "228d8a60ae56", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:22.581830Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 612, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.54220797121525, "ttft_ms": 13.662375044077635, "decode_ms": 81.70770795550197}, "total_wall_ms": 172.9343329789117, "ttft_ms": 13.662375044077635, "input_usage": {"receiver_prompt_tokens": 612}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13068574216, "mlx_cache_bytes": 8817828072, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13068574216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2207 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "750a8db3d040a88abf564234", "attempt_id": "e518695cc1f1", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:22.770728Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 606, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.30404191836715, "ttft_ms": 13.830167008563876, "decode_ms": 68.38020798750222}, "total_wall_ms": 157.53141592722386, "ttft_ms": 13.830167008563876, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13063888392, "mlx_cache_bytes": 8973967592, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13063888392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2208 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a7e69a2895782eeb9f00c93", "attempt_id": "908863ea7f04", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:22.944025Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 603, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.54270799644291, "ttft_ms": 13.63108295481652, "decode_ms": 13.799999956972897}, "total_wall_ms": 103.08587504550815, "ttft_ms": 13.63108295481652, "input_usage": {"receiver_prompt_tokens": 603}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031628296, "mlx_cache_bytes": 8973967592, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13031628296, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2209 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "418e7f500b6e6e362dece3af", "attempt_id": "3c396d887a23", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:23.063197Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 606, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.49104194529355, "ttft_ms": 13.505542068742216, "decode_ms": 13.643500045873225}, "total_wall_ms": 102.69391594920307, "ttft_ms": 13.505542068742216, "input_usage": {"receiver_prompt_tokens": 606}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071359496, "mlx_cache_bytes": 8973967592, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13071359496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2210 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "21b6e87267e19fa4c20084ae", "attempt_id": "d110b6bc8b65", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:23.182628Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 18}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 608, "message_tokens": 497, "message_utf8_bytes": 1564, "cache_tensor_bytes": null, "serialized_payload_bytes": 1564, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1.580249983817339, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.25949995033443, "ttft_ms": 13.743957970291376, "decode_ms": 13.575874967500567}, "total_wall_ms": 103.59687497839332, "ttft_ms": 13.743957970291376, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 581025792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034708488, "mlx_cache_bytes": 8973967592, "process_rss_bytes": 581025792}, "peak_prefill_memory": null, "peak_decode_memory": 13034708488, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9f32a7784dd7073f16c5749cab14867ffc7eae205f1bde5fb0c3c4a498736582", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2211 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3141919d839bfe191f3c0ed", "attempt_id": "04d2dfc5e14d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:23.540891Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 44, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.4068749733269215, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.03162500821054, "ttft_ms": 19.03162500821054, "decode_ms": 275.46220796648413}, "total_wall_ms": 297.28587507270277, "ttft_ms": 19.03162500821054, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 44}, "output_usage": {"output_tokens": 20}, "provider_cached_usage": null, "process_memory": 685129728, "backend_memory": {"mlx_active_bytes": 12944200712, "mlx_peak_bytes": 12988388584, "mlx_cache_bytes": 9328419401, "process_rss_bytes": 685129728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12988388584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "There is no information about a project with a site of Lot 360-T in Matagami.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "d26a5414fa37291df97bf2a3afe5b91c38b075c92820481be47aae618a116ff8"} | ||||
| 2212 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe5d171606038c76360f8396", "attempt_id": "fbba15aee0e5", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:23.854611Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 38, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.7202909803017974, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.072834005579352, "ttft_ms": 18.072834005579352, "decode_ms": 13.790957978926599}, "total_wall_ms": 34.896833007223904, "ttft_ms": 18.072834005579352, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 685129728, "backend_memory": {"mlx_active_bytes": 12941448200, "mlx_peak_bytes": 12983751912, "mlx_cache_bytes": 9351930441, "process_rss_bytes": 685129728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12983751912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 2213 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4a95a42ce5dae116099d4ce3", "attempt_id": "2359f6db7a60", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:23.905407Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 38, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.516583957709372, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.398625030182302, "ttft_ms": 17.398625030182302, "decode_ms": 14.51616594567895}, "total_wall_ms": 34.9736250936985, "ttft_ms": 17.398625030182302, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 685129728, "backend_memory": {"mlx_active_bytes": 12941448200, "mlx_peak_bytes": 12983751912, "mlx_cache_bytes": 9351930441, "process_rss_bytes": 685129728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12983751912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2214 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "faf34a6f8b208aae9c40528b", "attempt_id": "6a62ae52b34e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:23.956455Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 51, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.7986249877139926, "receiver_prefill_ms": 0.0, "query_prefill_ms": 18.058957997709513, "ttft_ms": 18.058957997709513, "decode_ms": 68.7876669690013}, "total_wall_ms": 89.98491696547717, "ttft_ms": 18.058957997709513, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 685129728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12996121860, "mlx_cache_bytes": 9393679882, "process_rss_bytes": 685129728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12996121860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2215 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fa156e4dcc2a042a66db96b7", "attempt_id": "81157b303617", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.062399Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 45, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.7682500183582306, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.913540941663086, "ttft_ms": 17.913540941663086, "decode_ms": 28.56116695329547}, "total_wall_ms": 49.58724998869002, "ttft_ms": 17.913540941663086, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 685129728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12988863748, "mlx_cache_bytes": 9415552522, "process_rss_bytes": 685129728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12988863748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 2216 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "db39b42316967402ed118999", "attempt_id": "7babbc4f310e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.127959Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 54, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.6422088956460357, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.871459014713764, "ttft_ms": 17.871459014713764, "decode_ms": 82.6666250359267}, "total_wall_ms": 103.54683303739876, "ttft_ms": 17.871459014713764, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 685129728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12998317328, "mlx_cache_bytes": 9459006238, "process_rss_bytes": 685129728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12998317328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2217 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31ae00e42b18b155475f139e", "attempt_id": "f9c7746db816", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.247612Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 48, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.7876250203698874, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.781417001970112, "ttft_ms": 17.781417001970112, "decode_ms": 68.93979094456881}, "total_wall_ms": 89.87137500662357, "ttft_ms": 17.781417001970112, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 685129728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12993123588, "mlx_cache_bytes": 9486072606, "process_rss_bytes": 685129728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12993123588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,621,302", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "a46ed4448d11a7b9532c43042e2c176180613ee04e4946c1fe783689e38d71a0"} | ||||
| 2218 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "517a70f9fba4175966cddad8", "attempt_id": "f7010e7bcda4", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.353264Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 45, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.7278330633416772, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.79783400706947, "ttft_ms": 17.79783400706947, "decode_ms": 27.308166958391666}, "total_wall_ms": 48.22500003501773, "ttft_ms": 17.79783400706947, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 685162496, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12988863748, "mlx_cache_bytes": 9486072606, "process_rss_bytes": 685162496}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12988863748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not present", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "3372d1ec5334d2776ea4225e9caea4e5fade87ac9a0ac559cde930a39b8f5067"} | ||||
| 2219 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e8854be0cb8291423f5c246d", "attempt_id": "aa228646e6e3", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.417626Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 48, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.7722080228850245, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.55245798267424, "ttft_ms": 17.55245798267424, "decode_ms": 13.761041918769479}, "total_wall_ms": 34.40708410926163, "ttft_ms": 17.55245798267424, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 685162496, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12993123588, "mlx_cache_bytes": 9486072606, "process_rss_bytes": 685162496}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12993123588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2220 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a41e674641495995eb46b18f", "attempt_id": "5394fdba06bf", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.468172Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12884562952}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 1801, "keep": 450, "compress_ms": 13.484874973073602}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 50, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622483, "side_information_bytes": 12883, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 238.5046670679003, "doc_prefill_ms": 208.60083296429366, "compress_ms": 13.519875006750226, "serialize_ms": 13.790249940939248, "load_ms": 1.6722501022741199, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.641042009927332, "ttft_ms": 17.641042009927332, "decode_ms": 13.631500070914626}, "total_wall_ms": 34.20562495011836, "ttft_ms": 17.641042009927332, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 685162496, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12998071556, "mlx_cache_bytes": 9502636830, "process_rss_bytes": 685162496}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12998071556, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "f11f6ee81f484ee2e44c4824e5ca784e6becce5593bce8e895c90d4286d5ed4e", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 2221 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "357a7e3b0cdd4de04707186d", "attempt_id": "a9ba3ddc1909", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.518195Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 44, "compress_ms": 44.43020804319531}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 44, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622522, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.5702920537442, "doc_prefill_ms": 208.60083296429366, "compress_ms": 45.67191703245044, "serialize_ms": 9.71858308184892, "load_ms": 1.356916967779398, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.386957886628807, "ttft_ms": 17.386957886628807, "decode_ms": 96.72870906069875}, "total_wall_ms": 172.460375004448, "ttft_ms": 17.386957886628807, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 686063616, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12988388584, "mlx_cache_bytes": 9763240838, "process_rss_bytes": 686063616}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12988388584, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d0f34244583e46404ac842e3b40f7ffa603285868c194160cd5434b2517f40c8", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 2222 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "519ee3f0507b6e5e67928c91", "attempt_id": "bb87845bca26", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.706959Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 38, "compress_ms": 43.25937503017485}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 38, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622522, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.158749990165234, "doc_prefill_ms": 208.60083296429366, "compress_ms": 44.521624920889735, "serialize_ms": 9.444625000469387, "load_ms": 1.3879159232601523, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.382041085511446, "ttft_ms": 17.382041085511446, "decode_ms": 27.517916983924806}, "total_wall_ms": 101.85458301566541, "ttft_ms": 17.382041085511446, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 738361344, "backend_memory": {"mlx_active_bytes": 12941448200, "mlx_peak_bytes": 12983735528, "mlx_cache_bytes": 9784671110, "process_rss_bytes": 738361344}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12983735528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d0f34244583e46404ac842e3b40f7ffa603285868c194160cd5434b2517f40c8", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 2223 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b1468312a9aff2c0df9d8106", "attempt_id": "b15ba3bc19dd", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.825645Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 38, "compress_ms": 43.786499998532236}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 38, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622523, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.68525006249547, "doc_prefill_ms": 208.60083296429366, "compress_ms": 45.05679209250957, "serialize_ms": 7.455667015165091, "load_ms": 1.5161659102886915, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.22129201516509, "ttft_ms": 17.22129201516509, "decode_ms": 27.409167028963566}, "total_wall_ms": 100.24312499444932, "ttft_ms": 17.22129201516509, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 738377728, "backend_memory": {"mlx_active_bytes": 12941448200, "mlx_peak_bytes": 12983735528, "mlx_cache_bytes": 9784671110, "process_rss_bytes": 738377728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12983735528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a64c4b9b033176eb7a48c45f40c4dc3e8ad4ac4b1fce990ceb47b348f37b3737", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2224 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a99a5b18afb7ba5ea9ca9ec", "attempt_id": "272e1808f30e", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:24.942125Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 51, "compress_ms": 42.972209048457444}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 51, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622523, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.28679103311151, "doc_prefill_ms": 208.60083296429366, "compress_ms": 44.25408295355737, "serialize_ms": 7.856583106331527, "load_ms": 0.5484999855980277, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.800624947994947, "ttft_ms": 17.800624947994947, "decode_ms": 68.52820795029402}, "total_wall_ms": 140.59104199986905, "ttft_ms": 17.800624947994947, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 738377728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12996121860, "mlx_cache_bytes": 9793944454, "process_rss_bytes": 738377728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12996121860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a64c4b9b033176eb7a48c45f40c4dc3e8ad4ac4b1fce990ceb47b348f37b3737", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2225 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "425ba2e4cdd14e2802ae0048", "attempt_id": "c8f026e558d7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:25.098836Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 45, "compress_ms": 43.59050001949072}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 45, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622522, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 52.72754200268537, "doc_prefill_ms": 208.60083296429366, "compress_ms": 44.813624932430685, "serialize_ms": 7.740042055957019, "load_ms": 1.548707950860262, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.567750066518784, "ttft_ms": 17.567750066518784, "decode_ms": 69.44533297792077}, "total_wall_ms": 142.65237504150718, "ttft_ms": 17.567750066518784, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 738377728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12988863748, "mlx_cache_bytes": 9802283910, "process_rss_bytes": 738377728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12988863748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,377,480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d0f34244583e46404ac842e3b40f7ffa603285868c194160cd5434b2517f40c8", "output_hash": "ec4c68b327a2d2427ed21821415a5f9ddf87134bd9f654bdd69c7d1301febcb0"} | ||||
| 2226 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4fbb455f1db4482ff2830834", "attempt_id": "bd22f992cbf9", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:25.258204Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 54, "compress_ms": 43.735292041674256}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 54, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622523, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.20370795764029, "doc_prefill_ms": 208.60083296429366, "compress_ms": 45.000792015343904, "serialize_ms": 9.001208003610373, "load_ms": 1.3392920373007655, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.376833013258874, "ttft_ms": 17.376833013258874, "decode_ms": 83.88012507930398}, "total_wall_ms": 158.28741702716798, "ttft_ms": 17.376833013258874, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 738377728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12998317328, "mlx_cache_bytes": 9830185862, "process_rss_bytes": 738377728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12998317328, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a64c4b9b033176eb7a48c45f40c4dc3e8ad4ac4b1fce990ceb47b348f37b3737", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2227 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1eb685f8306c376d4f275a03", "attempt_id": "3f292148a144", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:25.433462Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 48, "compress_ms": 43.523750035092235}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 48, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622523, "side_information_bytes": 12923, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 56.75962509121746, "doc_prefill_ms": 208.60083296429366, "compress_ms": 44.7707501007244, "serialize_ms": 11.806666036136448, "load_ms": 1.4489589957520366, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.54870906006545, "ttft_ms": 17.54870906006545, "decode_ms": 68.67875007446855}, "total_wall_ms": 145.84041701164097, "ttft_ms": 17.54870906006545, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 738377728, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12993123588, "mlx_cache_bytes": 9850878854, "process_rss_bytes": 738377728}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12993123588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,104,450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "a64c4b9b033176eb7a48c45f40c4dc3e8ad4ac4b1fce990ceb47b348f37b3737", "output_hash": "be5d9198843a8259814eb8d800574dc34f840ce8195b4282d6779f91a4805ca0"} | ||||
| 2228 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bfb8f737f80c35a3b53b48f5", "attempt_id": "bcba68a233aa", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:25.596037Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 45, "compress_ms": 43.92874997574836}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 45, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622522, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 55.27825001627207, "doc_prefill_ms": 208.60083296429366, "compress_ms": 45.14541698154062, "serialize_ms": 9.947292041033506, "load_ms": 1.499375095590949, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.372542060911655, "ttft_ms": 17.372542060911655, "decode_ms": 41.82162508368492}, "total_wall_ms": 117.46316705830395, "ttft_ms": 17.372542060911655, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 45}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 738394112, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12988863748, "mlx_cache_bytes": 9850878854, "process_rss_bytes": 738394112}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12988863748, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.78", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d0f34244583e46404ac842e3b40f7ffa603285868c194160cd5434b2517f40c8", "output_hash": "a613b48bf860be3904729751229f821c4082791d1c6f55636e6739c278603835"} | ||||
| 2229 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5056f0415be568a283a102f3", "attempt_id": "c13b324ceec1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:25.730396Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 48, "compress_ms": 43.27633301727474}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 48, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622522, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 54.86649996601045, "doc_prefill_ms": 208.60083296429366, "compress_ms": 44.52612507157028, "serialize_ms": 10.143082938157022, "load_ms": 1.2924160109832883, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.514709034003317, "ttft_ms": 17.514709034003317, "decode_ms": 13.626207946799695}, "total_wall_ms": 88.73437508009374, "ttft_ms": 17.514709034003317, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 738410496, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12993123588, "mlx_cache_bytes": 9850878854, "process_rss_bytes": 738410496}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12993123588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d0f34244583e46404ac842e3b40f7ffa603285868c194160cd5434b2517f40c8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2230 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ffa4f3ff6bcd888af30591c3", "attempt_id": "30f5d3804d6f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:25.835575Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12832265224}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 1801, "keep": 450, "window_tokens": 50, "compress_ms": 43.80054189823568}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 50, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 51609600, "serialized_payload_bytes": 51622522, "side_information_bytes": 12922, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 57.51779198180884, "doc_prefill_ms": 208.60083296429366, "compress_ms": 45.025042025372386, "serialize_ms": 12.311667087487876, "load_ms": 1.356333028525114, "receiver_prefill_ms": 0.0, "query_prefill_ms": 17.426042002625763, "ttft_ms": 17.426042002625763, "decode_ms": 13.619582983665168}, "total_wall_ms": 91.30833309609443, "ttft_ms": 17.426042002625763, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 738426880, "backend_memory": {"mlx_active_bytes": 12943283208, "mlx_peak_bytes": 12994893060, "mlx_cache_bytes": 9871981446, "process_rss_bytes": 738426880}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 12994893060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d0f34244583e46404ac842e3b40f7ffa603285868c194160cd5434b2517f40c8", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2231 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9687ac4943b0bbfb258ca7a1", "attempt_id": "6ed6f70ea135", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:25.972467Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 44, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 3.102000104263425, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.41858294978738, "ttft_ms": 20.41858294978738, "decode_ms": 106.33837501518428}, "total_wall_ms": 131.2118750065565, "ttft_ms": 20.41858294978738, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057053704, "mlx_peak_bytes": 13143051645, "mlx_cache_bytes": 10119826694, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13143051645, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ZW-73S-2197", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "5ab36a19a647e8707dc0e01150dbfc0b49554c16496650f6b32f847c5e5bdf04"} | ||||
| 2232 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0bd5d52af1cb11f964539951", "attempt_id": "780a2027d264", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:26.120446Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 38, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.2672080667689443, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.294124959036708, "ttft_ms": 20.294124959036708, "decode_ms": 29.860833077691495}, "total_wall_ms": 53.72750002425164, "ttft_ms": 20.294124959036708, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057053704, "mlx_peak_bytes": 13134936128, "mlx_cache_bytes": 10144081094, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13134936128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "5f9a2b795615ba6a3d5455fd5624d773fbca5bcd16249c421fd37411dc9837da"} | ||||
| 2233 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dd4d6844d88ad0d743a3a985", "attempt_id": "195c752c0a7d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:26.190510Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 38, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.3025409318506718, "receiver_prefill_ms": 0.0, "query_prefill_ms": 19.87150008790195, "ttft_ms": 19.87150008790195, "decode_ms": 29.59466597530991}, "total_wall_ms": 53.05945803411305, "ttft_ms": 19.87150008790195, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057053704, "mlx_peak_bytes": 13135002432, "mlx_cache_bytes": 10144081094, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13135002432, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2234 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0226c62b7dab20ce0aebe11d", "attempt_id": "e5b0a275cc3d", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:26.259695Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 51, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.1694160532206297, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.602459087967873, "ttft_ms": 20.602459087967873, "decode_ms": 74.93312505539507}, "total_wall_ms": 98.99337508250028, "ttft_ms": 20.602459087967873, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 51}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057971208, "mlx_peak_bytes": 13139931200, "mlx_cache_bytes": 10278093990, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13139931200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,199,125", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "f5f7ba5ec2f9b2364ec9e09349c810ade23d11404d04c3b17cea227797de4e79"} | ||||
| 2235 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9be70604683944fc9e437c11", "attempt_id": "291ffc446177", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:26.374902Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 45, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.1687080152332783, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.091540995053947, "ttft_ms": 20.091540995053947, "decode_ms": 75.00674994662404}, "total_wall_ms": 98.64579199347645, "ttft_ms": 20.091540995053947, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057053704, "mlx_peak_bytes": 13144165616, "mlx_cache_bytes": 10307002566, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13144165616, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,377,480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "ec4c68b327a2d2427ed21821415a5f9ddf87134bd9f654bdd69c7d1301febcb0"} | ||||
| 2236 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1e8edea9b02d1f8b37711fab", "attempt_id": "8b3f038e56ce", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:26.490474Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 54, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.2362909512594342, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.81662497948855, "ttft_ms": 20.81662497948855, "decode_ms": 90.0258329929784}, "total_wall_ms": 114.3756250385195, "ttft_ms": 20.81662497948855, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057971208, "mlx_peak_bytes": 13143405004, "mlx_cache_bytes": 10365780614, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13143405004, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Pragamfel-2", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "f0df32e3152d54160c1f3bdeb20ad87cbc7e1efcd3ea28c84ac1d2be0ed97c7a"} | ||||
| 2237 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0f98ff5d129cc66c8f391bd", "attempt_id": "a0a7ef1ea25b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:26.621093Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 48, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.30620801448822, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.42045898269862, "ttft_ms": 20.42045898269862, "decode_ms": 595.1891250442713}, "total_wall_ms": 619.2588330013677, "ttft_ms": 20.42045898269862, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 48}, "output_usage": {"output_tokens": 40}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13059806216, "mlx_peak_bytes": 13148328592, "mlx_cache_bytes": 10642260614, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13148328592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,104,225 + 1,253,225 + 1,806,025 + 1,806,025 + 3,621,302 = 9,530,802", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "a3d682dc2b8e4a3a44deb325237b4aef100854654333b589d28c8a4ae0d2f52b"} | ||||
| 2238 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1bcf5440598289e4b406393", "attempt_id": "046e31d6bc74", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:27.256766Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 45, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.2313330555334687, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.18045901786536, "ttft_ms": 20.18045901786536, "decode_ms": 59.31429204065353}, "total_wall_ms": 83.06670794263482, "ttft_ms": 20.18045901786536, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 45}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057053704, "mlx_peak_bytes": 13144163420, "mlx_cache_bytes": 10645013126, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13144163420, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "22.78 km", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "1ce58f692fb529015a5128c6624af329950b0f5314985326dc7df24c465cad98"} | ||||
| 2239 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8e340d5f2d28103e920fa708", "attempt_id": "e8789c18dc0a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:27.356438Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 48, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 2.262542024254799, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.1185840414837, "ttft_ms": 20.1185840414837, "decode_ms": 15.10966697242111}, "total_wall_ms": 38.825124967843294, "ttft_ms": 20.1185840414837, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057053704, "mlx_peak_bytes": 13148328592, "mlx_cache_bytes": 10645013126, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13148328592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2240 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "75703131671f628db1d00405", "attempt_id": "9cf96c3ebb10", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:27.412001Z", "task_family": "synthetic", "document_id": "syn_03015_2000", "document_hash": "71a7284b9bc3f681d69d91d18b9e8d45a4dda486cd14f4145395786ac6a68a89", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03015_2000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12943283208}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 1741, "source_tokens_receiver": 1741, "query_tokens": 50, "message_tokens": 1801, "message_utf8_bytes": 7177, "cache_tensor_bytes": 109731328, "serialized_payload_bytes": 109758444, "side_information_bytes": 27116, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 29.28708295803517, "doc_prefill_ms": 208.60083296429366, "compress_ms": 9.993541054427624, "serialize_ms": 19.020334002561867, "load_ms": 1.7645839834585786, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.546167041175067, "ttft_ms": 20.546167041175067, "decode_ms": 15.331416041590273}, "total_wall_ms": 38.987417006865144, "ttft_ms": 20.546167041175067, "input_usage": {"receiver_prefix_tokens": 1801, "dense_cache_bytes": 206553088, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 959152128, "backend_memory": {"mlx_active_bytes": 13057053704, "mlx_peak_bytes": 13151670928, "mlx_cache_bytes": 10676617862, "process_rss_bytes": 959152128}, "peak_prefill_memory": 13277917444, "peak_decode_memory": 13151670928, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03015_2000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b70553932981c46144f16a0b5009eea5d009e7f7db6d50b4fecb6a83c681b6fc", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2241 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a44502d755d5b09069a63b2c", "attempt_id": "ddd23dd2bbc7", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:27.527219Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5887, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 741.2559580989182, "ttft_ms": 14.286291087046266, "decode_ms": 142.2710840124637}, "total_wall_ms": 909.2134159291163, "ttft_ms": 14.286291087046266, "input_usage": {"receiver_prompt_tokens": 5887}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 822886400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 2573153720, "process_rss_bytes": 822886400}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 2242 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5458e979c281a93c012f63bc", "attempt_id": "cb44ce2cc75f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:28.461683Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 775.3647080389783, "ttft_ms": 14.303707983344793, "decode_ms": 14.534374931827188}, "total_wall_ms": 812.7253750571981, "ttft_ms": 14.303707983344793, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 822919168, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3273094584, "process_rss_bytes": 822919168}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2243 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "95a51374bac20d23263962ed", "attempt_id": "99429aba1308", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:29.296768Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5877, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 822.1203329740092, "ttft_ms": 14.575749984942377, "decode_ms": 14.286540914326906}, "total_wall_ms": 859.6711669815704, "ttft_ms": 14.575749984942377, "input_usage": {"receiver_prompt_tokens": 5877}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 822951936, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3273094584, "process_rss_bytes": 822951936}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2244 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6c57a7f7e6e3aa28b5e1432c", "attempt_id": "bd1c60d45c38", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:30.178859Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5893, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 828.2764169853181, "ttft_ms": 14.576083980500698, "decode_ms": 98.68816705420613}, "total_wall_ms": 950.0209999969229, "ttft_ms": 14.576083980500698, "input_usage": {"receiver_prompt_tokens": 5893}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 822984704, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 3990599096, "process_rss_bytes": 822984704}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7430110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "3781b0f7175e64bec5fc4e06e8c55b65284738b62891371384a1ee1dc8c3cfe9"} | ||||
| 2245 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7e9f040dc2191bd1ecb6826b", "attempt_id": "152812ca1633", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:31.151770Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5886, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 808.4232918918133, "ttft_ms": 14.650417026132345, "decode_ms": 100.69683298934251}, "total_wall_ms": 932.4220000999048, "ttft_ms": 14.650417026132345, "input_usage": {"receiver_prompt_tokens": 5886}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 823017472, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 4305696184, "process_rss_bytes": 823017472}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9844780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "771079f9bfa4045cea40b41caf04207b1c83e8ae61d7b82ef1421eae53276f16"} | ||||
| 2246 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d2f1842a377bce16aa5df627", "attempt_id": "c1908575ce02", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:32.106657Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5895, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 821.5971250319853, "ttft_ms": 14.028958044946194, "decode_ms": 99.09412497654557}, "total_wall_ms": 943.2315829908475, "ttft_ms": 14.028958044946194, "input_usage": {"receiver_prompt_tokens": 5895}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 823066624, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5013059000, "process_rss_bytes": 823066624}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2247 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "722e44446826153812e1d8b5", "attempt_id": "9c6186691d7f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:33.072626Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5888, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 823.9950409624726, "ttft_ms": 14.353208942338824, "decode_ms": 114.49220799840987}, "total_wall_ms": 961.4244590047747, "ttft_ms": 14.353208942338824, "input_usage": {"receiver_prompt_tokens": 5888}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 823099392, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5504644536, "process_rss_bytes": 823099392}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20884505", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "8750c6e2aa7d75be10f70e25809291c9880c4d5f85455aa03f4853cccca52f20"} | ||||
| 2248 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9e5f0e756ac1d5d6c2c2bd58", "attempt_id": "780919fdfdcd", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:34.056523Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5885, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 826.8837499199435, "ttft_ms": 14.629999990575016, "decode_ms": 72.31095794122666}, "total_wall_ms": 922.5630410946906, "ttft_ms": 14.629999990575016, "input_usage": {"receiver_prompt_tokens": 5885}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 823148544, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 5680412088, "process_rss_bytes": 823148544}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "73ffe585bc3e90cd98dbd9f9c29d075d23f2515d4ccc26e07934d3414d8feabd"} | ||||
| 2249 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "32e9f1e99c9a1d5f69bc3ca8", "attempt_id": "1bf977b0554b", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:35.001468Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5889, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 818.5708749806508, "ttft_ms": 15.847124974243343, "decode_ms": 14.057417050935328}, "total_wall_ms": 856.9048750214279, "ttft_ms": 15.847124974243343, "input_usage": {"receiver_prompt_tokens": 5889}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823181312, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 6172194232, "process_rss_bytes": 823181312}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2250 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7ab31734af3840f94b329190", "attempt_id": "1f7f00334016", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:35.881016Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 5890, "message_tokens": 5802, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.015833997167646885, "decode_payload_ms": 0.0, "receiver_prefill_ms": 855.7773750508204, "ttft_ms": 14.642874943092465, "decode_ms": 14.45670798420906}, "total_wall_ms": 893.5385840013623, "ttft_ms": 14.642874943092465, "input_usage": {"receiver_prompt_tokens": 5890}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823214080, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13580981312, "mlx_cache_bytes": 6664369592, "process_rss_bytes": 823214080}, "peak_prefill_memory": null, "peak_decode_memory": 13580981312, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2251 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f4697c22d5a44f0c625065c5", "attempt_id": "a578c7c29e88", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:40.785040Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 312, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.44191697984934, "ttft_ms": 13.348166947253048, "decode_ms": 13.461583061143756}, "total_wall_ms": 72.6293750340119, "ttft_ms": 13.348166947253048, "input_usage": {"receiver_prompt_tokens": 312, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12863560012, "mlx_cache_bytes": 7657474708, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12863560012, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2252 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a2c12d1f2c1fa07417604bf", "attempt_id": "ac907d37d683", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:40.880831Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 302, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.19891710858792, "ttft_ms": 13.450541067868471, "decode_ms": 13.633124995976686}, "total_wall_ms": 72.12462497409433, "ttft_ms": 13.450541067868471, "input_usage": {"receiver_prompt_tokens": 302, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12856514892, "mlx_cache_bytes": 7893863060, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12856514892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2253 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "262c4b4052b09e0620253ed8", "attempt_id": "f090a74ea8ea", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:40.975216Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 302, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 43.9103749813512, "ttft_ms": 13.605040963739157, "decode_ms": 13.29162495676428}, "total_wall_ms": 71.69512496329844, "ttft_ms": 13.605040963739157, "input_usage": {"receiver_prompt_tokens": 302, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12856514892, "mlx_cache_bytes": 7893863060, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12856514892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2254 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e75a4181d0980fadd328157a", "attempt_id": "f751f4b2756b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:41.070140Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 318, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.30329194292426, "ttft_ms": 13.299791957251728, "decode_ms": 13.39016598649323}, "total_wall_ms": 71.84295798651874, "ttft_ms": 13.299791957251728, "input_usage": {"receiver_prompt_tokens": 318, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12868737380, "mlx_cache_bytes": 8153124744, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12868737380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2255 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "80975415a6f83930a62752f8", "attempt_id": "4a1f0bff2bce", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:41.164644Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 311, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 43.663083924911916, "ttft_ms": 13.130040955729783, "decode_ms": 13.265541987493634}, "total_wall_ms": 70.95779199153185, "ttft_ms": 13.130040955729783, "input_usage": {"receiver_prompt_tokens": 311, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12863297868, "mlx_cache_bytes": 8214073224, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12863297868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2256 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8009210351ed93ded24623f7", "attempt_id": "f6f5af81a3e6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:41.258408Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 320, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.563041999936104, "ttft_ms": 13.23079108260572, "decode_ms": 93.01037504337728}, "total_wall_ms": 151.77624998614192, "ttft_ms": 13.23079108260572, "input_usage": {"receiver_prompt_tokens": 320, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12869917036, "mlx_cache_bytes": 8389317764, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12869917036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2257 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "13740ef2adb9d05ca3cdbaa7", "attempt_id": "7848df082b6e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:41.432526Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 313, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.73704204428941, "ttft_ms": 13.227542047388852, "decode_ms": 13.472917024046183}, "total_wall_ms": 72.4583329865709, "ttft_ms": 13.227542047388852, "input_usage": {"receiver_prompt_tokens": 313, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12864215396, "mlx_cache_bytes": 8560759940, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12864215396, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2258 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3fd7bdb138e7d4b3f3787a30", "attempt_id": "9a4b9370a73e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:41.529960Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 310, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.17087498586625, "ttft_ms": 13.303875108249485, "decode_ms": 13.215749990195036}, "total_wall_ms": 71.60479191225022, "ttft_ms": 13.303875108249485, "input_usage": {"receiver_prompt_tokens": 310, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12862773580, "mlx_cache_bytes": 8669811844, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12862773580, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2259 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f219ffe8da0ec107bfb3abbe", "attempt_id": "2e305ec15e1e", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:41.623418Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 314, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.545916956849396, "ttft_ms": 13.372041983529925, "decode_ms": 13.212625053711236}, "total_wall_ms": 72.01529201120138, "ttft_ms": 13.372041983529925, "input_usage": {"receiver_prompt_tokens": 314, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12879534436, "mlx_cache_bytes": 8858604676, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12879534436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2260 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a87f90724afb22ca293a2d13", "attempt_id": "636f38f5d26b", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:41.717720Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 315, "message_tokens": 223, "message_utf8_bytes": 1199, "cache_tensor_bytes": null, "serialized_payload_bytes": 1199, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3987.932250020094, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.480916927568614, "ttft_ms": 13.506334042176604, "decode_ms": 13.26495804823935}, "total_wall_ms": 72.12733395863324, "ttft_ms": 13.506334042176604, "input_usage": {"receiver_prompt_tokens": 315, "sender_input_tokens": 5918, "sender_output_tokens": 223, "sender_prefill_ms": 864.0557089820504, "sender_ttft_ms": 14.465083950199187, "sender_decode_ms": 3101.9324579974636}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823672832, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12881582460, "mlx_cache_bytes": 9030964356, "process_rss_bytes": 823672832}, "peak_prefill_memory": null, "peak_decode_memory": 12881582460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c89c14a01f716c2c2bef0db3629e8f72e3f4b9969b9df39d0946ec6a6ef5788f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2261 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eb3ac7d4e5ebf7d95cd30f36", "attempt_id": "01494c9fce2a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:47.326882Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 326, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.350458986125886, "ttft_ms": 13.137459056451917, "decode_ms": 13.643166981637478}, "total_wall_ms": 74.40304092597216, "ttft_ms": 13.137459056451917, "input_usage": {"receiver_prompt_tokens": 326, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823803904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12875438468, "mlx_cache_bytes": 10275969432, "process_rss_bytes": 823803904}, "peak_prefill_memory": null, "peak_decode_memory": 12875438468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2262 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6865b815609e600c2f2f8726", "attempt_id": "be65d47ba174", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:47.423809Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 316, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.499624986201525, "ttft_ms": 13.290207949467003, "decode_ms": 13.32341693341732}, "total_wall_ms": 71.89962500706315, "ttft_ms": 13.290207949467003, "input_usage": {"receiver_prompt_tokens": 316, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823803904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882368892, "mlx_cache_bytes": 10449115544, "process_rss_bytes": 823803904}, "peak_prefill_memory": null, "peak_decode_memory": 12882368892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2263 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c2e28546569e4c567e4cb15", "attempt_id": "5bf21aab9caa", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:47.518134Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 316, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 44.401666964404285, "ttft_ms": 13.357500080019236, "decode_ms": 13.393083936534822}, "total_wall_ms": 71.91137492191046, "ttft_ms": 13.357500080019236, "input_usage": {"receiver_prompt_tokens": 316, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823803904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12882368892, "mlx_cache_bytes": 10449115544, "process_rss_bytes": 823803904}, "peak_prefill_memory": null, "peak_decode_memory": 12882368892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2264 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "af7c66f0ce775bb1d20ac30e", "attempt_id": "05f30f3ca034", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:47.612483Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 332, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.439000056125224, "ttft_ms": 13.330833055078983, "decode_ms": 13.077749987132847}, "total_wall_ms": 73.59366596210748, "ttft_ms": 13.330833055078983, "input_usage": {"receiver_prompt_tokens": 332, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823803904, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12879780252, "mlx_cache_bytes": 10602782404, "process_rss_bytes": 823803904}, "peak_prefill_memory": null, "peak_decode_memory": 12879780252, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2265 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25d9fd498317761432c1cb82", "attempt_id": "f4bcc94981a9", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:47.707793Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 325, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 45.93925003428012, "ttft_ms": 13.847957947291434, "decode_ms": 13.631500070914626}, "total_wall_ms": 74.21070791315287, "ttft_ms": 13.847957947291434, "input_usage": {"receiver_prompt_tokens": 325, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823820288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12875176324, "mlx_cache_bytes": 10666483396, "process_rss_bytes": 823820288}, "peak_prefill_memory": null, "peak_decode_memory": 12875176324, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2266 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "833c42e8b61cc0c56687b764", "attempt_id": "b3a937de41bf", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:47.804501Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 334, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.20333400089294, "ttft_ms": 13.176499982364476, "decode_ms": 80.33566607628018}, "total_wall_ms": 140.47112490516156, "ttft_ms": 13.176499982364476, "input_usage": {"receiver_prompt_tokens": 334, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 823820288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12881795492, "mlx_cache_bytes": 10810467320, "process_rss_bytes": 823820288}, "peak_prefill_memory": null, "peak_decode_memory": 12881795492, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithwenmel-8", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "0275a3d12ae1ee50f2a2f4bb23111a75c1f3042a81d7db98d6f8c8f7298ddb1b"} | ||||
| 2267 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cc70a905991e058b17af60c9", "attempt_id": "9d982db64808", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:47.967262Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 327, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.116790967062116, "ttft_ms": 13.228958006948233, "decode_ms": 13.889375026337802}, "total_wall_ms": 74.03820799663663, "ttft_ms": 13.228958006948233, "input_usage": {"receiver_prompt_tokens": 327, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823820288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12876093852, "mlx_cache_bytes": 10989642744, "process_rss_bytes": 823820288}, "peak_prefill_memory": null, "peak_decode_memory": 12876093852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2268 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7c7398e9da0835c429e5ae08", "attempt_id": "33e98a622d5d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.063777Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 324, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.2774169864133, "ttft_ms": 13.390792068094015, "decode_ms": 13.404833036474884}, "total_wall_ms": 73.84500000625849, "ttft_ms": 13.390792068094015, "input_usage": {"receiver_prompt_tokens": 324, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823820288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12887873924, "mlx_cache_bytes": 11120927736, "process_rss_bytes": 823820288}, "peak_prefill_memory": null, "peak_decode_memory": 12887873924, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2269 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27aca5042cb4ee3983b705a1", "attempt_id": "74c17aa5bb3a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.160161Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 328, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.653375029563904, "ttft_ms": 13.617750024423003, "decode_ms": 13.395083951763809}, "total_wall_ms": 74.44758398924023, "ttft_ms": 13.617750024423003, "input_usage": {"receiver_prompt_tokens": 328, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823820288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12876618140, "mlx_cache_bytes": 11300627448, "process_rss_bytes": 823820288}, "peak_prefill_memory": null, "peak_decode_memory": 12876618140, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2270 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28552868ac01beaed3fbd403", "attempt_id": "d18eb1ef196f", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.256897Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 329, "message_tokens": 226, "message_utf8_bytes": 618, "cache_tensor_bytes": null, "serialized_payload_bytes": 618, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 5514.394249999896, "decode_payload_ms": 0.0, "receiver_prefill_ms": 46.17987503297627, "ttft_ms": 13.286417000927031, "decode_ms": 13.261541025713086}, "total_wall_ms": 73.46120895817876, "ttft_ms": 13.286417000927031, "input_usage": {"receiver_prompt_tokens": 329, "sender_input_tokens": 5946, "sender_output_tokens": 338, "sender_prefill_ms": 789.7189999930561, "sender_ttft_ms": 14.449457987211645, "sender_decode_ms": 4702.1975830430165}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823820288, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12877011356, "mlx_cache_bytes": 11480720376, "process_rss_bytes": 823820288}, "peak_prefill_memory": null, "peak_decode_memory": 12877011356, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 6, "unresolved_quotes": 5, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "2639256956b5ec77d7868d896da5c900113035ddbd66116b2a3b0a1a9687c384", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2271 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "954bd62c34283e27143c9b39", "attempt_id": "82f821a1de39", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.356678Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 593, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.24883304256946, "ttft_ms": 13.523166999220848, "decode_ms": 13.158542104065418}, "total_wall_ms": 97.91245800442994, "ttft_ms": 13.523166999220848, "input_usage": {"receiver_prompt_tokens": 593}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 11874198520, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2272 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "62a84ede023c3213b8ab34ae", "attempt_id": "577c252c9bb9", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.476626Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 583, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.7410840075463, "ttft_ms": 13.265417073853314, "decode_ms": 13.33595800679177}, "total_wall_ms": 97.33241703361273, "ttft_ms": 13.265417073853314, "input_usage": {"receiver_prompt_tokens": 583}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12985295960, "mlx_cache_bytes": 12214428664, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 12985295960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2273 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "02d521af3ab2f88eb60661e8", "attempt_id": "cc133bf74850", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.596924Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 583, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 68.96383396815509, "ttft_ms": 13.24295811355114, "decode_ms": 13.364083017222583}, "total_wall_ms": 96.56633401755244, "ttft_ms": 13.24295811355114, "input_usage": {"receiver_prompt_tokens": 583}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12985295960, "mlx_cache_bytes": 12214428664, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 12985295960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2274 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c2d8cfdfe82081768cd8330e", "attempt_id": "ee1c77e144e9", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.715919Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 599, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.0622919248417, "ttft_ms": 13.881542021408677, "decode_ms": 93.47308403812349}, "total_wall_ms": 178.42379107605666, "ttft_ms": 13.881542021408677, "input_usage": {"receiver_prompt_tokens": 599}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994929752, "mlx_cache_bytes": 12563899384, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 12994929752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7430110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "3781b0f7175e64bec5fc4e06e8c55b65284738b62891371384a1ee1dc8c3cfe9"} | ||||
| 2275 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26eebb6dd201ad4aa12258cb", "attempt_id": "a7b55d05dc9c", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:48.917196Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 592, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.63220797479153, "ttft_ms": 13.386290986090899, "decode_ms": 93.7797500519082}, "total_wall_ms": 177.80649999622256, "ttft_ms": 13.386290986090899, "input_usage": {"receiver_prompt_tokens": 592}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990702680, "mlx_cache_bytes": 12563899384, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 12990702680, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7430110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "3781b0f7175e64bec5fc4e06e8c55b65284738b62891371384a1ee1dc8c3cfe9"} | ||||
| 2276 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6e02f5c08116b7cf84d918fc", "attempt_id": "b80a2c8428f2", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:49.117301Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 601, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.54262503515929, "ttft_ms": 13.60558404121548, "decode_ms": 66.97566597722471}, "total_wall_ms": 152.15458301827312, "ttft_ms": 13.60558404121548, "input_usage": {"receiver_prompt_tokens": 601}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993356888, "mlx_cache_bytes": 12811035640, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 12993356888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Soltek-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "afeabbb13c97073235bda8ee98e604768e20ddd816bcc53f1cf102c9aefab62c"} | ||||
| 2277 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1d0b8dd0bb2083602e7356a6", "attempt_id": "cc131b157fae", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:49.291921Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 594, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.03870897460729, "ttft_ms": 13.48120893817395, "decode_ms": 106.878999969922}, "total_wall_ms": 191.43983302637935, "ttft_ms": 13.48120893817395, "input_usage": {"receiver_prompt_tokens": 594}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13012378712, "mlx_cache_bytes": 13077193720, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 13012378712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "19748457", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "e08b7639cf94e4ebfc057fcc3509e63eb89ee002cc27a986cbf392f6a1c31f1f"} | ||||
| 2278 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e8ca10d30f889d152448fc53", "attempt_id": "81779e57f9a6", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:49.505548Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 591, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.70591598656029, "ttft_ms": 13.465250027365983, "decode_ms": 94.25441699568182}, "total_wall_ms": 178.5789169371128, "ttft_ms": 13.465250027365983, "input_usage": {"receiver_prompt_tokens": 591}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989817944, "mlx_cache_bytes": 13320102904, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 12989817944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7430.11", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "29469d59bbce0f3e5c1bef78b04ee89ef9bd3fe3e4ac1ad50c6cbf837eda6831"} | ||||
| 2279 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dfa01118d8afccce57031d74", "attempt_id": "f4fbe1cef5f5", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:49.706816Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 595, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.1992919202894, "ttft_ms": 13.68162501603365, "decode_ms": 13.428500038571656}, "total_wall_ms": 98.34087500348687, "ttft_ms": 13.68162501603365, "input_usage": {"receiver_prompt_tokens": 595}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010412632, "mlx_cache_bytes": 13564781560, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 13010412632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2280 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1362435d6e1741fdf4d35109", "attempt_id": "549b557d8a78", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:49.827726Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 508, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 596, "message_tokens": 507, "message_utf8_bytes": 1258, "cache_tensor_bytes": null, "serialized_payload_bytes": 1258, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.275292041711509, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.98437503352761, "ttft_ms": 13.341790996491909, "decode_ms": 13.653874979354441}, "total_wall_ms": 97.95720805414021, "ttft_ms": 13.341790996491909, "input_usage": {"receiver_prompt_tokens": 596}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 823836672, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010805848, "mlx_cache_bytes": 13809853432, "process_rss_bytes": 823836672}, "peak_prefill_memory": null, "peak_decode_memory": 13010805848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "8090ce242bb9c79e0f1bac16c5e5a85e7a89fd4f115d6e2f00eabab2abaa515f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2281 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a47c4336cfeaba912cb1ab8", "attempt_id": "f014096893ce", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:50.753573Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 46, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.2070420198142529, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.25537500716746, "ttft_ms": 26.25537500716746, "decode_ms": 42.05033299513161}, "total_wall_ms": 73.75412492547184, "ttft_ms": 26.25537500716746, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 46}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977116408, "mlx_cache_bytes": 14278157673, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977116408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "NotProvided", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "a8da256cab6983d83636f7a669ac93f2dde30127260d7d17103e68ec8141c0e4"} | ||||
| 2282 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "415244dca016631abec503c6", "attempt_id": "fe5f875d69ec", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:50.850026Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.7630000365898013, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.781291955150664, "ttft_ms": 24.781291955150664, "decode_ms": 13.856292003765702}, "total_wall_ms": 44.7978749871254, "ttft_ms": 24.781291955150664, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12968318200, "mlx_cache_bytes": 14309303657, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968318200, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2283 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "edc3885de0bef34954f88bc8", "attempt_id": "fb8c070f33ad", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:50.917306Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.6894169384613633, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.60724995378405, "ttft_ms": 23.60724995378405, "decode_ms": 13.877833029255271}, "total_wall_ms": 43.58937498182058, "ttft_ms": 23.60724995378405, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12968465656, "mlx_cache_bytes": 14309303657, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968465656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2284 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6ddcb9299bb109c4736b8ccf", "attempt_id": "71f54f8b558f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:50.983341Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 52, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.8424999434500933, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.577624931931496, "ttft_ms": 23.577624931931496, "decode_ms": 110.37587490864098}, "total_wall_ms": 140.14287502504885, "ttft_ms": 23.577624931931496, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 52}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981884176, "mlx_cache_bytes": 14358963977, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981884176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15750000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "decbd95d6182e9e8ba96a78e9319381a600305745312e4e6e965d523cfdae680"} | ||||
| 2285 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fa361a1357de73354b071fee", "attempt_id": "beeea5343797", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:51.148011Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 45, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.7942909616976976, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.631124990060925, "ttft_ms": 23.631124990060925, "decode_ms": 110.14741600956768}, "total_wall_ms": 139.79191600810736, "ttft_ms": 23.631124990060925, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 45}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976805112, "mlx_cache_bytes": 14372646642, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976805112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15000000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "3eb1335461b8166081d2f74625d1fce8249a30968ba8b4a91bc1c2f5474661da"} | ||||
| 2286 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5425ea2f09c25eba7f5f50e", "attempt_id": "8cc6a04baa9a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:51.310820Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 54, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.8375420477241278, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.810666985809803, "ttft_ms": 23.810666985809803, "decode_ms": 97.0976670505479}, "total_wall_ms": 127.08474998362362, "ttft_ms": 23.810666985809803, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12984292632, "mlx_cache_bytes": 14410461346, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12984292632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2287 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "15a33bedf3e6e32286cc9611", "attempt_id": "428aaf8020de", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:51.460851Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 47, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 0.7263749139383435, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.23833294212818, "ttft_ms": 23.23833294212818, "decode_ms": 96.59587498754263}, "total_wall_ms": 125.00112492125481, "ttft_ms": 23.23833294212818, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977952016, "mlx_cache_bytes": 14410461346, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977952016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9344925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "9cd403c974ede5347798859560e5a95f548bc9574d23364595539a5bb7d61a00"} | ||||
| 2288 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a58495cb2dbef567020091c", "attempt_id": "d0aea0b69683", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:51.608357Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 44, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.647000084631145, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.254792042076588, "ttft_ms": 22.254792042076588, "decode_ms": 84.44908389355987}, "total_wall_ms": 112.48970893211663, "ttft_ms": 22.254792042076588, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 44}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12975756536, "mlx_cache_bytes": 14441541794, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975756536, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "120000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "4f9f73b34c5b89879aad65a48025f3187dd9ce6dc3d4e88eecb2fc79227350f1"} | ||||
| 2289 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8cef2735ccd2e3ab4ad84f83", "attempt_id": "c6622fdc4c85", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:51.743741Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 48, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.736916950903833, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.27145799063146, "ttft_ms": 23.27145799063146, "decode_ms": 13.786708004772663}, "total_wall_ms": 43.08795905672014, "ttft_ms": 23.27145799063146, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12978509072, "mlx_cache_bytes": 14460711074, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12978509072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2290 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8b987949006d99a3828470a8", "attempt_id": "5fdcf8a73acf", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:51.809164Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12868703240}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5841, "keep": 1460, "compress_ms": 15.789958066307008}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 49, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837629, "side_information_bytes": 16189, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 805.2368329372257, "doc_prefill_ms": 768.9147919882089, "compress_ms": 15.83020796533674, "serialize_ms": 11.385416961275041, "load_ms": 1.7126670572906733, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.078457965515554, "ttft_ms": 24.078457965515554, "decode_ms": 13.716874993406236}, "total_wall_ms": 43.85337501298636, "ttft_ms": 24.078457965515554, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 932511744, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12979918096, "mlx_cache_bytes": 14495068322, "process_rss_bytes": 932511744}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979918096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5bcee576b891865387e418fbc4dbf47bccb9784c365d91106aef18160057e97c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2291 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f003a3041afc92cc03a22c9a", "attempt_id": "4d1db88fcabb", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:51.876129Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 46, "compress_ms": 71.65237504523247}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 46, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837668, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 85.21129190921783, "doc_prefill_ms": 768.9147919882089, "compress_ms": 76.04874996468425, "serialize_ms": 8.923582965508103, "load_ms": 0.6079999729990959, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.107833927497268, "ttft_ms": 23.107833927497268, "decode_ms": 139.01491707656533}, "total_wall_ms": 252.3794589797035, "ttft_ms": 23.107833927497268, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 933822464, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977116408, "mlx_cache_bytes": 14757596266, "process_rss_bytes": 933822464}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977116408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5cd93cb3ec2bee4ef19e4c975c2a490dcc5c38ebe3f26ff679953785db7c3fdf", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 2292 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2d9ee9d481168390b9a5d50d", "attempt_id": "90aa8c68f40f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:52.151639Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 36, "compress_ms": 62.846874934621155}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837669, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 77.71091593895108, "doc_prefill_ms": 768.9147919882089, "compress_ms": 67.2746249474585, "serialize_ms": 10.218750103376806, "load_ms": 1.4481249963864684, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.947957972064614, "ttft_ms": 22.947957972064614, "decode_ms": 13.764958013780415}, "total_wall_ms": 120.3220000024885, "ttft_ms": 22.947957972064614, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 988119040, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12968088824, "mlx_cache_bytes": 14794640490, "process_rss_bytes": 988119040}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968088824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "350ac1172f7234991eace1f4c89e62942740ad2169436e9a391260d0c4694c9a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2293 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a0defeb01a9fb7db871489d2", "attempt_id": "2045b0992636", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:52.295144Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 36, "compress_ms": 61.21483305469155}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837668, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 74.17337491642684, "doc_prefill_ms": 768.9147919882089, "compress_ms": 65.27987506706268, "serialize_ms": 8.675332996062934, "load_ms": 1.5150000108405948, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.617457900196314, "ttft_ms": 22.617457900196314, "decode_ms": 13.617124990560114}, "total_wall_ms": 116.3395830662921, "ttft_ms": 22.617457900196314, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 988119040, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12968088824, "mlx_cache_bytes": 14800899178, "process_rss_bytes": 988119040}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12968088824, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5cd93cb3ec2bee4ef19e4c975c2a490dcc5c38ebe3f26ff679953785db7c3fdf", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2294 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7509cb2abc20b2016115deca", "attempt_id": "990e5d024a0d", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:52.434776Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 52, "compress_ms": 64.16845903731883}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 52, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837668, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.76241698209196, "doc_prefill_ms": 768.9147919882089, "compress_ms": 68.26179102063179, "serialize_ms": 8.281417074613273, "load_ms": 1.5927079366520047, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.000207962468266, "ttft_ms": 23.000207962468266, "decode_ms": 82.70450006239116}, "total_wall_ms": 188.54999996256083, "ttft_ms": 23.000207962468266, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 52}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 988135424, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12981884176, "mlx_cache_bytes": 14823754858, "process_rss_bytes": 988135424}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12981884176, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "747480", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5cd93cb3ec2bee4ef19e4c975c2a490dcc5c38ebe3f26ff679953785db7c3fdf", "output_hash": "a4dc22d4890a02a408d0bf4c5cb772bf0b93ce5bb16c022f5c3502ff3d6cc78c"} | ||||
| 2295 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0cd4d5351e52583ca48b838c", "attempt_id": "73d7a52db2ea", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:52.646621Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 45, "compress_ms": 62.864999985322356}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 45, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837669, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 75.93587506562471, "doc_prefill_ms": 768.9147919882089, "compress_ms": 66.93212501704693, "serialize_ms": 8.786457940004766, "load_ms": 0.5983749870210886, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.262750008143485, "ttft_ms": 23.262750008143485, "decode_ms": 96.04766604024917}, "total_wall_ms": 200.28837502468377, "ttft_ms": 23.262750008143485, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 988135424, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12976805112, "mlx_cache_bytes": 14840581226, "process_rss_bytes": 988135424}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12976805112, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9844780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "350ac1172f7234991eace1f4c89e62942740ad2169436e9a391260d0c4694c9a", "output_hash": "771079f9bfa4045cea40b41caf04207b1c83e8ae61d7b82ef1421eae53276f16"} | ||||
| 2296 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "90c458c2fa53c09a6d90eee1", "attempt_id": "d80ded55015c", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:52.870734Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 54, "compress_ms": 63.793833018280566}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 54, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837669, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.18637499399483, "doc_prefill_ms": 768.9147919882089, "compress_ms": 67.8732501110062, "serialize_ms": 8.093166048638523, "load_ms": 1.2295839842408895, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.588250041939318, "ttft_ms": 23.588250041939318, "decode_ms": 97.91316697373986}, "total_wall_ms": 203.28416698612273, "ttft_ms": 23.588250041939318, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 988135424, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12984325400, "mlx_cache_bytes": 14878657642, "process_rss_bytes": 988135424}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12984325400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "350ac1172f7234991eace1f4c89e62942740ad2169436e9a391260d0c4694c9a", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2297 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2dc2df05d3189236056483e8", "attempt_id": "824316ab7569", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:53.097079Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 47, "compress_ms": 66.30829197820276}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 47, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837668, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 80.11204202193767, "doc_prefill_ms": 768.9147919882089, "compress_ms": 70.64799999352545, "serialize_ms": 9.23583295661956, "load_ms": 1.5993330162018538, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.591874960809946, "ttft_ms": 25.591874960809946, "decode_ms": 96.94908303208649}, "total_wall_ms": 208.90591596253216, "ttft_ms": 25.591874960809946, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 988168192, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12977952016, "mlx_cache_bytes": 14896237674, "process_rss_bytes": 988168192}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12977952016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2035450", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5cd93cb3ec2bee4ef19e4c975c2a490dcc5c38ebe3f26ff679953785db7c3fdf", "output_hash": "28aec2bfb7d027acde68c8eb75ea78b43ac02da635a6c06937dd4bf0cea84a1b"} | ||||
| 2298 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b9931008a855b4d6aa720ed6", "attempt_id": "63a12e3bc0b3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:53.329295Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 44, "compress_ms": 62.845584005117416}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 44, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837669, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.23758306726813, "doc_prefill_ms": 768.9147919882089, "compress_ms": 67.27408396545798, "serialize_ms": 8.745083003304899, "load_ms": 1.4030419988557696, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.753833978436887, "ttft_ms": 21.753833978436887, "decode_ms": 68.44950001686811}, "total_wall_ms": 172.2178750205785, "ttft_ms": 21.753833978436887, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 988168192, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12975166712, "mlx_cache_bytes": 14919535722, "process_rss_bytes": 988168192}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12975166712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "350ac1172f7234991eace1f4c89e62942740ad2169436e9a391260d0c4694c9a", "output_hash": "73ffe585bc3e90cd98dbd9f9c29d075d23f2515d4ccc26e07934d3414d8feabd"} | ||||
| 2299 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c6a42d221092e8715eb3096c", "attempt_id": "8df3382819f3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:53.525016Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 48, "compress_ms": 63.897249987348914}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 48, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837669, "side_information_bytes": 16229, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.99591596610844, "doc_prefill_ms": 768.9147919882089, "compress_ms": 68.28000000678003, "serialize_ms": 8.492624969221652, "load_ms": 1.5017089899629354, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.68650010228157, "ttft_ms": 22.68650010228157, "decode_ms": 13.88320792466402}, "total_wall_ms": 119.55033394042403, "ttft_ms": 22.68650010228157, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 988184576, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12978509072, "mlx_cache_bytes": 14937492586, "process_rss_bytes": 988184576}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12978509072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "350ac1172f7234991eace1f4c89e62942740ad2169436e9a391260d0c4694c9a", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2300 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8428e56c590ee935027b2907", "attempt_id": "ef0be44aa596", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:53.667428Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12814439432}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5841, "keep": 1460, "window_tokens": 49, "compress_ms": 63.77404206432402}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 49, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 53821440, "serialized_payload_bytes": 53837668, "side_information_bytes": 16228, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 76.8597919959575, "doc_prefill_ms": 768.9147919882089, "compress_ms": 68.17820796277374, "serialize_ms": 8.450458059087396, "load_ms": 1.5677920309826732, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.688500048592687, "ttft_ms": 23.688500048592687, "decode_ms": 13.641542056575418}, "total_wall_ms": 120.2284999890253, "ttft_ms": 23.688500048592687, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 988200960, "backend_memory": {"mlx_active_bytes": 12925326344, "mlx_peak_bytes": 12979918096, "mlx_cache_bytes": 14955826282, "process_rss_bytes": 988200960}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 12979918096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5cd93cb3ec2bee4ef19e4c975c2a490dcc5c38ebe3f26ff679953785db7c3fdf", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2301 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "24a5050bf3c5f2ce947f41e1", "attempt_id": "3635605d2640", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:53.844282Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 46, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 2.986250096000731, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.119999915361404, "ttft_ms": 28.119999915361404, "decode_ms": 153.8063749903813}, "total_wall_ms": 189.32166695594788, "ttft_ms": 28.119999915361404, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 46}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1218248704, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13173655860, "mlx_cache_bytes": 15292974506, "process_rss_bytes": 1218248704}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13173655860, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 2302 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "34e8285c34d1d4530275b117", "attempt_id": "7eac4a8f1988", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:54.056706Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 2.297332976013422, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.324833907186985, "ttft_ms": 27.324833907186985, "decode_ms": 15.434207976795733}, "total_wall_ms": 49.224041984416544, "ttft_ms": 27.324833907186985, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1218248704, "backend_memory": {"mlx_active_bytes": 13047485448, "mlx_peak_bytes": 13151094900, "mlx_cache_bytes": 15348417962, "process_rss_bytes": 1218248704}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13151094900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2303 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4c5b609bdd832b4da0df4016", "attempt_id": "eeb91d056fc0", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:54.128252Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 36, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 1.3774590333923697, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.18225005082786, "ttft_ms": 27.18225005082786, "decode_ms": 15.604124986566603}, "total_wall_ms": 48.405874986201525, "ttft_ms": 27.18225005082786, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1218248704, "backend_memory": {"mlx_active_bytes": 13047485448, "mlx_peak_bytes": 13151094900, "mlx_cache_bytes": 15348417962, "process_rss_bytes": 1218248704}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13151094900, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2304 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "67837f7a8b1e3e6ae1b2803a", "attempt_id": "9c83f6e1b946", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:54.199612Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 52, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 2.270999946631491, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.34741596598178, "ttft_ms": 28.34741596598178, "decode_ms": 106.99658398516476}, "total_wall_ms": 141.8966669589281, "ttft_ms": 28.34741596598178, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1218248704, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13187784684, "mlx_cache_bytes": 15425969258, "process_rss_bytes": 1218248704}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13187784684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7430110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "3781b0f7175e64bec5fc4e06e8c55b65284738b62891371384a1ee1dc8c3cfe9"} | ||||
| 2305 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f713cccb61f28fd9222f007b", "attempt_id": "cff16821451a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:54.363981Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 45, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 2.2077499888837337, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.943667024374008, "ttft_ms": 27.943667024374008, "decode_ms": 106.58504196908325}, "total_wall_ms": 141.05933299288154, "ttft_ms": 27.943667024374008, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 45}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1218248704, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13172081844, "mlx_cache_bytes": 15493864554, "process_rss_bytes": 1218248704}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13172081844, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9844780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "771079f9bfa4045cea40b41caf04207b1c83e8ae61d7b82ef1421eae53276f16"} | ||||
| 2306 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "67788967c9b68d9da538052a", "attempt_id": "0f7ef6b81535", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:54.527626Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 54, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 1.3940829085186124, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.430582955479622, "ttft_ms": 28.430582955479622, "decode_ms": 106.95074999239296}, "total_wall_ms": 141.2533330731094, "ttft_ms": 28.430582955479622, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 54}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1218248704, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13192953044, "mlx_cache_bytes": 15576273930, "process_rss_bytes": 1218248704}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13192953044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2307 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "653dc82b616873264475ceeb", "attempt_id": "c9ea48feea03", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:54.692109Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 47, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 1.3495000312104821, "receiver_prefill_ms": 0.0, "query_prefill_ms": 25.622499990276992, "ttft_ms": 25.622499990276992, "decode_ms": 121.91400001756847}, "total_wall_ms": 153.27754092868418, "ttft_ms": 25.622499990276992, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1218265088, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13175889100, "mlx_cache_bytes": 15647183882, "process_rss_bytes": 1218265088}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13175889100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20884505", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "8750c6e2aa7d75be10f70e25809291c9880c4d5f85455aa03f4853cccca52f20"} | ||||
| 2308 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d6f606506f8b268d105d8bdb", "attempt_id": "a8398f44c9c1", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:54.868045Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 44, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 1.973042031750083, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.084584046155214, "ttft_ms": 28.084584046155214, "decode_ms": 76.3887920184061}, "total_wall_ms": 110.68829195573926, "ttft_ms": 28.084584046155214, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1218265088, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13168952180, "mlx_cache_bytes": 15713506314, "process_rss_bytes": 1218265088}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13168952180, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25500", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "73ffe585bc3e90cd98dbd9f9c29d075d23f2515d4ccc26e07934d3414d8feabd"} | ||||
| 2309 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6f7ff0e16743725138035152", "attempt_id": "5f09eea5781b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:55.001826Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 48, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 2.28683406021446, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.28487497754395, "ttft_ms": 28.28487497754395, "decode_ms": 15.238375053741038}, "total_wall_ms": 50.23862491361797, "ttft_ms": 28.28487497754395, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1218265088, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13179034828, "mlx_cache_bytes": 15785989130, "process_rss_bytes": 1218265088}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13179034828, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2310 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eee8e7c3fb455ecfa8e6a9ae", "attempt_id": "4a1fb267d5cd", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:55.074961Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12931879944}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5802, "source_tokens_receiver": 5802, "query_tokens": 49, "message_tokens": 5841, "message_utf8_bytes": 29319, "cache_tensor_bytes": 114390144, "serialized_payload_bytes": 114424473, "side_information_bytes": 34329, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 33.87020900845528, "doc_prefill_ms": 768.9147919882089, "compress_ms": 11.704790988005698, "serialize_ms": 21.784250042401254, "load_ms": 2.2723329020664096, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.32262497395277, "ttft_ms": 28.32262497395277, "decode_ms": 15.296709025278687}, "total_wall_ms": 50.30337499920279, "ttft_ms": 28.32262497395277, "input_usage": {"receiver_prefix_tokens": 5841, "dense_cache_bytes": 215322624, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1218265088, "backend_memory": {"mlx_active_bytes": 13048665096, "mlx_peak_bytes": 13181803724, "mlx_cache_bytes": 15859913738, "process_rss_bytes": 1218265088}, "peak_prefill_memory": 13580981312, "peak_decode_memory": 13181803724, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "87dac7b9ff09e749651a82fb8b699376fb153512099559ada64c3633e3f3915c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2311 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "48b6020c2bda7013e6697a9e", "attempt_id": "9a2ed0cb9b9a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:55.224767Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5717, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 702.3999999510124, "ttft_ms": 15.078750089742243, "decode_ms": 103.93445799127221}, "total_wall_ms": 829.5755420112982, "ttft_ms": 15.078750089742243, "input_usage": {"receiver_prompt_tokens": 5717}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1001029632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746066484, "mlx_cache_bytes": 2689245528, "process_rss_bytes": 1001029632}, "peak_prefill_memory": null, "peak_decode_memory": 13746066484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 2312 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bf866c4c8ec76c819cd38009", "attempt_id": "2147b9ad5d98", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:56.083444Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5708, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 731.6458750283346, "ttft_ms": 15.273249940946698, "decode_ms": 29.645250062458217}, "total_wall_ms": 784.3963339691982, "ttft_ms": 15.273249940946698, "input_usage": {"receiver_prompt_tokens": 5708}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1001046016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13744100404, "mlx_cache_bytes": 3065684312, "process_rss_bytes": 1001046016}, "peak_prefill_memory": null, "peak_decode_memory": 13744100404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2313 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bcb4ee94613457bb5394c914", "attempt_id": "7e1e7e42220f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:56.890254Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5707, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 786.2505830125883, "ttft_ms": 15.553249977529049, "decode_ms": 30.46441706828773}, "total_wall_ms": 840.4082920169458, "ttft_ms": 15.553249977529049, "input_usage": {"receiver_prompt_tokens": 5707}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1001046016, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13783651380, "mlx_cache_bytes": 3125059928, "process_rss_bytes": 1001046016}, "peak_prefill_memory": null, "peak_decode_memory": 13783651380, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2314 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "53d7b079766ceec26a435f99", "attempt_id": "cf0ff4793129", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:57.752462Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5723, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 813.3470000466332, "ttft_ms": 15.644458937458694, "decode_ms": 77.29825004935265}, "total_wall_ms": 914.3879159819335, "ttft_ms": 15.644458937458694, "input_usage": {"receiver_prompt_tokens": 5723}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1001062400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13747524660, "mlx_cache_bytes": 3534856536, "process_rss_bytes": 1001062400}, "peak_prefill_memory": null, "peak_decode_memory": 13747524660, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,844,780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "de98064ed9628eaf843fbf3a609313f4264cba6866be2c6a6cf7244cea3c65e7"} | ||||
| 2315 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da89c9420e288b2b076680eb", "attempt_id": "1d54ec667d65", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:58.688512Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5716, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 826.5555419493467, "ttft_ms": 16.01587503682822, "decode_ms": 76.87362504657358}, "total_wall_ms": 927.3540829308331, "ttft_ms": 16.01587503682822, "input_usage": {"receiver_prompt_tokens": 5716}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1001078784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13746066484, "mlx_cache_bytes": 3534856536, "process_rss_bytes": 1001078784}, "peak_prefill_memory": null, "peak_decode_memory": 13746066484, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,430,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "6ec8f3686ca12e2212d5f0b03da40f6c90866d495314345bafd9be7b9638f772"} | ||||
| 2316 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8ecc10fb7e849886a6ccff86", "attempt_id": "2f7db17e0245", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:03:59.637592Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5724, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 786.840167012997, "ttft_ms": 16.251916997134686, "decode_ms": 93.41320802923292}, "total_wall_ms": 904.264000011608, "ttft_ms": 16.251916997134686, "input_usage": {"receiver_prompt_tokens": 5724}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1001078784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13747983412, "mlx_cache_bytes": 3915030872, "process_rss_bytes": 1001078784}, "peak_prefill_memory": null, "peak_decode_memory": 13747983412, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2317 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26c3df2cdbd0687a95073a7c", "attempt_id": "a0b38a8d3602", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:00.563127Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5719, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 858.7665000231937, "ttft_ms": 15.954041969962418, "decode_ms": 77.70858297590166}, "total_wall_ms": 960.3961249813437, "ttft_ms": 15.954041969962418, "input_usage": {"receiver_prompt_tokens": 5719}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1001078784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13786862644, "mlx_cache_bytes": 4134347096, "process_rss_bytes": 1001078784}, "peak_prefill_memory": null, "peak_decode_memory": 13786862644, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,751,446", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "2b96b5884bfb0347c5abb78d3ecedf63840476d0db76749d6cd82a78fa4221c7"} | ||||
| 2318 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ba8773d122c54da978d94536", "attempt_id": "54554adc83a5", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:01.545592Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5715, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 854.837040998973, "ttft_ms": 15.894250012934208, "decode_ms": 47.10012499708682}, "total_wall_ms": 925.8706670952961, "ttft_ms": 15.894250012934208, "input_usage": {"receiver_prompt_tokens": 5715}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1001111552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13785617460, "mlx_cache_bytes": 4353073496, "process_rss_bytes": 1001111552}, "peak_prefill_memory": null, "peak_decode_memory": 13785617460, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "c2068c8abdd8d15e7c7e5f4b4d103c162fbe4fd0b578c1742d129b2a5565bcd3"} | ||||
| 2319 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b7160d24951f5f5036aaf061", "attempt_id": "b5c669540bc6", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:02.493564Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5719, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 821.8382090562955, "ttft_ms": 16.03833306580782, "decode_ms": 15.706625068560243}, "total_wall_ms": 861.9596660137177, "ttft_ms": 16.03833306580782, "input_usage": {"receiver_prompt_tokens": 5719}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001111552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13796856884, "mlx_cache_bytes": 4353073496, "process_rss_bytes": 1001111552}, "peak_prefill_memory": null, "peak_decode_memory": 13796856884, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2320 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5d1317a2fec4afc3927a453f", "attempt_id": "d1130fa328f9", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:03.377715Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 5721, "message_tokens": 5611, "message_utf8_bytes": 29319, "cache_tensor_bytes": null, "serialized_payload_bytes": 29319, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.008457922376692295, "decode_payload_ms": 0.0, "receiver_prefill_ms": 864.5480839768425, "ttft_ms": 16.037250054068863, "decode_ms": 15.65520791336894}, "total_wall_ms": 904.4223339296877, "ttft_ms": 16.037250054068863, "input_usage": {"receiver_prompt_tokens": 5721}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001111552, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13747082292, "mlx_cache_bytes": 4512719192, "process_rss_bytes": 1001111552}, "peak_prefill_memory": null, "peak_decode_memory": 13747082292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2321 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8165cb03a16a1c6fa9b803ea", "attempt_id": "d3a0e3d47a43", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:12.804505Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 622, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.53654208499938, "ttft_ms": 13.571374933235347, "decode_ms": 13.74079193919897}, "total_wall_ms": 107.14870796073228, "ttft_ms": 13.571374933235347, "input_usage": {"receiver_prompt_tokens": 622, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 6554518284, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2322 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9688089b12e1c25e329d56af", "attempt_id": "81a36220db81", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:12.934484Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 613, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.45837496966124, "ttft_ms": 13.81899998523295, "decode_ms": 27.96400000806898}, "total_wall_ms": 119.41008304711431, "ttft_ms": 13.81899998523295, "input_usage": {"receiver_prompt_tokens": 613, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037821452, "mlx_cache_bytes": 6897042188, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13037821452, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2323 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "29395583a9d9df42546a7d57", "attempt_id": "3da38415a13f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:13.076036Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 612, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.03191700764, "ttft_ms": 14.002166921272874, "decode_ms": 13.659250107593834}, "total_wall_ms": 104.93608308024704, "ttft_ms": 14.002166921272874, "input_usage": {"receiver_prompt_tokens": 612, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037641228, "mlx_cache_bytes": 6897042188, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13037641228, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2324 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4ec5ced0ec4cfa068a29fd7f", "attempt_id": "2793d1278b66", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:13.203046Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 628, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.16129201091826, "ttft_ms": 13.796583050861955, "decode_ms": 68.07649997062981}, "total_wall_ms": 161.31750005297363, "ttft_ms": 13.796583050861955, "input_usage": {"receiver_prompt_tokens": 628, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046619684, "mlx_cache_bytes": 7271615704, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13046619684, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "8,832,117", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "5433ad7dca6601c11c8a49e3239b880460c2fb281eb569df6a6134b5610e2859"} | ||||
| 2325 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c71976f0c268428b41bccdc0", "attempt_id": "8326dbc4a37a", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:13.387752Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 621, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.72374998219311, "ttft_ms": 13.811459066346288, "decode_ms": 13.525040936656296}, "total_wall_ms": 105.1597089972347, "ttft_ms": 13.811459066346288, "input_usage": {"receiver_prompt_tokens": 621, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 7271615704, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 2326 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f02ca21fa513284e00e13482", "attempt_id": "ad7a7352b713", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:13.514724Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 629, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.78637506999075, "ttft_ms": 14.2590421019122, "decode_ms": 81.51795901358128}, "total_wall_ms": 174.7975409962237, "ttft_ms": 14.2590421019122, "input_usage": {"receiver_prompt_tokens": 629, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13046799912, "mlx_cache_bytes": 7395088040, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13046799912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2327 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "321b27a353a6321e6aa57859", "attempt_id": "e9461f387dc3", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:13.711148Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.24512496497482, "ttft_ms": 14.105875045061111, "decode_ms": 353.18366589490324}, "total_wall_ms": 445.74187509715557, "ttft_ms": 14.105875045061111, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 26}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 7743772328, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,755,450 + 4,076,350 + 8,832,117 = 20,663,917", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "1b5705b6bf04dc9d37ee5def771d93215fd151cf3704d344ff7ab33f909cf678"} | ||||
| 2328 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b0787f44cfd877a70deeb427", "attempt_id": "d13553b90962", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:14.178603Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 620, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.48208294995129, "ttft_ms": 13.545249938033521, "decode_ms": 13.871499919332564}, "total_wall_ms": 105.10833305306733, "ttft_ms": 13.545249938033521, "input_usage": {"receiver_prompt_tokens": 620, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042179596, "mlx_cache_bytes": 7865472680, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13042179596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2329 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "13f0ffe84526917c742f9b35", "attempt_id": "25f51bd28cee", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:14.304999Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 624, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.32425001449883, "ttft_ms": 13.534249970689416, "decode_ms": 13.925875071436167}, "total_wall_ms": 106.01195902563632, "ttft_ms": 13.534249970689416, "input_usage": {"receiver_prompt_tokens": 624, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 7865472680, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2330 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8f132c242b51a02d66fc959f", "attempt_id": "6e5e31c57ab6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:14.434374Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 626, "message_tokens": 512, "message_utf8_bytes": 2196, "cache_tensor_bytes": null, "serialized_payload_bytes": 2196, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8500.147874932736, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.86287500150502, "ttft_ms": 13.75633291900158, "decode_ms": 13.693207991309464}, "total_wall_ms": 107.42133401799947, "ttft_ms": 13.75633291900158, "input_usage": {"receiver_prompt_tokens": 626, "sender_input_tokens": 5745, "sender_output_tokens": 512, "sender_prefill_ms": 865.261708968319, "sender_ttft_ms": 15.668625012040138, "sender_decode_ms": 7612.028958043084}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1001897984, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13077028388, "mlx_cache_bytes": 8026855080, "process_rss_bytes": 1001897984}, "peak_prefill_memory": null, "peak_decode_memory": 13077028388, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "d8a0c9e697623e36cd9ec0db23dd8bf56e9df339b924cf5a75a535b02c92eaca", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2331 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "17b694d37cfb7727fc54a81b", "attempt_id": "d6f629aeea86", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.037030Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 458, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.397041025571525, "ttft_ms": 14.277542009949684, "decode_ms": 13.466082978993654}, "total_wall_ms": 84.50154191814363, "ttft_ms": 14.277542009949684, "input_usage": {"receiver_prompt_tokens": 458, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12919872600, "mlx_cache_bytes": 8736708264, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12919872600, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2332 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ad87cb717dce84559b817853", "attempt_id": "09b34c7e274b", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.145086Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 449, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.588249953463674, "ttft_ms": 13.53670796379447, "decode_ms": 14.325625030323863}, "total_wall_ms": 82.36724999733269, "ttft_ms": 13.53670796379447, "input_usage": {"receiver_prompt_tokens": 449, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913663064, "mlx_cache_bytes": 8981681832, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12913663064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2333 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bba5cbcd0b3a205bcb7ca457", "attempt_id": "54479ddb9a1a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.249513Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 448, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.272708017379045, "ttft_ms": 13.57170904520899, "decode_ms": 13.679124996997416}, "total_wall_ms": 82.47695793397725, "ttft_ms": 13.57170904520899, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12913663064, "mlx_cache_bytes": 8981681832, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12913663064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2334 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a23fd09437ff60c55c51c02d", "attempt_id": "ba2099e212f3", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.354312Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 464, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.83095906674862, "ttft_ms": 13.566166046075523, "decode_ms": 13.572958996519446}, "total_wall_ms": 82.88041700143367, "ttft_ms": 13.566166046075523, "input_usage": {"receiver_prompt_tokens": 464, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12922952792, "mlx_cache_bytes": 9195296424, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12922952792, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2335 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "81106fa70f23cf9dd2214e7a", "attempt_id": "9e019b64cc36", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.458948Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 457, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.86004101112485, "ttft_ms": 13.476041029207408, "decode_ms": 13.555875048041344}, "total_wall_ms": 82.77120802085847, "ttft_ms": 13.476041029207408, "input_usage": {"receiver_prompt_tokens": 457, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12919479384, "mlx_cache_bytes": 9240123048, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12919479384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2336 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0107ab86814a4c6895499d77", "attempt_id": "d8151800732a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.563370Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 465, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.3085829121992, "ttft_ms": 13.542374945245683, "decode_ms": 14.00620792992413}, "total_wall_ms": 82.77104096487164, "ttft_ms": 13.542374945245683, "input_usage": {"receiver_prompt_tokens": 465, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12923133016, "mlx_cache_bytes": 9331349160, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12923133016, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2337 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5ec59fdd171c4a753e1ba0bb", "attempt_id": "e35ced173498", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.667765Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 460, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.79641701094806, "ttft_ms": 13.928708038292825, "decode_ms": 13.511458993889391}, "total_wall_ms": 83.08620902244002, "ttft_ms": 13.928708038292825, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12944284760, "mlx_cache_bytes": 9449936552, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12944284760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2338 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "af2e64c4d7e9adedf746a935", "attempt_id": "2efe9b32c2f7", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.772856Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 456, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.664541967213154, "ttft_ms": 14.223583973944187, "decode_ms": 13.526124996133149}, "total_wall_ms": 83.35229195654392, "ttft_ms": 14.223583973944187, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12941499480, "mlx_cache_bytes": 9567409832, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12941499480, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2339 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f5fede6618a01c9c5faad79", "attempt_id": "9f8bc3ac4eef", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.877860Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 460, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.86937495879829, "ttft_ms": 13.636541087180376, "decode_ms": 13.594708987511694}, "total_wall_ms": 82.94345799367875, "ttft_ms": 13.636541087180376, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12949986392, "mlx_cache_bytes": 9567409832, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 12949986392, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2340 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4772f10e5922518b2a637303", "attempt_id": "18e248a4e31a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:23.982740Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 462, "message_tokens": 336, "message_utf8_bytes": 941, "cache_tensor_bytes": null, "serialized_payload_bytes": 941, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 8473.15137507394, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.814958944916725, "ttft_ms": 13.863416970707476, "decode_ms": 13.593957992270589}, "total_wall_ms": 83.18337495438755, "ttft_ms": 13.863416970707476, "input_usage": {"receiver_prompt_tokens": 462, "sender_input_tokens": 5775, "sender_output_tokens": 512, "sender_prefill_ms": 853.6008750088513, "sender_ttft_ms": 16.056291991844773, "sender_decode_ms": 7598.844334017485}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002045440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12950543448, "mlx_cache_bytes": 9703462568, "process_rss_bytes": 1002045440}, "peak_prefill_memory": null, "peak_decode_memory": 12950543448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 9, "unresolved_quotes": 0, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "976779c7818a436a3c1c184e07d64cf1b93b4f369d31c0ca9d4c34695e5c17c3", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2341 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2ad263386399a3f06e80f10a", "attempt_id": "60e45b3427b3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:24.092291Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 617, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.2162500070408, "ttft_ms": 13.789249933324754, "decode_ms": 13.621542020700872}, "total_wall_ms": 105.66016600932926, "ttft_ms": 13.789249933324754, "input_usage": {"receiver_prompt_tokens": 617}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002045440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640076, "mlx_cache_bytes": 10002454184, "process_rss_bytes": 1002045440}, "peak_prefill_memory": null, "peak_decode_memory": 13039640076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2342 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0fa30871bd38e649d30c6ee8", "attempt_id": "fa9763190403", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:24.219221Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 608, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.8883751006797, "ttft_ms": 13.794499915093184, "decode_ms": 27.32787502463907}, "total_wall_ms": 119.06683398410678, "ttft_ms": 13.794499915093184, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1002045440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034626572, "mlx_cache_bytes": 10200438440, "process_rss_bytes": 1002045440}, "peak_prefill_memory": null, "peak_decode_memory": 13034626572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2343 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "031dc5cb9601b6f9ae0a218d", "attempt_id": "7d110f987de5", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:24.359926Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 607, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.64254207722843, "ttft_ms": 13.924333965405822, "decode_ms": 27.406583074480295}, "total_wall_ms": 120.01204199623317, "ttft_ms": 13.924333965405822, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1002045440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034429964, "mlx_cache_bytes": 10260010664, "process_rss_bytes": 1002045440}, "peak_prefill_memory": null, "peak_decode_memory": 13034429964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2344 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d1c5a79b00bdd9bfacb11eec", "attempt_id": "0fb51939f8c0", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:24.501602Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 623, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 80.54033399093896, "ttft_ms": 13.88254202902317, "decode_ms": 68.78545810468495}, "total_wall_ms": 164.28975004237145, "ttft_ms": 13.88254202902317, "input_usage": {"receiver_prompt_tokens": 623}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1002045440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043605028, "mlx_cache_bytes": 10260010664, "process_rss_bytes": 1002045440}, "peak_prefill_memory": null, "peak_decode_memory": 13043605028, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,430,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "6ec8f3686ca12e2212d5f0b03da40f6c90866d495314345bafd9be7b9638f772"} | ||||
| 2345 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "69a0cb595f67ebc4dabafde4", "attempt_id": "e71a56aa3be5", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:24.687053Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 616, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 79.36645892914385, "ttft_ms": 13.719749986194074, "decode_ms": 68.27220902778208}, "total_wall_ms": 162.42933389730752, "ttft_ms": 13.719749986194074, "input_usage": {"receiver_prompt_tokens": 616}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1002045440, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039640076, "mlx_cache_bytes": 10260010664, "process_rss_bytes": 1002045440}, "peak_prefill_memory": null, "peak_decode_memory": 13039640076, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,430,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "6ec8f3686ca12e2212d5f0b03da40f6c90866d495314345bafd9be7b9638f772"} | ||||
| 2346 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "39054c7d651c06ea4268cc1d", "attempt_id": "39ad87f9b790", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:24.871392Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 624, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.35516694467515, "ttft_ms": 13.749709003604949, "decode_ms": 54.354417021386325}, "total_wall_ms": 147.52212492749095, "ttft_ms": 13.749709003604949, "input_usage": {"receiver_prompt_tokens": 624}, "output_usage": {"output_tokens": 4}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043801636, "mlx_cache_bytes": 10260010664, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 13043801636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Soltek-12", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "afeabbb13c97073235bda8ee98e604768e20ddd816bcc53f1cf102c9aefab62c"} | ||||
| 2347 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "679e94b417df6f8dd7c3943f", "attempt_id": "64deaa03dd7a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:25.040658Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 619, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.36391597427428, "ttft_ms": 13.809042051434517, "decode_ms": 545.538124977611}, "total_wall_ms": 637.7708329819143, "ttft_ms": 13.809042051434517, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 40}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071982092, "mlx_cache_bytes": 10358773416, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 13071982092, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,755,450 + 4,076,350 + 3,964,110 + 4,172,340 + 7,430,110 = 27,313,960", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "676730a9b9a529f4d0f138cfa3613ec7bcc5bcd4d3b22b1fb6ca999a73e66e1c"} | ||||
| 2348 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "786e1b1edaa6c76f25585a9f", "attempt_id": "aa9d8e7302bd", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:25.699684Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 615, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.95945801585913, "ttft_ms": 13.86137492954731, "decode_ms": 13.691041967831552}, "total_wall_ms": 104.57704204600304, "ttft_ms": 13.86137492954731, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13039279628, "mlx_cache_bytes": 10479490728, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 13039279628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2349 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "768cf3cf1e970f0722078780", "attempt_id": "6aad8ac214fe", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:25.826393Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 619, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.87250000890344, "ttft_ms": 13.6824999935925, "decode_ms": 13.770457939244807}, "total_wall_ms": 105.38095806259662, "ttft_ms": 13.6824999935925, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002061824, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13079617036, "mlx_cache_bytes": 10479490728, "process_rss_bytes": 1002061824}, "peak_prefill_memory": null, "peak_decode_memory": 13079617036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2350 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9cebb4e4763b5450ed55dfe5", "attempt_id": "54a8e8119461", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:25.953424Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 510, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 621, "message_tokens": 510, "message_utf8_bytes": 1604, "cache_tensor_bytes": null, "serialized_payload_bytes": 1604, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 4.3068749364465475, "decode_payload_ms": 0.0, "receiver_prefill_ms": 77.41833396721631, "ttft_ms": 13.657332980073988, "decode_ms": 14.835541020147502}, "total_wall_ms": 107.0417920127511, "ttft_ms": 13.657332980073988, "input_usage": {"receiver_prompt_tokens": 621}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1002094592, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 10479490728, "process_rss_bytes": 1002094592}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "69caf3d25f4186b208c37d7123e1e25881f17b186e0c95190be75bde6446df8f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2351 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0c545c81afd48a21dfc1e9a9", "attempt_id": "b417a162d1ce", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:26.979972Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 46, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.6246669692918658, "receiver_prefill_ms": 0.0, "query_prefill_ms": 24.54833302181214, "ttft_ms": 24.54833302181214, "decode_ms": 101.84258304070681}, "total_wall_ms": 132.2397079784423, "ttft_ms": 24.54833302181214, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13667587304, "mlx_cache_bytes": 10231148569, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13667587304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "ES-16L-5151", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "c326940197fa27cddf181e9663b7e230f0c95a2c3ff5d8211759bc8d8497f1e4"} | ||||
| 2352 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "37f5435d40b6c6fe4e16fffc", "attempt_id": "5f57e3f43125", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.134410Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 37, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.5903330640867352, "receiver_prefill_ms": 0.0, "query_prefill_ms": 23.543416988104582, "ttft_ms": 23.543416988104582, "decode_ms": 15.012957970611751}, "total_wall_ms": 44.19804096687585, "ttft_ms": 23.543416988104582, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13659149544, "mlx_cache_bytes": 10468126745, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13659149544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 2353 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3ed8e6cfb45f0f7e448a382b", "attempt_id": "133cf87dad8b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.200509Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 36, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.5356659423559904, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.660500020720065, "ttft_ms": 22.660500020720065, "decode_ms": 15.050416928716004}, "total_wall_ms": 43.32183406222612, "ttft_ms": 22.660500020720065, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 36}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13658887400, "mlx_cache_bytes": 10477367321, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13658887400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2354 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49aefb87c7a83d32ee844b8a", "attempt_id": "1e5387262c5d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.265711Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 52, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.501707942225039, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.58945896755904, "ttft_ms": 22.58945896755904, "decode_ms": 29.413459007628262}, "total_wall_ms": 57.69941711332649, "ttft_ms": 22.58945896755904, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 52}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13671814400, "mlx_cache_bytes": 10514938953, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13671814400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 2355 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ae4b64c9e4e30f22115e358c", "attempt_id": "a1233343119a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.345369Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 45, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.639000023715198, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.528083994984627, "ttft_ms": 22.528083994984627, "decode_ms": 28.867791057564318}, "total_wall_ms": 57.23825003951788, "ttft_ms": 22.528083994984627, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 45}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13669553384, "mlx_cache_bytes": 10529274953, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13669553384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 2356 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "96df2be269c42b02c37b3710", "attempt_id": "2cbf50e15a7a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.425334Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 53, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.597292022779584, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.535332944244146, "ttft_ms": 22.535332944244146, "decode_ms": 88.19441706873477}, "total_wall_ms": 116.47583392914385, "ttft_ms": 22.535332944244146, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 53}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13672256772, "mlx_cache_bytes": 10764552426, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13672256772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2357 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "28143802c375be9807deb588", "attempt_id": "89e0885e7b2a", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.563844Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 48, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.017790986225009, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.461791057139635, "ttft_ms": 22.461791057139635, "decode_ms": 73.198749916628}, "total_wall_ms": 100.60149990022182, "ttft_ms": 22.461791057139635, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521216, "mlx_cache_bytes": 10787227882, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13668521216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1,044,925", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "ef862be0e930c74e1edac7a7de114a8547c6a2b844f9d93247fd6398047cbe94"} | ||||
| 2358 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "21f52b84d757bfa2f54533d0", "attempt_id": "b3c9de3a210f", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.686456Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 44, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.6099578933790326, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.296166978776455, "ttft_ms": 22.296166978776455, "decode_ms": 29.512875014916062}, "total_wall_ms": 57.343624997884035, "ttft_ms": 22.296166978776455, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 44}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668848872, "mlx_cache_bytes": 10807167210, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13668848872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 2359 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c4b98a6f8a2fe6c0a8b39969", "attempt_id": "a207e21078b8", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.765768Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 48, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.1026670690625906, "receiver_prefill_ms": 0.0, "query_prefill_ms": 22.332541993819177, "ttft_ms": 22.332541993819177, "decode_ms": 28.861625003628433}, "total_wall_ms": 56.476916070096195, "ttft_ms": 22.332541993819177, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 48}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521216, "mlx_cache_bytes": 10807167210, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13668521216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "9cf9f50925b2a7803c73826a305235d4215dc428721c731072a9f2c0f5d6ae5a"} | ||||
| 2360 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "aba71e813b44d88365c2e585", "attempt_id": "90d6152c4190", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.843958Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13435982856}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 5671, "keep": 1418, "compress_ms": 10.362958069890738}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 50, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640695, "side_information_bytes": 13111, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 896.2457500165328, "doc_prefill_ms": 840.0982919847593, "compress_ms": 10.405999957583845, "serialize_ms": 36.84141696430743, "load_ms": 1.5981660690158606, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.703375037759542, "ttft_ms": 21.703375037759542, "decode_ms": 14.41054092720151}, "total_wall_ms": 41.873416979797184, "ttft_ms": 21.703375037759542, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1164607488, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13673387264, "mlx_cache_bytes": 10832939242, "process_rss_bytes": 1164607488}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13673387264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "1e298ee9a25d2c9303a870afaf06a42860be60864183001a8abee072648fa73a", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 2361 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a253c3c336cb25b1275cb85c", "attempt_id": "b237af03d1ef", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:27.908456Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 46, "compress_ms": 86.83275000657886}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 46, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 118.48599999211729, "doc_prefill_ms": 840.0982919847593, "compress_ms": 90.93700000084937, "serialize_ms": 27.326874900609255, "load_ms": 1.5932080568745732, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.623082924634218, "ttft_ms": 21.623082924634218, "decode_ms": 103.71941700577736}, "total_wall_ms": 249.55529195722193, "ttft_ms": 21.623082924634218, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1166983168, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13667587304, "mlx_cache_bytes": 12215863634, "process_rss_bytes": 1166983168}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13667587304, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 2362 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "6968d3f214d74050ca3c0882", "attempt_id": "8d293eefd5b3", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:28.181122Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 37, "compress_ms": 76.73916697967798}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 37, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 109.17333397082984, "doc_prefill_ms": 840.0982919847593, "compress_ms": 80.75824996922165, "serialize_ms": 28.21775001939386, "load_ms": 1.4163339510560036, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.71541703864932, "ttft_ms": 21.71541703864932, "decode_ms": 29.91341706365347}, "total_wall_ms": 166.35945800226182, "ttft_ms": 21.71541703864932, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1330298880, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13659149544, "mlx_cache_bytes": 12250237266, "process_rss_bytes": 1330298880}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13659149544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2363 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "27cc95fd2dcee53c8bf4fd3f", "attempt_id": "6423d4b1fc8b", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:28.369635Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 36, "compress_ms": 78.70958291459829}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 36, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.09912495035678, "doc_prefill_ms": 840.0982919847593, "compress_ms": 82.84295897465199, "serialize_ms": 22.053416934795678, "load_ms": 0.9264170657843351, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.69187495019287, "ttft_ms": 21.69187495019287, "decode_ms": 28.675250010564923}, "total_wall_ms": 160.46925005503, "ttft_ms": 21.69187495019287, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1330298880, "backend_memory": {"mlx_active_bytes": 13602968584, "mlx_peak_bytes": 13658887400, "mlx_cache_bytes": 12271683922, "process_rss_bytes": 1330298880}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13658887400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2364 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8de80e844dd7f4f6ec12c012", "attempt_id": "62cc708b8338", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:28.552773Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 52, "compress_ms": 79.64654103852808}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 52, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 106.56600003130734, "doc_prefill_ms": 840.0982919847593, "compress_ms": 83.44541699625552, "serialize_ms": 22.93641702271998, "load_ms": 1.7248749500140548, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.39212505426258, "ttft_ms": 21.39212505426258, "decode_ms": 72.39595800638199}, "total_wall_ms": 206.1933750519529, "ttft_ms": 21.39212505426258, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1330331648, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13671814400, "mlx_cache_bytes": 12317542738, "process_rss_bytes": 1330331648}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13671814400, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,430,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "6ec8f3686ca12e2212d5f0b03da40f6c90866d495314345bafd9be7b9638f772"} | ||||
| 2365 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5dd1288be13fe7cc02a034b1", "attempt_id": "f3cb4c0fc7bb", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:28.782374Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 45, "compress_ms": 78.25870905071497}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 45, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.82958301529288, "doc_prefill_ms": 840.0982919847593, "compress_ms": 82.06212497316301, "serialize_ms": 23.585084010846913, "load_ms": 1.8399580148980021, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.939042024314404, "ttft_ms": 21.939042024314404, "decode_ms": 72.0805840101093}, "total_wall_ms": 205.7692080270499, "ttft_ms": 21.939042024314404, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1330348032, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13669487848, "mlx_cache_bytes": 12343527762, "process_rss_bytes": 1330348032}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13669487848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,430,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "6ec8f3686ca12e2212d5f0b03da40f6c90866d495314345bafd9be7b9638f772"} | ||||
| 2366 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8656cdcf71434c6e610aab72", "attempt_id": "463bcd348d6f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:29.011264Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 53, "compress_ms": 79.4331249780953}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 53, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640733, "side_information_bytes": 13149, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 107.06208308693022, "doc_prefill_ms": 840.0982919847593, "compress_ms": 83.3049580687657, "serialize_ms": 23.57333293184638, "load_ms": 1.4141249703243375, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.922957967035472, "ttft_ms": 21.922957967035472, "decode_ms": 87.94683299493045}, "total_wall_ms": 222.34658303204924, "ttft_ms": 21.922957967035472, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 53}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1330348032, "backend_memory": {"mlx_active_bytes": 13605721096, "mlx_peak_bytes": 13672256772, "mlx_cache_bytes": 12372134226, "process_rss_bytes": 1330348032}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13672256772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "41b0ca063fe412c878c4f00765819f8d12e722d2aff2aace8016c07b94d742c4", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2367 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b620a639e3dee5ecb76e5b26", "attempt_id": "a67279ef0ece", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:29.257029Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 48, "compress_ms": 78.88354104943573}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 48, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 107.44537506252527, "doc_prefill_ms": 840.0982919847593, "compress_ms": 82.89387496188283, "serialize_ms": 24.365541990846395, "load_ms": 1.6762909945100546, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.86379104387015, "ttft_ms": 21.86379104387015, "decode_ms": 72.89554201997817}, "total_wall_ms": 208.05283403024077, "ttft_ms": 21.86379104387015, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1330348032, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521216, "mlx_cache_bytes": 12399184210, "process_rss_bytes": 1330348032}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13668521216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,751,145", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "3cae0874df609e228693b3d9849ee2a0b11aadcad258fc1aac2c57def10a6a16"} | ||||
| 2368 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7cee4a70bfbf802642a3f4b4", "attempt_id": "cafffd70db54", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:29.488883Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 44, "compress_ms": 78.3450419548899}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 44, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640733, "side_information_bytes": 13149, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 105.29070801567286, "doc_prefill_ms": 840.0982919847593, "compress_ms": 82.15037500485778, "serialize_ms": 22.96120801474899, "load_ms": 1.87924993224442, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.45804208703339, "ttft_ms": 21.45804208703339, "decode_ms": 43.15408307593316}, "total_wall_ms": 175.77500001061708, "ttft_ms": 21.45804208703339, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1330348032, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668816104, "mlx_cache_bytes": 12423694674, "process_rss_bytes": 1330348032}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13668816104, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "41b0ca063fe412c878c4f00765819f8d12e722d2aff2aace8016c07b94d742c4", "output_hash": "c2068c8abdd8d15e7c7e5f4b4d103c162fbe4fd0b578c1742d129b2a5565bcd3"} | ||||
| 2369 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "31ba6e2929b6f961e1032699", "attempt_id": "6e130fbd6162", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:29.688191Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 48, "compress_ms": 77.16633297968656}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 48, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 104.803082998842, "doc_prefill_ms": 840.0982919847593, "compress_ms": 81.26866701059043, "serialize_ms": 23.34033395163715, "load_ms": 1.9052920397371054, "receiver_prefill_ms": 0.0, "query_prefill_ms": 21.930334041826427, "ttft_ms": 21.930334041826427, "decode_ms": 14.540957985445857}, "total_wall_ms": 147.15841703582555, "ttft_ms": 21.930334041826427, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1330348032, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13668521216, "mlx_cache_bytes": 12423694674, "process_rss_bytes": 1330348032}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13668521216, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2370 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "023cc76fe71c9f2f496c0b2e", "attempt_id": "10f71a9044b1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:29.858467Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13272667144}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 5671, "keep": 1418, "window_tokens": 50, "compress_ms": 79.07458301633596}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 50, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 162627584, "serialized_payload_bytes": 162640734, "side_information_bytes": 13150, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 106.10966698732227, "doc_prefill_ms": 840.0982919847593, "compress_ms": 82.83654204569757, "serialize_ms": 23.09879194945097, "load_ms": 1.7172080697491765, "receiver_prefill_ms": 0.0, "query_prefill_ms": 20.910458988510072, "ttft_ms": 20.910458988510072, "decode_ms": 14.485875028185546}, "total_wall_ms": 147.30225002858788, "ttft_ms": 20.910458988510072, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1330348032, "backend_memory": {"mlx_active_bytes": 13604803592, "mlx_peak_bytes": 13673354496, "mlx_cache_bytes": 12450924882, "process_rss_bytes": 1330348032}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 13673354496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "0e9f10cfc83acbb56f898fe7fb25929535cef099c84011b077772231e34e8696", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2371 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "559200fb23a3a05286606047", "attempt_id": "eec17aea61ca", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:30.128171Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 46, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 6.5862080082297325, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.628582949750125, "ttft_ms": 28.628582949750125, "decode_ms": 115.84379198029637}, "total_wall_ms": 154.9202500609681, "ttft_ms": 28.628582949750125, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 46}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2023374848, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14147015080, "mlx_cache_bytes": 13259490578, "process_rss_bytes": 2023374848}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14147015080, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RY-99D-9177", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "abc5e1adc6533afa7ee1683a2195252eb090b08b52392c8150ccf6a387b14df6"} | ||||
| 2372 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e22f88de23c059c011674c8e", "attempt_id": "0ebda186c9dd", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:30.306731Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 37, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 2.927207970060408, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.99575002770871, "ttft_ms": 26.99575002770871, "decode_ms": 32.98949997406453}, "total_wall_ms": 66.98879192117602, "ttft_ms": 26.99575002770871, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2023374848, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14127053032, "mlx_cache_bytes": 13259906098, "process_rss_bytes": 2023374848}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14127053032, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2373 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb37f456e0932fde641cc838", "attempt_id": "429973b0c930", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:30.395432Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 36, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 2.0687499782070518, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.8365420633927, "ttft_ms": 26.8365420633927, "decode_ms": 33.0295420717448}, "total_wall_ms": 66.08074996620417, "ttft_ms": 26.8365420633927, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 36}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2023374848, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14125381864, "mlx_cache_bytes": 13319085106, "process_rss_bytes": 2023374848}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14125381864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2374 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3bcf02ec0e55a14b262d2824", "attempt_id": "7f348f366835", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:30.483407Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 52, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 3.173540928401053, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.63679197616875, "ttft_ms": 28.63679197616875, "decode_ms": 82.42554205935448}, "total_wall_ms": 118.10979107394814, "ttft_ms": 28.63679197616875, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2023374848, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14160123264, "mlx_cache_bytes": 13405502642, "process_rss_bytes": 2023374848}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14160123264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "9,844,780", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "de98064ed9628eaf843fbf3a609313f4264cba6866be2c6a6cf7244cea3c65e7"} | ||||
| 2375 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ff129cd4577fc8c48f30c374", "attempt_id": "9bdf5fc53391", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:30.623223Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 45, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 3.125874907709658, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.81454101204872, "ttft_ms": 27.81454101204872, "decode_ms": 82.45608396828175}, "total_wall_ms": 117.45304195210338, "ttft_ms": 27.81454101204872, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2023374848, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14148665964, "mlx_cache_bytes": 13479623858, "process_rss_bytes": 2023374848}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14148665964, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7,430,110", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "6ec8f3686ca12e2212d5f0b03da40f6c90866d495314345bafd9be7b9638f772"} | ||||
| 2376 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "421fe067179bfdb637a49ede", "attempt_id": "4239e1436c06", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:30.762439Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 53, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 2.0803329534828663, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.405167046003044, "ttft_ms": 28.405167046003044, "decode_ms": 100.58958397712559}, "total_wall_ms": 134.9291669903323, "ttft_ms": 28.405167046003044, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 53}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2023374848, "backend_memory": {"mlx_active_bytes": 13971805192, "mlx_peak_bytes": 14161974820, "mlx_cache_bytes": 13966073298, "process_rss_bytes": 2023374848}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14161974820, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Lithmunpra-16", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "26fc169ceaba84d7f292defd76062949b1b87a9a87be89b5c857b8642cc75061"} | ||||
| 2377 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "82835b005fe44056fbc17f94", "attempt_id": "04c9d4308c98", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:30.919752Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 48, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 3.306083963252604, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.082332923077047, "ttft_ms": 28.082332923077047, "decode_ms": 82.6941670384258}, "total_wall_ms": 118.16579208243638, "ttft_ms": 28.082332923077047, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2023391232, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14150715072, "mlx_cache_bytes": 14046125522, "process_rss_bytes": 2023391232}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14150715072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "11,751,445", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "54807db4e4d4350d94f1b08860da26d63a874494c6fc1937af00f6a1d54fae88"} | ||||
| 2378 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "857e594639c5c950107b3762", "attempt_id": "97d00a7f49e7", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:31.060088Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 44, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 2.2600420052185655, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.737917029298842, "ttft_ms": 27.737917029298842, "decode_ms": 49.498833948746324}, "total_wall_ms": 83.45325000118464, "ttft_ms": 27.737917029298842, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2023391232, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14146632588, "mlx_cache_bytes": 14118575570, "process_rss_bytes": 2023391232}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14146632588, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25.5", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "c2068c8abdd8d15e7c7e5f4b4d103c162fbe4fd0b578c1742d129b2a5565bcd3"} | ||||
| 2379 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1f761a24a633e30bf8da452b", "attempt_id": "0294c74d4853", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:31.166337Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 48, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 3.0308329733088613, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.83658297266811, "ttft_ms": 27.83658297266811, "decode_ms": 16.48054097313434}, "total_wall_ms": 51.43208394292742, "ttft_ms": 27.83658297266811, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2023391232, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14150715072, "mlx_cache_bytes": 14118575570, "process_rss_bytes": 2023391232}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14150715072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2380 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "165428447ef29d8ce3959fa6", "attempt_id": "62e98cbc3013", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:31.239575Z", "task_family": "synthetic", "document_id": "syn_03016_8000", "document_hash": "c087f3475bd3d0ecdd3f33c8a5862c81d3ce40f58b9774fe26f7e5627786e04f", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03016_8000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13620401160}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 5611, "source_tokens_receiver": 5611, "query_tokens": 50, "message_tokens": 5671, "message_utf8_bytes": 29319, "cache_tensor_bytes": 345522688, "serialized_payload_bytes": 345550024, "side_information_bytes": 27336, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 99.01050000917166, "doc_prefill_ms": 840.0982919847593, "compress_ms": 17.965834005735815, "serialize_ms": 80.76512499246746, "load_ms": 3.1546660466119647, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.53912499267608, "ttft_ms": 28.53912499267608, "decode_ms": 16.709374962374568}, "total_wall_ms": 52.51445807516575, "ttft_ms": 28.53912499267608, "input_usage": {"receiver_prefix_tokens": 5671, "dense_cache_bytes": 650395648, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2023391232, "backend_memory": {"mlx_active_bytes": 13970887688, "mlx_peak_bytes": 14160627428, "mlx_cache_bytes": 14201052626, "process_rss_bytes": 2023391232}, "peak_prefill_memory": 13734630452, "peak_decode_memory": 14160627428, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03016_8000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "20fb7e3bed9f32c03e0ffa4391d2759493821c7489e21ae476547bca5c01f2cb", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2381 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "710ea15215ce8afc2fa742f5", "attempt_id": "c699d8df2822", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:31.390854Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11053, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1695.1753330649808, "ttft_ms": 14.817249961197376, "decode_ms": 146.99054101947695}, "total_wall_ms": 1873.2408329378814, "ttft_ms": 14.817249961197376, "input_usage": {"receiver_prompt_tokens": 11053}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 3910083000, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JA-11F-3284", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "023777c48578a936705662567afe9c3480c75ddfdd44d356be3c0bd70dd23b19"} | ||||
| 2382 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe8d4c88ba29087f69277842", "attempt_id": "4985e9b57ef4", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:33.297004Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11045, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1764.931834070012, "ttft_ms": 15.21374995354563, "decode_ms": 15.108291059732437}, "total_wall_ms": 1811.3906659418717, "ttft_ms": 15.21374995354563, "input_usage": {"receiver_prompt_tokens": 11045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4382777784, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2383 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eb0f7ec26004483cdf70a416", "attempt_id": "0c3f4c0b067f", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:35.138702Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11045, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1784.7037080209702, "ttft_ms": 14.938749955035746, "decode_ms": 15.062415972352028}, "total_wall_ms": 1831.3852499704808, "ttft_ms": 14.938749955035746, "input_usage": {"receiver_prompt_tokens": 11045}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4382777784, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2384 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a9475c14accc7c145cc908d6", "attempt_id": "f6c19fd4251a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:37.000565Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11060, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1791.4970419369638, "ttft_ms": 15.37604199256748, "decode_ms": 104.37820910010487}, "total_wall_ms": 1927.8674999950454, "ttft_ms": 15.37604199256748, "input_usage": {"receiver_prompt_tokens": 11060}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1580007424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 4884734392, "process_rss_bytes": 1580007424}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2900830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "1389adb9cdca46e64aa98e98220e08623d97652e5c93ec4ccae05b37be94b109"} | ||||
| 2385 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "076e1fe556d78cfe7673c933", "attempt_id": "87ad223142bf", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:38.960836Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11052, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1805.598207982257, "ttft_ms": 15.11266699526459, "decode_ms": 103.575833956711}, "total_wall_ms": 1941.4397079963237, "ttft_ms": 15.11266699526459, "input_usage": {"receiver_prompt_tokens": 11052}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1580007424, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5099037112, "process_rss_bytes": 1580007424}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2669891", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "ed45a65076eee57e45d0b4ed82ae16ab3710662de8fd3e39bd335322ea1db7d5"} | ||||
| 2386 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fc481ccf2f9e57abd50372e6", "attempt_id": "2b632400bdce", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:40.933083Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11062, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1805.8117090258747, "ttft_ms": 15.42049995623529, "decode_ms": 89.54004105180502}, "total_wall_ms": 1927.8267080662772, "ttft_ms": 15.42049995623529, "input_usage": {"receiver_prompt_tokens": 11062}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5582332344, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardkori-8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "5d133158798e5edb3fdb9ad941ab3920666e3f5dee0d82e771528b4c7592bc54"} | ||||
| 2387 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ebf7e3054f76eb7f62d0f115", "attempt_id": "04f8fa888970", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:42.893403Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11055, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1800.4119580145925, "ttft_ms": 15.254749916493893, "decode_ms": 119.370499975048}, "total_wall_ms": 1951.145957922563, "ttft_ms": 15.254749916493893, "input_usage": {"receiver_prompt_tokens": 11055}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 5950874040, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10442115", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "51a9cef0f73bfc9a8f85cacacc0cde78fc4589ccce6e70956ea1f566f511145e"} | ||||
| 2388 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e66aee4d30cea7e89e98d026", "attempt_id": "941953a9a142", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:44.875542Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11051, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1788.6082499753684, "ttft_ms": 15.280625084415078, "decode_ms": 74.62666695937514}, "total_wall_ms": 1894.6317500667647, "ttft_ms": 15.280625084415078, "input_usage": {"receiver_prompt_tokens": 11051}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6070313400, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13400", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "a524645aa2b384bcad1e91bcef04b1ed66f1ffcc74e57b51cfbc2f55c2e4dcd7"} | ||||
| 2389 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e66d66fc2daa9f4a223c198a", "attempt_id": "7b0c1e3b345c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:46.801232Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11056, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1819.2192920250818, "ttft_ms": 15.421541989780962, "decode_ms": 15.416708076372743}, "total_wall_ms": 1866.316833999008, "ttft_ms": 15.421541989780962, "input_usage": {"receiver_prompt_tokens": 11056}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6406021560, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2390 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4677e0ff80e1c8b60d1d6741", "attempt_id": "e0cefcd7359d", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:48.703132Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 11057, "message_tokens": 10969, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.022000051103532314, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1832.8360409941524, "ttft_ms": 15.399834024719894, "decode_ms": 14.955832972191274}, "total_wall_ms": 1879.1254590032622, "ttft_ms": 15.399834024719894, "input_usage": {"receiver_prompt_tokens": 11057}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1579991040, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13832655936, "mlx_cache_bytes": 6742024632, "process_rss_bytes": 1579991040}, "peak_prefill_memory": null, "peak_decode_memory": 13832655936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2391 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "78d41ca81edc6a40f1753b99", "attempt_id": "746fc39a9908", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:04:59.842363Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 601, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.96475001890212, "ttft_ms": 13.44758307095617, "decode_ms": 136.85274997260422}, "total_wall_ms": 222.89233293849975, "ttft_ms": 13.44758307095617, "input_usage": {"receiver_prompt_tokens": 601, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12993160280, "mlx_cache_bytes": 8526448056, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12993160280, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JA-11F-3284", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "023777c48578a936705662567afe9c3480c75ddfdd44d356be3c0bd70dd23b19"} | ||||
| 2392 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9f5615058e5d475a0e9b9977", "attempt_id": "9d99c7b8e458", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:00.096966Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.80904203373939, "ttft_ms": 13.764416915364563, "decode_ms": 13.648041989654303}, "total_wall_ms": 98.43312506563962, "ttft_ms": 13.764416915364563, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 8872084920, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2393 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea6d0aef5e3f98d5b989972b", "attempt_id": "79c7c22d973f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:00.226746Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 593, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.48854203801602, "ttft_ms": 13.672666973434389, "decode_ms": 13.628290966153145}, "total_wall_ms": 98.02183299325407, "ttft_ms": 13.672666973434389, "input_usage": {"receiver_prompt_tokens": 593, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12990899288, "mlx_cache_bytes": 8872084920, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12990899288, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2394 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0f88023b975b07f28ccb86cb", "attempt_id": "c1d83d7a5615", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:00.355499Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 608, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.70524990558624, "ttft_ms": 13.325958047062159, "decode_ms": 13.322624959982932}, "total_wall_ms": 98.51587505545467, "ttft_ms": 13.325958047062159, "input_usage": {"receiver_prompt_tokens": 608, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997551192, "mlx_cache_bytes": 9241609656, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12997551192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2395 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed670b268c7e7f006ca0f3b1", "attempt_id": "b6fc361d350d", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:00.484469Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 600, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.53541706409305, "ttft_ms": 13.604499981738627, "decode_ms": 13.51416704710573}, "total_wall_ms": 98.79837499465793, "ttft_ms": 13.604499981738627, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12992767064, "mlx_cache_bytes": 9399879096, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12992767064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2396 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b2f1c0b9ad8fb1ff414269c3", "attempt_id": "8df0577d4b6c", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:00.613594Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 610, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.24695801455528, "ttft_ms": 13.879582984372973, "decode_ms": 80.48966596834362}, "total_wall_ms": 169.81079196557403, "ttft_ms": 13.879582984372973, "input_usage": {"receiver_prompt_tokens": 610, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12999599192, "mlx_cache_bytes": 9777071544, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12999599192, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zenymiesh-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "6eb8b512e13e00d3354e225efbb77f69a7b6ab1dea765071743af4ff4ec3c307"} | ||||
| 2397 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "46593691dc620e4e20a8f16b", "attempt_id": "ed5ef756f850", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:00.813438Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 603, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.35429205279797, "ttft_ms": 13.590540969744325, "decode_ms": 67.36970797646791}, "total_wall_ms": 152.4494580226019, "ttft_ms": 13.590540969744325, "input_usage": {"receiver_prompt_tokens": 603, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13010183256, "mlx_cache_bytes": 10047161784, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 13010183256, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "25920", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "d76793a014e9858798ed002af610fc33f6aa4fcd682cd44742732ea94f32c6b3"} | ||||
| 2398 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b541e612755d1260a1ee45c2", "attempt_id": "48ead5fafc96", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:00.996216Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 599, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 69.74895799066871, "ttft_ms": 13.364667072892189, "decode_ms": 67.24062492139637}, "total_wall_ms": 151.5267079230398, "ttft_ms": 13.364667072892189, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12994929752, "mlx_cache_bytes": 10135340472, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12994929752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13400", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "a524645aa2b384bcad1e91bcef04b1ed66f1ffcc74e57b51cfbc2f55c2e4dcd7"} | ||||
| 2399 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c400f1dd7cea042addddf323", "attempt_id": "a21a50ca2b13", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:01.177667Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 604, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 70.52533305250108, "ttft_ms": 13.451374950818717, "decode_ms": 13.546625035814941}, "total_wall_ms": 98.67654100526124, "ttft_ms": 13.451374950818717, "input_usage": {"receiver_prompt_tokens": 604, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13008282712, "mlx_cache_bytes": 10383754680, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 13008282712, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2400 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "123f7b7900d573c3ceeb707c", "attempt_id": "f1e3bb4ddb64", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:01.306344Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 605, "message_tokens": 512, "message_utf8_bytes": 1822, "cache_tensor_bytes": null, "serialized_payload_bytes": 1822, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9228.952208999544, "decode_payload_ms": 0.0, "receiver_prefill_ms": 71.36729103513062, "ttft_ms": 13.53241701144725, "decode_ms": 13.737292028963566}, "total_wall_ms": 99.79112492874265, "ttft_ms": 13.53241701144725, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 11085, "sender_output_tokens": 512, "sender_prefill_ms": 1835.2472089463845, "sender_ttft_ms": 15.92933398205787, "sender_decode_ms": 7368.28770802822}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580122112, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996125784, "mlx_cache_bytes": 10632463800, "process_rss_bytes": 1580122112}, "peak_prefill_memory": null, "peak_decode_memory": 12996125784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "859950e87edabde8a9ad0091ccff40f28b81925360df117aea9f5dea6316901f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2401 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c3d8d75fe6c09c9db79a534d", "attempt_id": "f72d39156de5", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:10.796926Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 456, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.938499979674816, "ttft_ms": 13.87395802885294, "decode_ms": 13.430292019620538}, "total_wall_ms": 84.2666249955073, "ttft_ms": 13.87395802885294, "input_usage": {"receiver_prompt_tokens": 456, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978658188, "mlx_cache_bytes": 11570875604, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12978658188, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2402 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a8dc538d2d20e7105cdf5219", "attempt_id": "e15fc2f9ecab", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:10.912558Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 448, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 54.127083043567836, "ttft_ms": 13.38329107966274, "decode_ms": 13.326541986316442}, "total_wall_ms": 81.80462499149144, "ttft_ms": 13.38329107966274, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12972530572, "mlx_cache_bytes": 11920968916, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12972530572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2403 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f47618771a6fb3be5f5510cc", "attempt_id": "11a16de5ac31", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.024566Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 448, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 53.65037498995662, "ttft_ms": 13.568583992309868, "decode_ms": 13.567665941081941}, "total_wall_ms": 81.7005829885602, "ttft_ms": 13.568583992309868, "input_usage": {"receiver_prompt_tokens": 448, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12972530572, "mlx_cache_bytes": 11920968916, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12972530572, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2404 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1665d35a69dc8c51e832b07e", "attempt_id": "4ad55ea4f2bb", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.137190Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 463, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.11741705797613, "ttft_ms": 13.601416954770684, "decode_ms": 13.466166914440691}, "total_wall_ms": 84.15841695386916, "ttft_ms": 13.601416954770684, "input_usage": {"receiver_prompt_tokens": 463, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12903504784, "mlx_cache_bytes": 12204315660, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12903504784, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2405 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b5cbc8ea2e2d2839b6d5d2f2", "attempt_id": "05f6880cced0", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.252501Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 455, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 58.30770800821483, "ttft_ms": 14.385749935172498, "decode_ms": 13.454791973344982}, "total_wall_ms": 87.13287499267608, "ttft_ms": 14.385749935172498, "input_usage": {"receiver_prompt_tokens": 455, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978396044, "mlx_cache_bytes": 12293575692, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12978396044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2406 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "33a123a3517c3b6924475825", "attempt_id": "e3aad1e81e64", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.369945Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 465, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 58.382541057653725, "ttft_ms": 13.564915978349745, "decode_ms": 13.390000094659626}, "total_wall_ms": 86.32383297663182, "ttft_ms": 13.564915978349745, "input_usage": {"receiver_prompt_tokens": 465, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904389528, "mlx_cache_bytes": 12484680524, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12904389528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2407 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "619c1c8bfcd2fa9a7b1aff3e", "attempt_id": "5fac28153f3d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.486840Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 458, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 59.05562499538064, "ttft_ms": 13.829250005073845, "decode_ms": 93.78474997356534}, "total_wall_ms": 167.64679097104818, "ttft_ms": 13.829250005073845, "input_usage": {"receiver_prompt_tokens": 458, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12930522144, "mlx_cache_bytes": 12713909068, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12930522144, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "7670195", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "799d54acea7157638b07d7c6fea4e348ecfb830c0bba29fbad4beb3d5b329459"} | ||||
| 2408 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "01dfa1b862381cfdbe77b16c", "attempt_id": "c725fcb7dcfc", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.685022Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 454, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 58.21237503550947, "ttft_ms": 14.037500019185245, "decode_ms": 13.52775003761053}, "total_wall_ms": 86.7318749660626, "ttft_ms": 14.037500019185245, "input_usage": {"receiver_prompt_tokens": 454, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12977609612, "mlx_cache_bytes": 12873554764, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12977609612, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2409 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "02ab86b4298d35e97f4af762", "attempt_id": "2f3e3ae55e8a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.803074Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 459, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 58.95383399911225, "ttft_ms": 13.743999996222556, "decode_ms": 13.175125000998378}, "total_wall_ms": 86.82366600260139, "ttft_ms": 13.743999996222556, "input_usage": {"receiver_prompt_tokens": 459, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12930653264, "mlx_cache_bytes": 13082385228, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12930653264, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2410 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "187859a5cd9ed963002d6480", "attempt_id": "4bf0ba62e755", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:11.920675Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 460, "message_tokens": 356, "message_utf8_bytes": 888, "cache_tensor_bytes": null, "serialized_payload_bytes": 888, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9360.260665998794, "decode_payload_ms": 0.0, "receiver_prefill_ms": 58.98329196497798, "ttft_ms": 13.67033296264708, "decode_ms": 13.437959016300738}, "total_wall_ms": 87.03183406032622, "ttft_ms": 13.67033296264708, "input_usage": {"receiver_prompt_tokens": 460, "sender_input_tokens": 11113, "sender_output_tokens": 512, "sender_prefill_ms": 1881.2742080772296, "sender_ttft_ms": 15.395374968647957, "sender_decode_ms": 7451.891458011232}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580154880, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12915776436, "mlx_cache_bytes": 13271423820, "process_rss_bytes": 1580154880}, "peak_prefill_memory": null, "peak_decode_memory": 12915776436, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "3f9c814454a6ec4d13f1e0a069c58262fab0d141bfd1440d9ecbd9c2a7ad17d1", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2411 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b27fd427685f6567a36a2c40", "attempt_id": "c9819a9ba358", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:12.046365Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 580, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.19258302636445, "ttft_ms": 13.939833967015147, "decode_ms": 13.528916984796524}, "total_wall_ms": 103.70287508703768, "ttft_ms": 13.939833967015147, "input_usage": {"receiver_prompt_tokens": 580}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12983231576, "mlx_cache_bytes": 13624138572, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12983231576, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2412 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "94b54325c2bc8594614a02b9", "attempt_id": "3c582986ce6d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:12.180234Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 572, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.87024990748614, "ttft_ms": 13.699291972443461, "decode_ms": 13.35841603577137}, "total_wall_ms": 101.96687502320856, "ttft_ms": 13.699291972443461, "input_usage": {"receiver_prompt_tokens": 572}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978512984, "mlx_cache_bytes": 13957782348, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12978512984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2413 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "135457661ae9d9770cf4a716", "attempt_id": "5a99b6ebc45a", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:12.313090Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 572, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.59108398668468, "ttft_ms": 13.613124960102141, "decode_ms": 13.538084109313786}, "total_wall_ms": 101.76179104018956, "ttft_ms": 13.613124960102141, "input_usage": {"receiver_prompt_tokens": 572}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12978512984, "mlx_cache_bytes": 13957782348, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12978512984, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "no", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "9390298f3fb0c5b160498935d79cb139aef28e1c47358b4bbba61862b9c26e59"} | ||||
| 2414 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5a34f368b2b26eb91d5cb5d8", "attempt_id": "112a5f047ec5", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:12.445573Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 587, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.30133300740272, "ttft_ms": 13.637667056173086, "decode_ms": 94.0879579866305}, "total_wall_ms": 187.08858301397413, "ttft_ms": 13.637667056173086, "input_usage": {"receiver_prompt_tokens": 587}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13007692888, "mlx_cache_bytes": 14220794700, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 13007692888, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2900830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "1389adb9cdca46e64aa98e98220e08623d97652e5c93ec4ccae05b37be94b109"} | ||||
| 2415 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "99496489c787874de15e8c87", "attempt_id": "2d6260b1ffed", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:12.663252Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 579, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.7357080001384, "ttft_ms": 13.518166029825807, "decode_ms": 121.62766698747873}, "total_wall_ms": 211.8881669593975, "ttft_ms": 13.518166029825807, "input_usage": {"receiver_prompt_tokens": 579}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982641752, "mlx_cache_bytes": 14458788684, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12982641752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,669,891", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "8fe1b189ae1a151b07a072a9524b1d00e8f7708d41aa40359d72e25fbfd6d513"} | ||||
| 2416 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3b0f64aef8cf58e64a094c92", "attempt_id": "ea469256dd4f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:12.906490Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 589, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 74.0012499736622, "ttft_ms": 13.76641693059355, "decode_ms": 81.83749997988343}, "total_wall_ms": 170.6522919703275, "ttft_ms": 13.76641693059355, "input_usage": {"receiver_prompt_tokens": 589}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12989178968, "mlx_cache_bytes": 14701009740, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12989178968, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zenymiesh-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "6eb8b512e13e00d3354e225efbb77f69a7b6ab1dea765071743af4ff4ec3c307"} | ||||
| 2417 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "525330ea3125538c8b56e417", "attempt_id": "14580c09367e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:13.107425Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 582, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.36729201395065, "ttft_ms": 13.662290992215276, "decode_ms": 81.3075409969315}, "total_wall_ms": 168.41308400034904, "ttft_ms": 13.662290992215276, "input_usage": {"receiver_prompt_tokens": 582}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12996715608, "mlx_cache_bytes": 15031180108, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12996715608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "842211", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "22a4035cc51d5e6900c32b6d713aa2cb22155a6e8166626aa8feb0faf0b64419"} | ||||
| 2418 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c8d95070cee7af1d978da957", "attempt_id": "724a30aa2140", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:13.305680Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 578, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 72.62179197277874, "ttft_ms": 13.830457930453122, "decode_ms": 13.479291927069426}, "total_wall_ms": 101.02733399253339, "ttft_ms": 13.830457930453122, "input_usage": {"receiver_prompt_tokens": 578}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12982641752, "mlx_cache_bytes": 15031180108, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12982641752, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2419 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "03330f6828d15a74c8573ef3", "attempt_id": "e042855cec48", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:13.437809Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 583, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 73.86987493373454, "ttft_ms": 13.68983299471438, "decode_ms": 13.45995906740427}, "total_wall_ms": 102.11058298591524, "ttft_ms": 13.68983299471438, "input_usage": {"receiver_prompt_tokens": 583}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997207128, "mlx_cache_bytes": 15270943564, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12997207128, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2420 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f0cafe0badf2d3045c540b09", "attempt_id": "080383b21656", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:13.570733Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 497, "n_sentences": 14}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 584, "message_tokens": 495, "message_utf8_bytes": 1246, "cache_tensor_bytes": null, "serialized_payload_bytes": 1246, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.80295894946903, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.53862500935793, "ttft_ms": 13.785624993033707, "decode_ms": 13.559916988015175}, "total_wall_ms": 103.90833392739296, "ttft_ms": 13.785624993033707, "input_usage": {"receiver_prompt_tokens": 584}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1580187648, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12997600344, "mlx_cache_bytes": 15511100236, "process_rss_bytes": 1580187648}, "peak_prefill_memory": null, "peak_decode_memory": 12997600344, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4e1099a9587328368b63e56bf0a081d62d1f4b933485d826bd967c8fcc8473ad", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2421 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "acc1a48889115b3cf9743c0d", "attempt_id": "b41e8b251661", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:15.757159Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 45, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.7445409903302789, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.006709000095725, "ttft_ms": 34.006709000095725, "decode_ms": 141.93754200823605}, "total_wall_ms": 191.57995900604874, "ttft_ms": 34.006709000095725, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1678508032, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268899060, "mlx_cache_bytes": 16005637278, "process_rss_bytes": 1678508032}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268899060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RA-53U-8092", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "65c601ab87e10a79261f364233c63c116236143b0f2791666cf688c2cfb92259"} | ||||
| 2422 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0719a0cd88f8501fd435518a", "attempt_id": "87ea8d7e6f7b", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:15.980678Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 37, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.9822920439764857, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.265416997484863, "ttft_ms": 31.265416997484863, "decode_ms": 14.434250071644783}, "total_wall_ms": 56.20179104153067, "ttft_ms": 31.265416997484863, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1678508032, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13261886708, "mlx_cache_bytes": 16030540958, "process_rss_bytes": 1678508032}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13261886708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2423 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b6f22ef55f6cad91d8863d7c", "attempt_id": "86ca68f7ef9e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:16.067684Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 37, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.9040830666199327, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.026874901726842, "ttft_ms": 31.026874901726842, "decode_ms": 14.022125047631562}, "total_wall_ms": 55.50316604785621, "ttft_ms": 31.026874901726842, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1678508032, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13261886708, "mlx_cache_bytes": 16030540958, "process_rss_bytes": 1678508032}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13261886708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 2424 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9ed894dbb1ea6ec5832c93bb", "attempt_id": "fa4984d04144", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:16.153257Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 52, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.6827499493956566, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.86737503670156, "ttft_ms": 29.86737503670156, "decode_ms": 126.95700000040233}, "total_wall_ms": 167.02449996955693, "ttft_ms": 29.86737503670156, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 52}, "output_usage": {"output_tokens": 9}, "provider_cached_usage": null, "process_memory": 1678508032, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13274273040, "mlx_cache_bytes": 16080201278, "process_rss_bytes": 1678508032}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274273040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,017,859", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "961f38ac45cab18d04f2287dd87567bb0897a7268c049ca12a8e83dcc21ecdc4"} | ||||
| 2425 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "88cfd783c631032d6cd85e8b", "attempt_id": "b76816005ad6", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:16.351018Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 44, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 0.9266670094802976, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.18658300768584, "ttft_ms": 29.18658300768584, "decode_ms": 70.56808401830494}, "total_wall_ms": 108.69729099795222, "ttft_ms": 29.18658300768584, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 44}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1678524416, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268604148, "mlx_cache_bytes": 16093587006, "process_rss_bytes": 1678524416}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268604148, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "12345", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "5994471abb01112afcc18159f6cc74b4f511b99806da59b3caf5a9c173cacfc5"} | ||||
| 2426 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7265051404dbeb3b576b1077", "attempt_id": "de0b7f730c8c", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:16.490614Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 54, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.877833972685039, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.195250106975436, "ttft_ms": 31.195250106975436, "decode_ms": 85.26666590478271}, "total_wall_ms": 126.58908392768353, "ttft_ms": 31.195250106975436, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1678524416, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13280826652, "mlx_cache_bytes": 16126584814, "process_rss_bytes": 1678524416}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13280826652, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardkori-8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "5d133158798e5edb3fdb9ad941ab3920666e3f5dee0d82e771528b4c7592bc54"} | ||||
| 2427 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7bffeec468efe85a4b3dc8bd", "attempt_id": "21f6364f6a09", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:16.648321Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 2.0221670856699347, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.494916019961238, "ttft_ms": 30.494916019961238, "decode_ms": 99.7172089992091}, "total_wall_ms": 140.36779198795557, "ttft_ms": 30.494916019961238, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1678524416, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270324496, "mlx_cache_bytes": 16126584814, "process_rss_bytes": 1678524416}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270324496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2074714", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "88565cea973e563c710768b9090737806a7146e531b289380059edfae6d54e32"} | ||||
| 2428 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "436345aa38692fb7f22433a6", "attempt_id": "118f4611ae5d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:16.820096Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 43, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.7202920280396938, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.194959021173418, "ttft_ms": 30.194959021173418, "decode_ms": 70.84025000222027}, "total_wall_ms": 111.52695794589818, "ttft_ms": 30.194959021173418, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1678524416, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270455540, "mlx_cache_bytes": 16145360878, "process_rss_bytes": 1678524416}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270455540, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "15000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "d4c999ae43633bd2036188d2bca68e1be8202b2cc1f3a1c42a728eaff7d2483d"} | ||||
| 2429 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c99fe1760eb1a9f106c9dcb3", "attempt_id": "d53f22f671f1", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:16.962809Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 48, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.913374988362193, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.57720891572535, "ttft_ms": 29.57720891572535, "decode_ms": 14.027792029082775}, "total_wall_ms": 53.7895419402048, "ttft_ms": 29.57720891572535, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1678524416, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270897936, "mlx_cache_bytes": 16179128302, "process_rss_bytes": 1678524416}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270897936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2430 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "133977f6ab2dd29fb5a8ac1b", "attempt_id": "105c5fe81899", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:17.047315Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13104632840}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 11008, "keep": 2752, "compress_ms": 11.26508298330009}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 49, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466007, "side_information_bytes": 16279, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 2050.996999954805, "doc_prefill_ms": 1998.522707959637, "compress_ms": 11.301124934107065, "serialize_ms": 24.417708977125585, "load_ms": 1.906791003420949, "receiver_prefill_ms": 0.0, "query_prefill_ms": 31.18425002321601, "ttft_ms": 31.18425002321601, "decode_ms": 14.13304207380861}, "total_wall_ms": 55.22479198407382, "ttft_ms": 31.18425002321601, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1678524416, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13272306960, "mlx_cache_bytes": 16213485550, "process_rss_bytes": 1678524416}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272306960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cffb63a74038c704a5acf547c248699758631dda3ddfeba73519e5335c72291b", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2431 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cb23876f015f274c9d472ca", "attempt_id": "17f1874ef75a", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:17.134096Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 45, "compress_ms": 128.79858305677772}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 45, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466048, "side_information_bytes": 16320, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 173.81762503646314, "doc_prefill_ms": 1998.522707959637, "compress_ms": 136.91524998284876, "serialize_ms": 36.77604102995247, "load_ms": 2.0308749517425895, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.792249948717654, "ttft_ms": 30.792249948717654, "decode_ms": 140.88162500411272}, "total_wall_ms": 355.6492089992389, "ttft_ms": 30.792249948717654, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1330429952, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268899060, "mlx_cache_bytes": 16653903990, "process_rss_bytes": 1330429952}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268899060, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JA-11F-3284", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "59027a476508a59c83089ffe8263c9ca9c0adb45e47ea3ed61dc194f393fc2aa", "output_hash": "023777c48578a936705662567afe9c3480c75ddfdd44d356be3c0bd70dd23b19"} | ||||
| 2432 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "64bf64fd9472b595cead7143", "attempt_id": "0f3d13d72c50", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:17.521218Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 37, "compress_ms": 89.84541706740856}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 37, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 148.60279194545, "doc_prefill_ms": 1998.522707959637, "compress_ms": 97.86683297716081, "serialize_ms": 50.605749944224954, "load_ms": 1.766500063240528, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.717374989762902, "ttft_ms": 30.717374989762902, "decode_ms": 14.0990000218153}, "total_wall_ms": 203.76379194203764, "ttft_ms": 30.717374989762902, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1256390656, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13261886708, "mlx_cache_bytes": 16692422774, "process_rss_bytes": 1256390656}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13261886708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2433 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a3f9b78f7492390f03a7894", "attempt_id": "a2199c7b4fc9", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:17.757279Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 37, "compress_ms": 89.1951669473201}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 37, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466046, "side_information_bytes": 16318, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 244.90987497847527, "doc_prefill_ms": 1998.522707959637, "compress_ms": 97.14550001081079, "serialize_ms": 147.63866702560335, "load_ms": 1.1897090589627624, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.947791994549334, "ttft_ms": 30.947791994549334, "decode_ms": 14.03637498151511}, "total_wall_ms": 299.81004097498953, "ttft_ms": 30.947791994549334, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1082671104, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13261886708, "mlx_cache_bytes": 16692422774, "process_rss_bytes": 1082671104}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13261886708, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bf1065956912614db2febe5c01f5d64af72dfb61cfacc8b6b3fc8dbc0c547032", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2434 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5d32e9e49f34a42a4c93460f", "attempt_id": "4b12eda62cd7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:18.088760Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 52, "compress_ms": 92.10587502457201}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 52, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 174.30275003425777, "doc_prefill_ms": 1998.522707959637, "compress_ms": 100.19166697748005, "serialize_ms": 73.98458302486688, "load_ms": 1.7940830439329147, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.918040963821113, "ttft_ms": 29.918040963821113, "decode_ms": 98.64862507674843}, "total_wall_ms": 312.9952499875799, "ttft_ms": 29.918040963821113, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1082703872, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13274273040, "mlx_cache_bytes": 16736512118, "process_rss_bytes": 1082703872}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13274273040, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2900830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "1389adb9cdca46e64aa98e98220e08623d97652e5c93ec4ccae05b37be94b109"} | ||||
| 2435 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9bae76f8161e0f9c1c8a1106", "attempt_id": "16b8b0f90597", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:18.433807Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 44, "compress_ms": 89.57224991172552}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 44, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 113.1861669709906, "doc_prefill_ms": 1998.522707959637, "compress_ms": 97.55241707898676, "serialize_ms": 15.513833030126989, "load_ms": 1.773625030182302, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.15816695895046, "ttft_ms": 29.15816695895046, "decode_ms": 85.0720830494538}, "total_wall_ms": 237.4764169799164, "ttft_ms": 29.15816695895046, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 44}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1082720256, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268292852, "mlx_cache_bytes": 16772556918, "process_rss_bytes": 1082720256}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268292852, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "268119", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "72b7d6a76da4b3e222fd548708367a1907b0ebc82a7bada3ba635a3cd21a5798"} | ||||
| 2436 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8e734ba70d24d0bf55413d63", "attempt_id": "710752ccc804", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:18.702775Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 54, "compress_ms": 90.94304195605218}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 54, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 120.48633291851729, "doc_prefill_ms": 1998.522707959637, "compress_ms": 98.87841599993408, "serialize_ms": 21.475624991580844, "load_ms": 1.627334044314921, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.976333025842905, "ttft_ms": 29.976333025842905, "decode_ms": 84.32987495325506}, "total_wall_ms": 244.60083292797208, "ttft_ms": 29.976333025842905, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1082736640, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13276517656, "mlx_cache_bytes": 16827803766, "process_rss_bytes": 1082736640}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13276517656, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardkori-8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "5d133158798e5edb3fdb9ad941ab3920666e3f5dee0d82e771528b4c7592bc54"} | ||||
| 2437 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b631caa9030d9cc75775597e", "attempt_id": "d73692f49d41", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:18.978590Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 47, "compress_ms": 90.51387500949204}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.46133395656943, "doc_prefill_ms": 1998.522707959637, "compress_ms": 98.72175008058548, "serialize_ms": 15.614916919730604, "load_ms": 1.6779580619186163, "receiver_prefill_ms": 0.0, "query_prefill_ms": 34.17258302215487, "ttft_ms": 34.17258302215487, "decode_ms": 98.76795799937099}, "total_wall_ms": 257.2599579580128, "ttft_ms": 34.17258302215487, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1082753024, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270324496, "mlx_cache_bytes": 16860915830, "process_rss_bytes": 1082753024}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270324496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "1039214", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "17eeda6f539267c2dac20484e1d26546cf52a8f86b8b34159720c2a12ffba84d"} | ||||
| 2438 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b5a48f5ed272006b58d5ee2b", "attempt_id": "952ac1a91cee", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:19.267330Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 43, "compress_ms": 89.752999949269}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 43, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466045, "side_information_bytes": 16317, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 113.45154198352247, "doc_prefill_ms": 1998.522707959637, "compress_ms": 97.87408309057355, "serialize_ms": 15.444500022567809, "load_ms": 0.7637499365955591, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.80712498538196, "ttft_ms": 29.80712498538196, "decode_ms": 70.53733395878226}, "total_wall_ms": 222.82841603737324, "ttft_ms": 29.80712498538196, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1082753024, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13268276468, "mlx_cache_bytes": 16892291190, "process_rss_bytes": 1082753024}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13268276468, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13410", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "e8a76948040b092ce48157846389d5487c6a2e14737a88856b8f3331e5eea010", "output_hash": "6dd4f2758287be9f38e0e93c71146c76e90f83f0b8c9b49760fc0b594494607b"} | ||||
| 2439 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1613d920ae61f4b097b009d5", "attempt_id": "bdd2dea17ee4", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:19.521386Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 48, "compress_ms": 90.86924989242107}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 48, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.41295896656811, "doc_prefill_ms": 1998.522707959637, "compress_ms": 98.8877919735387, "serialize_ms": 15.401917044073343, "load_ms": 1.7581250285729766, "receiver_prefill_ms": 0.0, "query_prefill_ms": 29.180499957874417, "ttft_ms": 29.180499957874417, "decode_ms": 14.103875029832125}, "total_wall_ms": 167.58979100268334, "ttft_ms": 29.180499957874417, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1082753024, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13270897936, "mlx_cache_bytes": 16926107766, "process_rss_bytes": 1082753024}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13270897936, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2440 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2359397419e684ba75046059", "attempt_id": "0b73b1c12e30", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:19.720585Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13003183112}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 11008, "keep": 2752, "window_tokens": 49, "compress_ms": 90.42975003831089}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 49, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 101449728, "serialized_payload_bytes": 101466047, "side_information_bytes": 16319, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 114.41741697490215, "doc_prefill_ms": 1998.522707959637, "compress_ms": 98.36720896419138, "serialize_ms": 15.928291948512197, "load_ms": 1.7200000584125519, "receiver_prefill_ms": 0.0, "query_prefill_ms": 30.67349991761148, "ttft_ms": 30.67349991761148, "decode_ms": 13.962167082354426}, "total_wall_ms": 169.0322089707479, "ttft_ms": 30.67349991761148, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1082753024, "backend_memory": {"mlx_active_bytes": 13208441864, "mlx_peak_bytes": 13272306960, "mlx_cache_bytes": 16960628854, "process_rss_bytes": 1082753024}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13272306960, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "74458199fe5480fc4d176533edffc2518b40f9be0e591afcd0e6ddac4d5dc44c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2441 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fb449a7f5eaa6c1bf3bea1d7", "attempt_id": "6956075518f6", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:20.783984Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 45, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 5.451417062431574, "receiver_prefill_ms": 0.0, "query_prefill_ms": 760.136374970898, "ttft_ms": 760.136374970898, "decode_ms": 178.22633392643183}, "total_wall_ms": 952.1076249657199, "ttft_ms": 760.136374970898, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 45}, "output_usage": {"output_tokens": 10}, "provider_cached_usage": null, "process_memory": 1145651200, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13643159226, "mlx_cache_bytes": 17550885190, "process_rss_bytes": 1145651200}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13643159226, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JA-11F-3284", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "023777c48578a936705662567afe9c3480c75ddfdd44d356be3c0bd70dd23b19"} | ||||
| 2442 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7a64e3efde40575e6e9c5562", "attempt_id": "cb4510720a5b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:21.770968Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 37, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.5555420434102416, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.70762502588332, "ttft_ms": 36.70762502588332, "decode_ms": 17.337791970930994}, "total_wall_ms": 66.06129207648337, "ttft_ms": 36.70762502588332, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1145651200, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13615486445, "mlx_cache_bytes": 17655611718, "process_rss_bytes": 1145651200}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13615486445, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2443 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "19ec21985f86ebd84146437f", "attempt_id": "d4f3474769c9", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:21.876676Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 37, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.3382920771837234, "receiver_prefill_ms": 0.0, "query_prefill_ms": 35.93974991235882, "ttft_ms": 35.93974991235882, "decode_ms": 16.98433398269117}, "total_wall_ms": 63.484332989901304, "ttft_ms": 35.93974991235882, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1145667584, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13615486445, "mlx_cache_bytes": 17655611718, "process_rss_bytes": 1145667584}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13615486445, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2444 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9a2a34a3681115505dc3ee1f", "attempt_id": "65d539514076", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:21.974945Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 52, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.4722920497879386, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.130458910018206, "ttft_ms": 38.130458910018206, "decode_ms": 119.1073750378564}, "total_wall_ms": 168.6284999595955, "ttft_ms": 38.130458910018206, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 52}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1145667584, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13666460185, "mlx_cache_bytes": 17804105734, "process_rss_bytes": 1145667584}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13666460185, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2900830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "1389adb9cdca46e64aa98e98220e08623d97652e5c93ec4ccae05b37be94b109"} | ||||
| 2445 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b0545fdacde3049e6cf49aa9", "attempt_id": "d4a2ff480cdc", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:22.177195Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 44, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.8420420130714774, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.40208300203085, "ttft_ms": 36.40208300203085, "decode_ms": 114.02050009928644}, "total_wall_ms": 161.6072909673676, "ttft_ms": 36.40208300203085, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1145667584, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13639684474, "mlx_cache_bytes": 17929607174, "process_rss_bytes": 1145667584}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13639684474, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2669891", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "ed45a65076eee57e45d0b4ed82ae16ab3710662de8fd3e39bd335322ea1db7d5"} | ||||
| 2446 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e95235a97a2e248a98f64aa7", "attempt_id": "da4e28eca566", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:22.371463Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 54, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.6895839255303144, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.24408305808902, "ttft_ms": 38.24408305808902, "decode_ms": 97.86145796533674}, "total_wall_ms": 146.89824997913092, "ttft_ms": 38.24408305808902, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 54}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1145667584, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13673931529, "mlx_cache_bytes": 18083786662, "process_rss_bytes": 1145667584}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13673931529, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardkori-8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "5d133158798e5edb3fdb9ad941ab3920666e3f5dee0d82e771528b4c7592bc54"} | ||||
| 2447 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "08566b40d24da87b8d891f7b", "attempt_id": "a3f39e926943", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:22.549292Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 47, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 1.857292023487389, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.49654197599739, "ttft_ms": 37.49654197599739, "decode_ms": 130.60745794791728}, "total_wall_ms": 177.89908300619572, "ttft_ms": 37.49654197599739, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 47}, "output_usage": {"output_tokens": 8}, "provider_cached_usage": null, "process_memory": 1145667584, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13649534393, "mlx_cache_bytes": 18216824742, "process_rss_bytes": 1145667584}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13649534393, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "10492534", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "bace09eb74ebda3cc9d91e0ddd4d458057fc5bd31fd4c3899097c713ac664601"} | ||||
| 2448 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "992695228ff085c09a6f6567", "attempt_id": "f19178633b9b", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:22.757902Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 43, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.7044169837608933, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.601917003281415, "ttft_ms": 36.601917003281415, "decode_ms": 81.37975004501641}, "total_wall_ms": 128.77720908727497, "ttft_ms": 36.601917003281415, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 43}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1145667584, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13638553489, "mlx_cache_bytes": 18338590630, "process_rss_bytes": 1145667584}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13638553489, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13400", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "a524645aa2b384bcad1e91bcef04b1ed66f1ffcc74e57b51cfbc2f55c2e4dcd7"} | ||||
| 2449 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f996706741ba13232dfaa698", "attempt_id": "3401208eea16", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:22.917220Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 48, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.4281659862026572, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.8802499724552, "ttft_ms": 36.8802499724552, "decode_ms": 16.469875001348555}, "total_wall_ms": 63.90583305619657, "ttft_ms": 36.8802499724552, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 48}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1145683968, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13652696505, "mlx_cache_bytes": 18475593638, "process_rss_bytes": 1145683968}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13652696505, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2450 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2fb7cf2a611d0430e24520ea", "attempt_id": "8208efea183e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:23.012239Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "receiver_model_revision": "mlx-community/Qwen2.5-3B-Instruct-bf16@bec1ad658e380044bbfe06d4a2268801d3379a11", "tokenizer_hashes": {"sender": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b", "receiver": "5c5a439ba2677fe28e1dea9b22371b270ecd5e34acbc849bc619689605f9547b"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13220238344}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10969, "source_tokens_receiver": 10969, "query_tokens": 49, "message_tokens": 11008, "message_utf8_bytes": 58829, "cache_tensor_bytes": 215580672, "serialized_payload_bytes": 215615744, "side_information_bytes": 35072, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 862.9688749788329, "doc_prefill_ms": 1998.522707959637, "compress_ms": 12.702040956355631, "serialize_ms": 849.8747919220477, "load_ms": 2.6480420492589474, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.249583983793855, "ttft_ms": 37.249583983793855, "decode_ms": 16.80208300240338}, "total_wall_ms": 64.63862501550466, "ttft_ms": 37.249583983793855, "input_usage": {"receiver_prefix_tokens": 11008, "dense_cache_bytes": 405798912, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1145683968, "backend_memory": {"mlx_active_bytes": 13438473224, "mlx_peak_bytes": 13656907193, "mlx_cache_bytes": 18614398886, "process_rss_bytes": 1145683968}, "peak_prefill_memory": 13832655936, "peak_decode_memory": 13656907193, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "bb8a9cc69b4f743a53c2ab79b12cb8a5f005277b03cfd82d7c699b55d2cb2f0d", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2451 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "426cec6e51c7233d1696c085", "attempt_id": "0365a51ab267", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:23.837695Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10894, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 2150.909416959621, "ttft_ms": 16.32854202762246, "decode_ms": 112.22466605249792}, "total_wall_ms": 2294.101709034294, "ttft_ms": 16.32854202762246, "input_usage": {"receiver_prompt_tokens": 10894}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 756645888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14287410240, "mlx_cache_bytes": 6176301400, "process_rss_bytes": 756645888}, "peak_prefill_memory": null, "peak_decode_memory": 14287410240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JA-11F-3284", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "023777c48578a936705662567afe9c3480c75ddfdd44d356be3c0bd70dd23b19"} | ||||
| 2452 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e6939764293a68e36b18977d", "attempt_id": "fecc0784efb5", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:26.173101Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10887, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1555.9839169727638, "ttft_ms": 16.666540992446244, "decode_ms": 33.15854200627655}, "total_wall_ms": 1620.9936660015956, "ttft_ms": 16.666540992446244, "input_usage": {"receiver_prompt_tokens": 10887}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 756645888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14285132864, "mlx_cache_bytes": 6418768216, "process_rss_bytes": 756645888}, "peak_prefill_memory": null, "peak_decode_memory": 14285132864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2453 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a5e843b1b7746ae11a6c151c", "attempt_id": "2d6b82f0448c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:27.824624Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10888, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1703.562958049588, "ttft_ms": 16.719124978408217, "decode_ms": 33.564041019417346}, "total_wall_ms": 1768.607083009556, "ttft_ms": 16.719124978408217, "input_usage": {"receiver_prompt_tokens": 10888}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 756645888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14285378624, "mlx_cache_bytes": 6546039128, "process_rss_bytes": 756645888}, "peak_prefill_memory": null, "peak_decode_memory": 14285378624, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2454 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4e50af17d55b8d75aa29220a", "attempt_id": "d411d3216555", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:29.622122Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10902, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1821.4083329075947, "ttft_ms": 17.008334049023688, "decode_ms": 83.60579202417284}, "total_wall_ms": 1936.7670000065118, "ttft_ms": 17.008334049023688, "input_usage": {"receiver_prompt_tokens": 10902}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 756629504, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14290474048, "mlx_cache_bytes": 6810214744, "process_rss_bytes": 756629504}, "peak_prefill_memory": null, "peak_decode_memory": 14290474048, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,900,830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "05b0bcd84be8ddbe71ddec72d4f72c4f385ecda37c0f830cd4e2627180f51176"} | ||||
| 2455 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a7ff6d652571d14e301c5ed0", "attempt_id": "8f172701ddbc", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:31.587644Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10895, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1832.3404580587521, "ttft_ms": 17.045042011886835, "decode_ms": 84.2751250602305}, "total_wall_ms": 1951.2571670347825, "ttft_ms": 17.045042011886835, "input_usage": {"receiver_prompt_tokens": 10895}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 756645888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14288000064, "mlx_cache_bytes": 7012819288, "process_rss_bytes": 756645888}, "peak_prefill_memory": null, "peak_decode_memory": 14288000064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,088,030", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "ae26f99b7de63b15b822650630cdc1f33ca98f06ee4233dc64eeba577bb6bd2f"} | ||||
| 2456 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "7f7c10758e048b55919bcc42", "attempt_id": "1d71c6336aa0", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:33.567714Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10905, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1899.3274579988793, "ttft_ms": 16.864374978467822, "decode_ms": 100.17225006595254}, "total_wall_ms": 2031.0963329393417, "ttft_ms": 16.864374978467822, "input_usage": {"receiver_prompt_tokens": 10905}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 756645888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14291424320, "mlx_cache_bytes": 7261675864, "process_rss_bytes": 756645888}, "peak_prefill_memory": null, "peak_decode_memory": 14291424320, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zenymiesh-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "6eb8b512e13e00d3354e225efbb77f69a7b6ab1dea765071743af4ff4ec3c307"} | ||||
| 2457 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "71a49eae014b2e8794ad1c74", "attempt_id": "56c4d2218f96", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:35.627699Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10898, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1889.4492089748383, "ttft_ms": 17.041707993485034, "decode_ms": 84.04537499882281}, "total_wall_ms": 2005.3930839058012, "ttft_ms": 17.041707993485034, "input_usage": {"receiver_prompt_tokens": 10898}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 756645888, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14314001472, "mlx_cache_bytes": 7423287640, "process_rss_bytes": 756645888}, "peak_prefill_memory": null, "peak_decode_memory": 14314001472, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,672,756", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "69ea0355f9622554b22cc1234b5e8ca34956b4c2823778347fffc85c77e1320f"} | ||||
| 2458 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "09e6a3c6875605e974a8af9b", "attempt_id": "45f055e34244", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:37.661916Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10894, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1900.6731250556186, "ttft_ms": 16.962584108114243, "decode_ms": 50.74725009035319}, "total_wall_ms": 1983.0035000341013, "ttft_ms": 16.962584108114243, "input_usage": {"receiver_prompt_tokens": 10894}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 756678656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14287410240, "mlx_cache_bytes": 7423287640, "process_rss_bytes": 756678656}, "peak_prefill_memory": null, "peak_decode_memory": 14287410240, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13.4", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "b6b99d5f7c2118802110608c7253b87f7f83ef1656289f6795b531e0a2504d27"} | ||||
| 2459 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "99bfae584a710c8d2c5cdb27", "attempt_id": "3f3cacb7278c", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:39.674115Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10899, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1899.5294580236077, "ttft_ms": 16.93587494082749, "decode_ms": 16.743041924200952}, "total_wall_ms": 1947.8821670636535, "ttft_ms": 16.93587494082749, "input_usage": {"receiver_prompt_tokens": 10899}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 756678656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14314116160, "mlx_cache_bytes": 7509533016, "process_rss_bytes": 756678656}, "peak_prefill_memory": null, "peak_decode_memory": 14314116160, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2460 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "58e019edc3ac6fdb8b22ca51", "attempt_id": "43925e77752a", "run_group_id": "E7_qtypes:A1", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:41.650651Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A1", "implementation_fidelity": "custom", "compression_config": {}, "question_access": "none", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 10900, "message_tokens": 10790, "message_utf8_bytes": 58829, "cache_tensor_bytes": null, "serialized_payload_bytes": 58829, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 0.011875061318278313, "decode_payload_ms": 0.0, "receiver_prefill_ms": 1896.9600000418723, "ttft_ms": 17.100957920774817, "decode_ms": 16.720709041692317}, "total_wall_ms": 1945.4551660455763, "ttft_ms": 17.100957920774817, "input_usage": {"receiver_prompt_tokens": 10900}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 756678656, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 14290244672, "mlx_cache_bytes": 7595909464, "process_rss_bytes": 756678656}, "peak_prefill_memory": null, "peak_decode_memory": 14290244672, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2461 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "79173f35c7186eb8f92c0c8c", "attempt_id": "21ca0a8fade9", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:53.349880Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 594, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 75.40537498425692, "ttft_ms": 13.859292026609182, "decode_ms": 13.434957945719361}, "total_wall_ms": 103.91916695516557, "ttft_ms": 13.859292026609182, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757153792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13026811292, "mlx_cache_bytes": 10916299420, "process_rss_bytes": 757153792}, "peak_prefill_memory": null, "peak_decode_memory": 13026811292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2462 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c7c69edb7bb457db53a1e0de", "attempt_id": "3463ecb7fea6", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:53.483101Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 587, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 76.47758291568607, "ttft_ms": 13.994709006510675, "decode_ms": 13.490417040884495}, "total_wall_ms": 105.07050005253404, "ttft_ms": 13.994709006510675, "input_usage": {"receiver_prompt_tokens": 587, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757153792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13022649756, "mlx_cache_bytes": 11244110492, "process_rss_bytes": 757153792}, "peak_prefill_memory": null, "peak_decode_memory": 13022649756, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2463 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "857bf85d15e3aadc5ce68db6", "attempt_id": "5f8f656e0adb", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:53.617623Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 588, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 78.71712499763817, "ttft_ms": 13.793000020086765, "decode_ms": 13.696542009711266}, "total_wall_ms": 107.36699996050447, "ttft_ms": 13.793000020086765, "input_usage": {"receiver_prompt_tokens": 588, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757153792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13023731100, "mlx_cache_bytes": 11573019292, "process_rss_bytes": 757153792}, "peak_prefill_memory": null, "peak_decode_memory": 13023731100, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2464 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25fec3640d72d45ba1d0c98b", "attempt_id": "684a9dea453f", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:53.754469Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 602, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 81.23637503013015, "ttft_ms": 13.838332961313426, "decode_ms": 68.71074996888638}, "total_wall_ms": 164.9660839466378, "ttft_ms": 13.838332961313426, "input_usage": {"receiver_prompt_tokens": 602, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 757153792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13031447996, "mlx_cache_bytes": 11931995136, "process_rss_bytes": 757153792}, "peak_prefill_memory": null, "peak_decode_memory": 13031447996, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,783,211", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "b5b0f72e16647741b3269c0d733c3e0f23419aae6f870f5c18ee53551850a9a7"} | ||||
| 2465 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8deadb728e2897d314a20b23", "attempt_id": "bd94a2f89c68", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:53.948526Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 595, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.61816599406302, "ttft_ms": 13.982332893647254, "decode_ms": 68.78841598518193}, "total_wall_ms": 166.50933295022696, "ttft_ms": 13.982332893647254, "input_usage": {"receiver_prompt_tokens": 595, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 757153792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13026991548, "mlx_cache_bytes": 12048780288, "process_rss_bytes": 757153792}, "peak_prefill_memory": null, "peak_decode_memory": 13026991548, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,669,891", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "8fe1b189ae1a151b07a072a9524b1d00e8f7708d41aa40359d72e25fbfd6d513"} | ||||
| 2466 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a4395b2c1bcfe68976f0d8a8", "attempt_id": "076e127b2069", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:54.144170Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 605, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.06741709727794, "ttft_ms": 13.854125048965216, "decode_ms": 68.89354204759002}, "total_wall_ms": 166.0461249994114, "ttft_ms": 13.854125048965216, "input_usage": {"receiver_prompt_tokens": 605, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 757153792, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13032889800, "mlx_cache_bytes": 12386833776, "process_rss_bytes": 757153792}, "peak_prefill_memory": null, "peak_decode_memory": 13032889800, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ixlith-13", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "fc97f66f18271cc414e8ac1fc0eecdf6b49a978d02867c1070f928b6dcc6dfb0"} | ||||
| 2467 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "d08bdffb6bca5a34809ae880", "attempt_id": "24b257f62d18", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:54.338911Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 598, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.26708392612636, "ttft_ms": 14.032792067155242, "decode_ms": 68.47874994855374}, "total_wall_ms": 165.90016591362655, "ttft_ms": 14.032792067155242, "input_usage": {"receiver_prompt_tokens": 598, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 757170176, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13028629948, "mlx_cache_bytes": 12720805232, "process_rss_bytes": 757170176}, "peak_prefill_memory": null, "peak_decode_memory": 13028629948, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,901,651", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "e57de83b97e46f20ba77f4632834fc860fe70fdc4a1eba795a14e8379a546961"} | ||||
| 2468 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "a3b41d0b8ab36e94c1035dc8", "attempt_id": "93abd8f20ac1", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:54.533550Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 594, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 82.3884999845177, "ttft_ms": 14.200542005710304, "decode_ms": 13.65616696421057}, "total_wall_ms": 111.31741700228304, "ttft_ms": 14.200542005710304, "input_usage": {"receiver_prompt_tokens": 594, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757170176, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13026811292, "mlx_cache_bytes": 12720805232, "process_rss_bytes": 757170176}, "peak_prefill_memory": null, "peak_decode_memory": 13026811292, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2469 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b3b1197af91f82a3a99377d4", "attempt_id": "13f572a1f9f0", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:54.673740Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 599, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 84.5530410297215, "ttft_ms": 13.798666070215404, "decode_ms": 13.70891707483679}, "total_wall_ms": 113.22512500919402, "ttft_ms": 13.798666070215404, "input_usage": {"receiver_prompt_tokens": 599, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757170176, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13059677628, "mlx_cache_bytes": 12875240816, "process_rss_bytes": 757170176}, "peak_prefill_memory": null, "peak_decode_memory": 13059677628, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2470 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e43584ddd5ddcea2211ee80d", "attempt_id": "d70b679aff17", "run_group_id": "E7_qtypes:A4|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:05:54.816693Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A4", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 600, "message_tokens": 486, "message_utf8_bytes": 2045, "cache_tensor_bytes": null, "serialized_payload_bytes": 2045, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 9724.465750041418, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.04416600428522, "ttft_ms": 14.010416925884783, "decode_ms": 13.932583038695157}, "total_wall_ms": 115.01383397262543, "ttft_ms": 14.010416925884783, "input_usage": {"receiver_prompt_tokens": 600, "sender_input_tokens": 10924, "sender_output_tokens": 486, "sender_prefill_ms": 1921.6841249726713, "sender_ttft_ms": 16.80370792746544, "sender_decode_ms": 7776.804415974766}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757170176, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13067656636, "mlx_cache_bytes": 12993009008, "process_rss_bytes": 757170176}, "peak_prefill_memory": null, "peak_decode_memory": 13067656636, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5243b27399a1e30ee0eb56252fbd9f50ecb83b8045e0d68bb9d39c8b2cac0e71", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2471 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5cf17f996f8c0c276f3cebfc", "attempt_id": "d39af9b6548d", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:05.322334Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 428, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 55.58891699183732, "ttft_ms": 13.567709014751017, "decode_ms": 13.869374990463257}, "total_wall_ms": 84.35362507589161, "ttft_ms": 13.567709014751017, "input_usage": {"receiver_prompt_tokens": 428, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902390872, "mlx_cache_bytes": 13592384880, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12902390872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2472 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "17808c1f2265953f78828869", "attempt_id": "b675667caead", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:05.435887Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 421, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 56.56641605310142, "ttft_ms": 14.04029200784862, "decode_ms": 13.87708296533674}, "total_wall_ms": 85.40129102766514, "ttft_ms": 14.04029200784862, "input_usage": {"receiver_prompt_tokens": 421, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12898229336, "mlx_cache_bytes": 13827560816, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12898229336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2473 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e383eff2ea8581736520eaec", "attempt_id": "34fc8d1a9eb6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:05.550665Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 422, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 58.92091698478907, "ttft_ms": 14.583957963623106, "decode_ms": 13.949125073850155}, "total_wall_ms": 88.36408401839435, "ttft_ms": 14.583957963623106, "input_usage": {"receiver_prompt_tokens": 422, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12898606168, "mlx_cache_bytes": 13951817072, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12898606168, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2474 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "49f7dff07a8483dd4ae5d4a6", "attempt_id": "ab03bc17b16a", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:05.668063Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 436, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 59.40033390652388, "ttft_ms": 13.594791060313582, "decode_ms": 13.658625073730946}, "total_wall_ms": 87.67716703005135, "ttft_ms": 13.594791060313582, "input_usage": {"receiver_prompt_tokens": 436, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12907027544, "mlx_cache_bytes": 14211962224, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12907027544, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2475 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1752ec9d3d0e2b8f36a611db", "attempt_id": "85ffa2f8b117", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:05.786420Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 429, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 61.018666019663215, "ttft_ms": 13.771167024970055, "decode_ms": 13.660457916557789}, "total_wall_ms": 89.3579589901492, "ttft_ms": 13.771167024970055, "input_usage": {"receiver_prompt_tokens": 429, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902571096, "mlx_cache_bytes": 14296110448, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12902571096, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2476 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf882adaa27a0edee8451b12", "attempt_id": "f9d42d6bd591", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:05.905211Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 439, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 62.46104103047401, "ttft_ms": 13.78683396615088, "decode_ms": 13.863957952708006}, "total_wall_ms": 90.9581669839099, "ttft_ms": 13.78683396615088, "input_usage": {"receiver_prompt_tokens": 439, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12908665944, "mlx_cache_bytes": 14498469232, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12908665944, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2477 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "35b680506c84e5d4eb758019", "attempt_id": "546499b692f5", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.025205Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 432, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 63.38162499014288, "ttft_ms": 13.956667040474713, "decode_ms": 13.75933294184506}, "total_wall_ms": 91.97966707870364, "ttft_ms": 13.956667040474713, "input_usage": {"receiver_prompt_tokens": 432, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904209496, "mlx_cache_bytes": 14739805552, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12904209496, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2478 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2d00fb099687efbdbea9d468", "attempt_id": "032f18168dc6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.145614Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 428, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.46125009097159, "ttft_ms": 13.947542058303952, "decode_ms": 14.093500096350908}, "total_wall_ms": 93.33466703537852, "ttft_ms": 13.947542058303952, "input_usage": {"receiver_prompt_tokens": 428, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12902390872, "mlx_cache_bytes": 14739805552, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12902390872, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2479 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "06e6554d743349745f64519e", "attempt_id": "3393d8bf5830", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.267620Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 433, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 64.28729090839624, "ttft_ms": 13.950666063465178, "decode_ms": 13.990540988743305}, "total_wall_ms": 93.07116700801998, "ttft_ms": 13.950666063465178, "input_usage": {"receiver_prompt_tokens": 433, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12904389720, "mlx_cache_bytes": 14824740208, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12904389720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2480 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "157df33e90b75b6cd575c09d", "attempt_id": "c7df0b4acca6", "run_group_id": "E7_qtypes:A5|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.389394Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A5", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 434, "message_tokens": 308, "message_utf8_bytes": 840, "cache_tensor_bytes": null, "serialized_payload_bytes": 840, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 10362.415667041205, "decode_payload_ms": 0.0, "receiver_prefill_ms": 65.11933403089643, "ttft_ms": 14.264125027693808, "decode_ms": 13.796459068544209}, "total_wall_ms": 94.02216598391533, "ttft_ms": 14.264125027693808, "input_usage": {"receiver_prompt_tokens": 434, "sender_input_tokens": 10954, "sender_output_tokens": 512, "sender_prefill_ms": 2137.85891700536, "sender_ttft_ms": 17.13145908433944, "sender_decode_ms": 8199.264000053518}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757317632, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 12927999064, "mlx_cache_bytes": 14936577392, "process_rss_bytes": 757317632}, "peak_prefill_memory": null, "peak_decode_memory": 12927999064, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": {"n_facts": 8, "unresolved_quotes": 1, "parse_ok": true}, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "9049054759a21ac1d95430ff69de5b635bccf141f62c68b360d1fc0be58c891f", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2481 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "511ee9fba092ca27a2d19f5f", "attempt_id": "09a4b509bdad", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.519927Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 614, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 91.5097079705447, "ttft_ms": 14.476209064014256, "decode_ms": 14.04699997510761}, "total_wall_ms": 121.11175002064556, "ttft_ms": 14.476209064014256, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757350400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037903340, "mlx_cache_bytes": 15302205188, "process_rss_bytes": 757350400}, "peak_prefill_memory": null, "peak_decode_memory": 13037903340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2482 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "25f863d49f75fa3a3f53ce9e", "attempt_id": "9096ba0b294e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.669303Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 607, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 91.03079105261713, "ttft_ms": 14.381916960701346, "decode_ms": 28.084584046155214}, "total_wall_ms": 134.52025002334267, "ttft_ms": 14.381916960701346, "input_usage": {"receiver_prompt_tokens": 607}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 757350400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034151404, "mlx_cache_bytes": 15641550596, "process_rss_bytes": 757350400}, "peak_prefill_memory": null, "peak_decode_memory": 13034151404, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2483 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "83b4520a27c10b222c51e6a2", "attempt_id": "06fadc36c4c3", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.832692Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 608, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 90.43904207646847, "ttft_ms": 14.435499906539917, "decode_ms": 27.934666955843568}, "total_wall_ms": 133.90599994454533, "ttft_ms": 14.435499906539917, "input_usage": {"receiver_prompt_tokens": 608}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 757350400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13034528236, "mlx_cache_bytes": 15820660484, "process_rss_bytes": 757350400}, "peak_prefill_memory": null, "peak_decode_memory": 13034528236, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2484 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "50cc905048a4b08c393770bc", "attempt_id": "6234bb8ae5af", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:06.995184Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 622, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 94.16237496770918, "ttft_ms": 14.347999938763678, "decode_ms": 70.1898749684915}, "total_wall_ms": 179.8237080220133, "ttft_ms": 14.347999938763678, "input_usage": {"receiver_prompt_tokens": 622}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 757350400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042540044, "mlx_cache_bytes": 16191056056, "process_rss_bytes": 757350400}, "peak_prefill_memory": null, "peak_decode_memory": 13042540044, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,900,830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "05b0bcd84be8ddbe71ddec72d4f72c4f385ecda37c0f830cd4e2627180f51176"} | ||||
| 2485 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8c309d527fc44b3be75e99e4", "attempt_id": "d6f93e18cd94", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:07.203601Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 615, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 90.43574996758252, "ttft_ms": 14.277457958087325, "decode_ms": 69.07320802565664}, "total_wall_ms": 174.89400005433708, "ttft_ms": 14.277457958087325, "input_usage": {"receiver_prompt_tokens": 615}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 757350400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13038788108, "mlx_cache_bytes": 16474515640, "process_rss_bytes": 757350400}, "peak_prefill_memory": null, "peak_decode_memory": 13038788108, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,088,030", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "ae26f99b7de63b15b822650630cdc1f33ca98f06ee4233dc64eeba577bb6bd2f"} | ||||
| 2486 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "e230e1408ab17668d845c63d", "attempt_id": "cb57c78b735d", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:07.407481Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 625, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 88.79612502641976, "ttft_ms": 14.089916017837822, "decode_ms": 83.35754193831235}, "total_wall_ms": 187.38712498452514, "ttft_ms": 14.089916017837822, "input_usage": {"receiver_prompt_tokens": 625}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 757350400, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13043981848, "mlx_cache_bytes": 16823399032, "process_rss_bytes": 757350400}, "peak_prefill_memory": null, "peak_decode_memory": 13043981848, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zenymiesh-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "6eb8b512e13e00d3354e225efbb77f69a7b6ab1dea765071743af4ff4ec3c307"} | ||||
| 2487 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "85f961f0080a4daf86202864", "attempt_id": "1d4f6092b25e", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:07.624408Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 618, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 87.84208400174975, "ttft_ms": 13.92549998126924, "decode_ms": 68.71833303011954}, "total_wall_ms": 171.93979199510068, "ttft_ms": 13.92549998126924, "input_usage": {"receiver_prompt_tokens": 618}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 757366784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13071801868, "mlx_cache_bytes": 17043468920, "process_rss_bytes": 757366784}, "peak_prefill_memory": null, "peak_decode_memory": 13071801868, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,987,632", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "3872ddfae3e069d923930c9d9d94bf0cf2335eea2c4852e20c46ee1550703b9c"} | ||||
| 2488 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ed82abf6084f2e90336c9b3b", "attempt_id": "781f7fbddb90", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:07.824421Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 614, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.67154197953641, "ttft_ms": 13.773125014267862, "decode_ms": 13.716459041461349}, "total_wall_ms": 114.17312500998378, "ttft_ms": 13.773125014267862, "input_usage": {"receiver_prompt_tokens": 614}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757366784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13037903340, "mlx_cache_bytes": 17043468920, "process_rss_bytes": 757366784}, "peak_prefill_memory": null, "peak_decode_memory": 13037903340, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2489 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "f900dd0fa7333d77f4c13cfd", "attempt_id": "68629b18600f", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:07.967069Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 619, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 85.32429102342576, "ttft_ms": 13.968915911391377, "decode_ms": 14.125416986644268}, "total_wall_ms": 114.65958296321332, "ttft_ms": 13.968915911391377, "input_usage": {"receiver_prompt_tokens": 619}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757366784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13079617036, "mlx_cache_bytes": 17164972664, "process_rss_bytes": 757366784}, "peak_prefill_memory": null, "peak_decode_memory": 13079617036, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2490 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "fe4f2394960d340a65b004ee", "attempt_id": "e574a95e4840", "run_group_id": "E7_qtypes:A3|budget_tokens=512|blind", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:08.110857Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 12597384200}, "weight_precision": "bf16", "method_id": "A3", "implementation_fidelity": "custom", "compression_config": {"budget_tokens": 512, "access": "blind", "realized": {"budget_tokens": 512, "realized_tokens": 511, "n_sentences": 19}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 620, "message_tokens": 509, "message_utf8_bytes": 1585, "cache_tensor_bytes": null, "serialized_payload_bytes": 1585, "side_information_bytes": 0, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 7.814500015228987, "decode_payload_ms": 0.0, "receiver_prefill_ms": 86.65166702121496, "ttft_ms": 14.108749921433628, "decode_ms": 13.933790964074433}, "total_wall_ms": 115.86704105138779, "ttft_ms": 14.108749921433628, "input_usage": {"receiver_prompt_tokens": 620}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 757366784, "backend_memory": {"mlx_active_bytes": 12597384200, "mlx_peak_bytes": 13042179596, "mlx_cache_bytes": 17286673016, "process_rss_bytes": 757366784}, "peak_prefill_memory": null, "peak_decode_memory": 13042179596, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "cb36ecd6d43c88c4836780824c83f58780ea75e09e9748cdbd8a1df8b770653c", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2491 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ea7d99b29d30828cb9852bf2", "attempt_id": "79d48ad21055", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:11.499706Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 44, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 3.230749978683889, "receiver_prefill_ms": 0.0, "query_prefill_ms": 68.31400003284216, "ttft_ms": 68.31400003284216, "decode_ms": 627.4916670517996}, "total_wall_ms": 710.1630420656875, "ttft_ms": 68.31400003284216, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1153024000, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 16939447257, "process_rss_bytes": 1153024000}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "RA-53U-8092", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "65c601ab87e10a79261f364233c63c116236143b0f2791666cf688c2cfb92259"} | ||||
| 2492 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "83684aebf52329fbf5a303e5", "attempt_id": "0552df348720", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:12.240102Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 37, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.7290410362184048, "receiver_prefill_ms": 0.0, "query_prefill_ms": 52.462292020209134, "ttft_ms": 52.462292020209134, "decode_ms": 53.105083061382174}, "total_wall_ms": 115.79379206523299, "ttft_ms": 52.462292020209134, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 37}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1152958464, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571377896, "mlx_cache_bytes": 16967693273, "process_rss_bytes": 1152958464}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14571377896, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "1ea442a134b2a184bd5d40104401f2a37fbc09ccf3f4bc9da161c6099be3691d"} | ||||
| 2493 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "9df72bb87bb0b6b39258dea3", "attempt_id": "77f8dedecf2e", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:12.385732Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 38, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.218457986600697, "receiver_prefill_ms": 0.0, "query_prefill_ms": 69.11470799241215, "ttft_ms": 69.11470799241215, "decode_ms": 16.19791693519801}, "total_wall_ms": 96.20650007855147, "ttft_ms": 69.11470799241215, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 38}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1096843264, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14572262632, "mlx_cache_bytes": 16994989017, "process_rss_bytes": 1096843264}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14572262632, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Yes", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "85a39ab345d672ff8ca9b9c6876f3adcacf45ee7c1e2dbd2408fd338bd55e07e"} | ||||
| 2494 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1872f786abe6ccbb92a4a2ee", "attempt_id": "312ca91db4ea", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:12.515679Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 52, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 1.6243749996647239, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.58920907601714, "ttft_ms": 28.58920907601714, "decode_ms": 700.6854580249637}, "total_wall_ms": 738.3652919670567, "ttft_ms": 28.58920907601714, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 843284480, "backend_memory": {"mlx_active_bytes": 14489277448, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 17350082569, "process_rss_bytes": 843284480}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,500,000", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "ab2aa1d5ed41d305fa34a2ced49db1fdf239576a2d67ef052a3b05edebe7cddd"} | ||||
| 2495 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b10d0133f74f995bbde791c9", "attempt_id": "8456be17b40d", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:13.286810Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 45, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.6406670222058892, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.36825007945299, "ttft_ms": 37.36825007945299, "decode_ms": 80.7963339611888}, "total_wall_ms": 128.2653749221936, "ttft_ms": 37.36825007945299, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 843333632, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575801608, "mlx_cache_bytes": 17371398153, "process_rss_bytes": 843333632}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14575801608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,978,859", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "3154faaec9c29d2c89463d1c5741e1803291935d92a0c21988d664c0fa19370a"} | ||||
| 2496 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "70ea5ec5470c021d459ccc73", "attempt_id": "052f3ba2c9a1", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:13.445455Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 55, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.6427090633660555, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.850625036284328, "ttft_ms": 28.850625036284328, "decode_ms": 81.007375032641}, "total_wall_ms": 119.87329099792987, "ttft_ms": 28.850625036284328, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 55}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 843350016, "backend_memory": {"mlx_active_bytes": 14489277448, "mlx_peak_bytes": 14583829772, "mlx_cache_bytes": 17467608466, "process_rss_bytes": 843350016}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14583829772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Ardkori-8", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "5d133158798e5edb3fdb9ad941ab3920666e3f5dee0d82e771528b4c7592bc54"} | ||||
| 2497 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3bfd769915f8b3fa2aa46e8e", "attempt_id": "8836e74992a1", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:13.594674Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 48, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.437166986055672, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.444208972156048, "ttft_ms": 27.444208972156048, "decode_ms": 77.70116592291743}, "total_wall_ms": 115.13820895925164, "ttft_ms": 27.444208972156048, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 843350016, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 17502670226, "process_rss_bytes": 843350016}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,924,717", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "4bc625a959244a0c5abedfe218920fb868bc1eda2541ed5535bb20812f07e64f"} | ||||
| 2498 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "76abc2c06c4585851e9f12c1", "attempt_id": "c3a62c4033fd", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:13.743666Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 44, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.5377500569447875, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.29479200206697, "ttft_ms": 27.29479200206697, "decode_ms": 30.968416016548872}, "total_wall_ms": 68.12758301384747, "ttft_ms": 27.29479200206697, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 44}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 843350016, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 17503587730, "process_rss_bytes": 843350016}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Not available", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 1.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "67a926f7008e2b0e7f2b3f7a4b37597834830110be1d51138f425d6f3449bc09"} | ||||
| 2499 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "805dfd4a2c3d900d8c73160c", "attempt_id": "b364a1da4d67", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:13.840728Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 49, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.6117500383406878, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.448999975807965, "ttft_ms": 28.448999975807965, "decode_ms": 15.967749990522861}, "total_wall_ms": 54.33366692159325, "ttft_ms": 28.448999975807965, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 843350016, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14582961408, "mlx_cache_bytes": 17515416978, "process_rss_bytes": 843350016}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14582961408, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 2500 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "dea0698231cbc137bd88bbd5", "attempt_id": "929d5b8ea286", "run_group_id": "E7_qtypes:B3|keep_frac=0.25", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:13.923522Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14170903560}, "weight_precision": "bf16", "method_id": "B3", "implementation_fidelity": "inspired", "compression_config": {"keep_frac": 0.25, "realized": {"policy": "sink_recent", "keep_frac": 0.25, "T": 10850, "keep": 2712, "compress_ms": 15.207833028398454}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 50, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047061, "side_information_bytes": 13205, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 3241.7694999603555, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 15.24837501347065, "serialize_ms": 1069.7354999138042, "load_ms": 2.493790932931006, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.045833110809326, "ttft_ms": 28.045833110809326, "decode_ms": 15.653542010113597}, "total_wall_ms": 53.61070798244327, "ttft_ms": 28.045833110809326, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 843350016, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14583371008, "mlx_cache_bytes": 17538076050, "process_rss_bytes": 843350016}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14583371008, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "85cb0d2ec84b03ccc4820e2175e402893308217c3e086fb2c48035e9e76a59cc", "output_hash": "b764cdc0eab7137467211272fa539f1260d1bf2e71bcf6ff3bdc960f5c16aa14"} | ||||
| 2501 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "0099df63980dbb67c5dae845", "attempt_id": "102f73e75e05", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:14.005727Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 44, "compress_ms": 876.9219999667257}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 44, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047100, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 1002.6095829671249, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 885.0325830280781, "serialize_ms": 117.32187494635582, "load_ms": 2.768374979496002, "receiver_prefill_ms": 0.0, "query_prefill_ms": 43.4475839138031, "ttft_ms": 43.4475839138031, "decode_ms": 114.03045791666955}, "total_wall_ms": 1181.7413329845294, "ttft_ms": 43.4475839138031, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 1140162560, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 20129320442, "process_rss_bytes": 1140162560}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JA-11F-3284", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "84859ff01dee3e042ba1cab0f238731619d679fed74ba0b7edca10e80da82dda", "output_hash": "023777c48578a936705662567afe9c3480c75ddfdd44d356be3c0bd70dd23b19"} | ||||
| 2502 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "70a7ea52a0bfa62427e0e2db", "attempt_id": "f136181f2086", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:15.229210Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 37, "compress_ms": 132.93545809574425}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 37, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047101, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 200.0973749672994, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 141.38704200740904, "serialize_ms": 58.466542046517134, "load_ms": 2.3223329335451126, "receiver_prefill_ms": 0.0, "query_prefill_ms": 41.93416691850871, "ttft_ms": 41.93416691850871, "decode_ms": 39.14412495214492}, "total_wall_ms": 291.3327080896124, "ttft_ms": 41.93416691850871, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1101643776, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14571361512, "mlx_cache_bytes": 20173147642, "process_rss_bytes": 1101643776}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14571361512, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5c3a083f3b01b32d3c0807991383553db377992a2286336b8929621538088312", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2503 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "bedb2f7c884e84e31853f44a", "attempt_id": "50e2cc055028", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:15.598129Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 38, "compress_ms": 126.45758397411555}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 38, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047101, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 188.52258299011737, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 134.02329094242305, "serialize_ms": 54.30429195985198, "load_ms": 1.9247500458732247, "receiver_prefill_ms": 0.0, "query_prefill_ms": 26.834500022232533, "ttft_ms": 26.834500022232533, "decode_ms": 31.18587494827807}, "total_wall_ms": 256.3156670657918, "ttft_ms": 26.834500022232533, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 1104510976, "backend_memory": {"mlx_active_bytes": 14486524936, "mlx_peak_bytes": 14572229864, "mlx_cache_bytes": 20226231802, "process_rss_bytes": 1104510976}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14572229864, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5c3a083f3b01b32d3c0807991383553db377992a2286336b8929621538088312", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2504 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "3a40d363db901b36ca6d62cb", "attempt_id": "e028d5949dc1", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:15.886872Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 52, "compress_ms": 129.651666036807}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 52, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047099, "side_information_bytes": 13243, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.76241698954254, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 136.94029208272696, "serialize_ms": 47.64166695531458, "load_ms": 2.379207988269627, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.012582984752953, "ttft_ms": 27.012582984752953, "decode_ms": 77.46812491677701}, "total_wall_ms": 299.2514590732753, "ttft_ms": 27.012582984752953, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1106509824, "backend_memory": {"mlx_active_bytes": 14489277448, "mlx_peak_bytes": 14581830912, "mlx_cache_bytes": 20282215930, "process_rss_bytes": 1106509824}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14581830912, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,900,830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "13619a077b0099cd0571d24795bf4134e31b851d590f9e6609820da32db6e70b", "output_hash": "05b0bcd84be8ddbe71ddec72d4f72c4f385ecda37c0f830cd4e2627180f51176"} | ||||
| 2505 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "2e289e6eac2cd241742c66bf", "attempt_id": "574943fb474f", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:16.217853Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 45, "compress_ms": 127.6524169370532}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 45, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047100, "side_information_bytes": 13244, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 182.3702499968931, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 134.9758330034092, "serialize_ms": 47.20024997368455, "load_ms": 2.348333946429193, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.529167011380196, "ttft_ms": 27.529167011380196, "decode_ms": 77.44708401151001}, "total_wall_ms": 297.2743749851361, "ttft_ms": 27.529167011380196, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1106591744, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14575801608, "mlx_cache_bytes": 20330565114, "process_rss_bytes": 1106591744}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14575801608, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,088,030", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "84859ff01dee3e042ba1cab0f238731619d679fed74ba0b7edca10e80da82dda", "output_hash": "ae26f99b7de63b15b822650630cdc1f33ca98f06ee4233dc64eeba577bb6bd2f"} | ||||
| 2506 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "927500585663dfe0c871db7d", "attempt_id": "59f399143129", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:16.546595Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 55, "compress_ms": 132.76775006670505}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 55, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047101, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 187.14129098225385, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 140.1207079179585, "serialize_ms": 46.83141701389104, "load_ms": 2.43704195600003, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.21404195856303, "ttft_ms": 28.21404195856303, "decode_ms": 94.51000008266419}, "total_wall_ms": 319.7847920237109, "ttft_ms": 28.21404195856303, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 1106673664, "backend_memory": {"mlx_active_bytes": 14489277448, "mlx_peak_bytes": 14583829772, "mlx_cache_bytes": 20405865978, "process_rss_bytes": 1106673664}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14583829772, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zenymiesh-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5c3a083f3b01b32d3c0807991383553db377992a2286336b8929621538088312", "output_hash": "6eb8b512e13e00d3354e225efbb77f69a7b6ab1dea765071743af4ff4ec3c307"} | ||||
| 2507 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "c9292c2fb1a1b9694e2d9c5c", "attempt_id": "2c6a80d8f3a7", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:16.897303Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 48, "compress_ms": 128.88408300932497}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 48, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047101, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 185.7612089952454, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 136.19804102927446, "serialize_ms": 49.353540991432965, "load_ms": 2.3747500963509083, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.28625002782792, "ttft_ms": 27.28625002782792, "decode_ms": 77.80958304647356}, "total_wall_ms": 301.01454199757427, "ttft_ms": 27.28625002782792, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 1107116032, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14577571072, "mlx_cache_bytes": 20469763578, "process_rss_bytes": 1107116032}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14577571072, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,672,859", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5c3a083f3b01b32d3c0807991383553db377992a2286336b8929621538088312", "output_hash": "2acbbb36342fc750af08b55e6fe6c57dc79c92f26d233ea6b558be0c7ec04050"} | ||||
| 2508 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "cf252e7ca9ccbdd3fba731eb", "attempt_id": "6ef9e427cbc6", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:17.230112Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 44, "compress_ms": 126.92391697783023}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 44, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047101, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 182.96712508890778, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 134.94445802643895, "serialize_ms": 47.8347500320524, "load_ms": 1.9717080285772681, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.201417066156864, "ttft_ms": 28.201417066156864, "decode_ms": 46.49266600608826}, "total_wall_ms": 267.1905829338357, "ttft_ms": 28.201417066156864, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 1107247104, "backend_memory": {"mlx_active_bytes": 14487442440, "mlx_peak_bytes": 14575621352, "mlx_cache_bytes": 20470681082, "process_rss_bytes": 1107247104}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14575621352, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "20.6", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5c3a083f3b01b32d3c0807991383553db377992a2286336b8929621538088312", "output_hash": "b1ac0fea75978074ee541cd725748a9dcee6c81834500bc00d328158134df9b1"} | ||||
| 2509 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "827b8e27bf1ce3e9ab612e5f", "attempt_id": "291495a22abd", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:17.528549Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 49, "compress_ms": 129.01749997399747}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 49, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047101, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 184.6432499587536, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 136.24362496193498, "serialize_ms": 48.20758302230388, "load_ms": 2.424999955110252, "receiver_prefill_ms": 0.0, "query_prefill_ms": 28.25324994046241, "ttft_ms": 28.25324994046241, "decode_ms": 15.558583079837263}, "total_wall_ms": 238.4788750205189, "ttft_ms": 28.25324994046241, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1107329024, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14579848448, "mlx_cache_bytes": 20532022778, "process_rss_bytes": 1107329024}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14579848448, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5c3a083f3b01b32d3c0807991383553db377992a2286336b8929621538088312", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2510 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "76c7ba0c5c798bf4899ecf6f", "attempt_id": "62288b992aa5", "run_group_id": "E7_qtypes:B5|keep_frac=0.25|aware", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:17.797880Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 13859869704}, "weight_precision": "bf16", "method_id": "B5", "implementation_fidelity": "faithful_reimplementation", "compression_config": {"keep_frac": 0.25, "access": "aware", "realized": {"policy": "attention", "keep_frac": 0.25, "T": 10850, "keep": 2712, "window_tokens": 50, "compress_ms": 130.08108304347843}}, "question_access": "aware", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 1, "cache_hit": false, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 50, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 311033856, "serialized_payload_bytes": 311047101, "side_information_bytes": 13245, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 186.22737505938858, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 137.47758395038545, "serialize_ms": 48.55795903131366, "load_ms": 2.327208057977259, "receiver_prefill_ms": 0.0, "query_prefill_ms": 27.747125015594065, "ttft_ms": 27.747125015594065, "decode_ms": 15.646958025172353}, "total_wall_ms": 239.48099999688566, "ttft_ms": 27.747125015594065, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 1107410944, "backend_memory": {"mlx_active_bytes": 14488359944, "mlx_peak_bytes": 14580290816, "mlx_cache_bytes": 20584107514, "process_rss_bytes": 1107410944}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 14580290816, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "5c3a083f3b01b32d3c0807991383553db377992a2286336b8929621538088312", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2511 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "26b972ffa4d39db99b01b932", "attempt_id": "837f6defabd2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:18.218524Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q05_multi_hop", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 44, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 13.485291972756386, "receiver_prefill_ms": 0.0, "query_prefill_ms": 48.51700004655868, "ttft_ms": 48.51700004655868, "decode_ms": 184.7011250210926}, "total_wall_ms": 254.31041698902845, "ttft_ms": 48.51700004655868, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 44}, "output_usage": {"output_tokens": 7}, "provider_cached_usage": null, "process_memory": 2416934912, "backend_memory": {"mlx_active_bytes": 15189464072, "mlx_peak_bytes": 15493469856, "mlx_cache_bytes": 22787982714, "process_rss_bytes": 2416934912}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15493469856, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "JA-11F-3284", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "023777c48578a936705662567afe9c3480c75ddfdd44d356be3c0bd70dd23b19"} | ||||
| 2512 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "eef30c71667f3de54c3bb884", "attempt_id": "359cf518bd0e", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:18.503700Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q06_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 37, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 3.792041912674904, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.53649997431785, "ttft_ms": 36.53649997431785, "decode_ms": 37.82562504056841}, "total_wall_ms": 85.88345791213214, "ttft_ms": 36.53649997431785, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 37}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2416934912, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15467738592, "mlx_cache_bytes": 22905955802, "process_rss_bytes": 2416934912}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15467738592, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2513 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "4731a91ed5215b75f3734d3e", "attempt_id": "72cb5b19f5c2", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:18.623479Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q07_negation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 38, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 3.7758330581709743, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.403957987204194, "ttft_ms": 36.403957987204194, "decode_ms": 37.65641700010747}, "total_wall_ms": 86.00637502968311, "ttft_ms": 36.403957987204194, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 38}, "output_usage": {"output_tokens": 2}, "provider_cached_usage": null, "process_memory": 2417508352, "backend_memory": {"mlx_active_bytes": 15188415496, "mlx_peak_bytes": 15471870760, "mlx_cache_bytes": 23000692954, "process_rss_bytes": 2417508352}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15471870760, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "No.", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "38178a20b470cfd18299fb1593dd4ba706f1a83321dac051d01086efd8b7a96f"} | ||||
| 2514 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "b4b1f3ebd7596110405f5ae9", "attempt_id": "207b332d9223", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:18.739905Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q08_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 52, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 3.219209029339254, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.047665962949395, "ttft_ms": 38.047665962949395, "decode_ms": 91.85650001745671}, "total_wall_ms": 140.64025005791336, "ttft_ms": 38.047665962949395, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 52}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2417508352, "backend_memory": {"mlx_active_bytes": 15189398536, "mlx_peak_bytes": 15523536336, "mlx_cache_bytes": 22999352794, "process_rss_bytes": 2417508352}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15523536336, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "2,900,830", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "05b0bcd84be8ddbe71ddec72d4f72c4f385ecda37c0f830cd4e2627180f51176"} | ||||
| 2515 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "5d96a8fe6747b136939dd004", "attempt_id": "f4884a5acae7", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:18.910241Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q09_revision", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 45, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 3.928041085600853, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.512291921302676, "ttft_ms": 37.512291921302676, "decode_ms": 91.85616602189839}, "total_wall_ms": 140.64224995672703, "ttft_ms": 37.512291921302676, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 45}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2417573888, "backend_memory": {"mlx_active_bytes": 15189464072, "mlx_peak_bytes": 15496796384, "mlx_cache_bytes": 22998289274, "process_rss_bytes": 2417573888}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15496796384, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "3,088,030", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "ae26f99b7de63b15b822650630cdc1f33ca98f06ee4233dc64eeba577bb6bd2f"} | ||||
| 2516 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "ca68b5fdc72212a4936777f0", "attempt_id": "224ee4cfd214", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:19.080281Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q10_temporal", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 55, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 4.087415989488363, "receiver_prefill_ms": 0.0, "query_prefill_ms": 38.51083305198699, "ttft_ms": 38.51083305198699, "decode_ms": 110.65799999050796}, "total_wall_ms": 160.65762494690716, "ttft_ms": 38.51083305198699, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 55}, "output_usage": {"output_tokens": 6}, "provider_cached_usage": null, "process_memory": 2417573888, "backend_memory": {"mlx_active_bytes": 15189398536, "mlx_peak_bytes": 15534055068, "mlx_cache_bytes": 22997424442, "process_rss_bytes": 2417573888}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15534055068, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "Zenymiesh-1", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 0.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "6eb8b512e13e00d3354e225efbb77f69a7b6ab1dea765071743af4ff4ec3c307"} | ||||
| 2517 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "da876703647000e63406d01e", "attempt_id": "ff9e864c0f0a", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:19.270198Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q11_aggregation", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 48, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 4.220791044645011, "receiver_prefill_ms": 0.0, "query_prefill_ms": 37.533832946792245, "ttft_ms": 37.533832946792245, "decode_ms": 91.24308393802494}, "total_wall_ms": 140.63595794141293, "ttft_ms": 37.533832946792245, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 48}, "output_usage": {"output_tokens": 5}, "provider_cached_usage": null, "process_memory": 2417590272, "backend_memory": {"mlx_active_bytes": 15189398536, "mlx_peak_bytes": 15508510528, "mlx_cache_bytes": 22996490554, "process_rss_bytes": 2417590272}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15508510528, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "4,672,756", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "69ea0355f9622554b22cc1234b5e8ca34956b4c2823778347fffc85c77e1320f"} | ||||
| 2518 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "38f6c8a4862e704a0c4c33ab", "attempt_id": "00054e9ae728", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:19.440001Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q12_unit_conversion", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 44, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 3.2678749412298203, "receiver_prefill_ms": 0.0, "query_prefill_ms": 36.48399992380291, "ttft_ms": 36.48399992380291, "decode_ms": 55.371749913319945}, "total_wall_ms": 102.78991691302508, "ttft_ms": 36.48399992380291, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 44}, "output_usage": {"output_tokens": 3}, "provider_cached_usage": null, "process_memory": 2417590272, "backend_memory": {"mlx_active_bytes": 15189333000, "mlx_peak_bytes": 15493465892, "mlx_cache_bytes": 22996556090, "process_rss_bytes": 2417590272}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15493465892, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "13.4", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 0.0, "abstained": 0.0, "f1": 0.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "b6b99d5f7c2118802110608c7253b87f7f83ef1656289f6795b531e0a2504d27"} | ||||
| 2519 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "1fb9387cd5b1ed98a71e74d9", "attempt_id": "aa875dc7c7f7", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:19.572368Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q13_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 49, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 4.102041944861412, "receiver_prefill_ms": 0.0, "query_prefill_ms": 39.986666990444064, "ttft_ms": 39.986666990444064, "decode_ms": 18.70333298575133}, "total_wall_ms": 70.60874998569489, "ttft_ms": 39.986666990444064, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 49}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2417590272, "backend_memory": {"mlx_active_bytes": 15189464072, "mlx_peak_bytes": 15513638720, "mlx_cache_bytes": 23001340218, "process_rss_bytes": 2417590272}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15513638720, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
| 2520 | +{"schema_version": "wp30-attempt-1", "study_id": "WP30", "experiment_id": "E7_qtypes", "trial_id": "8d3269f6438b28c8188c0efe", "attempt_id": "3bbd9f7dbd57", "run_group_id": "E7_qtypes:B2|bits=8", "protocol_hash": "404c52b34d964693da72ef459a036ffc42fbf5f6ba8748cc9de0c554ebebddd6", "config_hash": "48675e4ab2284c0b09fd979a135ba1739ace9df6b858ca4d31d650aa3af5dec3", "git_commit": "3a436c8586dd6931359f6444e44174dea069c358", "timestamp_utc": "2026-10-30T09:06:19.672490Z", "task_family": "synthetic", "document_id": "syn_03017_16000", "document_hash": "4a8b2656a54db97bf965777dca364be49477843008dad9697d52242fb75822c4", "question_id": "q14_unanswerable", "split": "test", "cluster_id": "syn_03017_16000", "sender_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "receiver_model_revision": "mlx-community/Llama-3.2-3B-Instruct-bf16@6d88ba43024fef71b10e52e101c7cd4598322601", "tokenizer_hashes": {"sender": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763", "receiver": "b9d8872cf3a99da99e1fc4b0f71232a451632dc49ca4c6771549b4efa5c1c763"}, "backend_versions": {"mlx": "0.32.4", "mlx_lm": "0.32.2"}, "hardware_id": "laptop-m5max-48g", "device_state": {"mlx_active_before": 14523225096}, "weight_precision": "bf16", "method_id": "B2", "implementation_fidelity": "custom", "compression_config": {"bits": 8, "realized": {"bits": 8}}, "question_access": "blind", "topology": "single_handoff", "handoff_index": 1, "reuse_count": 10, "cache_hit": true, "cache_compatibility_hash": null, "random_seed": 0, "source_tokens_sender": 10790, "source_tokens_receiver": 10790, "query_tokens": 50, "message_tokens": 10850, "message_utf8_bytes": 58829, "cache_tensor_bytes": 661068800, "serialized_payload_bytes": 661096641, "side_information_bytes": 27841, "fetched_bytes": 0, "transport_bytes_if_measured": null, "timing_spans": {"encode_ms": 149.66833300422877, "doc_prefill_ms": 2141.1887500435114, "compress_ms": 31.192124937660992, "serialize_ms": 118.14516608137637, "load_ms": 4.104332998394966, "receiver_prefill_ms": 0.0, "query_prefill_ms": 40.01283296383917, "ttft_ms": 40.01283296383917, "decode_ms": 18.587625003419816}, "total_wall_ms": 70.17299998551607, "ttft_ms": 40.01283296383917, "input_usage": {"receiver_prefix_tokens": 10850, "dense_cache_bytes": 1244364800, "query_tokens": 50}, "output_usage": {"output_tokens": 1}, "provider_cached_usage": null, "process_memory": 2417606656, "backend_memory": {"mlx_active_bytes": 15189464072, "mlx_peak_bytes": 15516981056, "mlx_cache_bytes": 22997227834, "process_rss_bytes": 2417606656}, "peak_prefill_memory": 14301631552, "peak_decode_memory": 15516981056, "mapper_memory": null, "cost_with_source": null, "prediction_artifact": "unknown", "evidence_artifact": null, "reference_key_id": "keys/synthetic/syn_03017_16000.json", "task_scores": {"correct": 1.0, "abstained": 1.0, "f1": 1.0}, "status": "success", "error_code": null, "retry_of": null, "log_artifact": "runs/logs/E7_qtypes.log", "payload_hash": "b172d66d2f75361834aeeda97d02e01b75ec1744ddd03d56d971a7cd0854c988", "output_hash": "b23a6a8439c0dde5515893e7c90c1e3233b8616e634470f20dc4928bcf3609bc"} | ||||
modified
src/wp30/analysis/analyze.py
+14 −0
@@ -274,6 +274,20 @@ def main(protocol_path: str) -> int: | |||||
| 274 | q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500) | 274 | q = cluster_bootstrap_mean(g, "quality_operational", n_boot=500) | ||
| 275 | rows.append({"family": fam, "provider_model": recv, "condition": cond, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "cost_usd_mean": g["cost_usd"].mean(), "ttft_ms_p50": g["ttft_ms"].median(), "total_ms_p50": g["total_wall_ms"].median(), "success_rate": (g["status"] == "success").mean()}) | 275 | rows.append({"family": fam, "provider_model": recv, "condition": cond, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "cost_usd_mean": g["cost_usd"].mean(), "ttft_ms_p50": g["ttft_ms"].median(), "total_ms_p50": g["total_wall_ms"].median(), "success_rate": (g["status"] == "success").mean()}) | ||
| 276 | t = pd.DataFrame(rows); p = TAB / "ED_hosted.csv"; t.to_csv(p, index=False); _prov(p, src, "hosted receivers; cost estimated from provider price tables") | 276 | t = pd.DataFrame(rows); p = TAB / "ED_hosted.csv"; t.to_csv(p, index=False); _prov(p, src, "hosted receivers; cost estimated from provider price tables") | ||
| 277 | + if "E3_core" in exps: | ||||
| 278 | + d3 = load_experiments(["E3_core.jsonl"]); s3 = load_experiments(["E3_core_sender.jsonl"]) if "E3_core_sender" in exps else pd.DataFrame() | ||||
| 279 | + src3 = ["runs/raw/E3_core.jsonl", "runs/raw/E3_core_sender.jsonl"] | ||||
| 280 | + d3["cond_s"] = d3["condition"].str.replace("|mapper=runs/checkpoints/mapper_v2_qwen1b5_to_qwen3b.npz", "", regex=False).str.replace("budget_tokens=512", "512", regex=False).str.replace("keep_frac=0.25", "1/4", regex=False) | ||||
| 281 | + if len(s3): s3["cond_s"] = "sender alone " + s3["condition"] | ||||
| 282 | + allr = pd.concat([d3, s3], ignore_index=True) | ||||
| 283 | + rows = [] | ||||
| 284 | + for (fam, cond), g in allr.groupby(["task_family", "cond_s"]): | ||||
| 285 | + q = cluster_bootstrap_mean(g, "quality_operational"); byq = g.groupby("qtype")["quality_operational"].mean().to_dict() | ||||
| 286 | + rows.append({"family": fam, "condition": cond, "quality": q["mean"], "lo": q["lo"], "hi": q["hi"], "n": q["n"], "n_docs": q["n_clusters"], "payload_bytes_median": g["serialized_payload_bytes"].median(), | ||||
| 287 | + "cold_ms_p50": g["cost_cold_ms"].median(), "warm_ms_p50": g["cost_warm_query_ms"].median(), "unknown_share": g["prediction_artifact"].fillna("").str.lower().str.contains("unknown").mean(), **{f"q_{k}": v for k, v in byq.items()}}) | ||||
| 288 | + t3 = pd.DataFrame(rows); p = TAB / "E3_core_transfer.csv"; t3.to_csv(p, index=False); _prov(p, src3, "same-family mapper transfer vs text handoffs and references") | ||||
| 289 | + primary_tests(d3.assign(condition=d3["cond_s"]), "E3_core", src3, [{"name": "C2 mapper vs A4 summary (synthetic)", "a": "C2", "b": "A4|512|blind", "families": ["synthetic"], "hypothesis": "H10"}, | ||||
| 290 | + {"name": "C2 mapper vs A1 receiver full context (synthetic)", "a": "C2", "b": "A1", "families": ["synthetic"], "hypothesis": "H10"}]) | ||||
| 277 | if "E7_qtypes" in exps: | 291 | if "E7_qtypes" in exps: | ||
| 278 | d7 = load_experiments(["E7_qtypes.jsonl"]); src7 = ["runs/raw/E7_qtypes.jsonl"] | 292 | d7 = load_experiments(["E7_qtypes.jsonl"]); src7 = ["runs/raw/E7_qtypes.jsonl"] | ||
| 279 | rows = [] | 293 | rows = [] | ||
modified
src/wp30/analysis/claims.py
+32 −8
@@ -1,12 +1,36 @@ | |||||
| 1 | −"""Claim ledger: every headline claim in the manuscript -> experiment ids, table/figure, rows, limitation. Written after analysis.""" | 1 | +"""Claim ledger: every headline claim -> experiment ids, evidence table/figure, rows, script, status, limitation.""" | ||
| 2 | from __future__ import annotations | 2 | from __future__ import annotations | ||
| 3 | import csv | 3 | import csv | ||
| 4 | −from pathlib import Path | ||||
| 5 | from ..util import ROOT | 4 | from ..util import ROOT | ||
| 6 | 5 | ||||
| 7 | −def write_ledger(claims: list[dict]): | 6 | +CLAIMS = [ | ||
| 8 | − p = ROOT / "results/claim_ledger.csv"; p.parent.mkdir(parents=True, exist_ok=True) | 7 | + ("C01", "Lossless representations (A1, A7, B0, B1, B2-8bit) give the same quality within noise on every family and pair", "E1_core", "results/tables/E1_core_primary_tests.csv (T2, T6); table_primary", "rows T2,T6", "analyze.py", "confirmed", "two 3B pairs, 160 test documents"), | ||
| 9 | − with open(p, "w", newline="") as f: | 8 | + ("C02", "4-bit packed KV quantization destroys Qwen2.5-3B (0%) but not Llama-3.2-3B (>=97%)", "E1_core", "E1_core_primary.csv B2|bits=4; primary_tests T3", "condition B2|bits=4", "analyze.py", "confirmed (H2)", "mlx per-token affine quantization, group 64"), | ||
| 10 | − w = csv.DictWriter(f, fieldnames=["claim_id", "claim", "experiment_ids", "evidence_table_or_figure", "rows_or_filter", "script", "status", "limitation"]) | 9 | + ("C03", "Attention-informed eviction with the question (B5-aware) beats sink+recent at 1/4 by +44 points; blind window variant collapses", "E1_core", "primary_tests T4; E1_core_primary.csv", "B5 vs B3", "analyze.py", "confirmed (H3 first half, H7)", "question-aware method"), | ||
| 11 | − w.writeheader(); w.writerows(claims) | 10 | + ("C04", "All eviction methods score 0 on executable tasks at 1/4 retention", "E1_core", "E1_core_primary.csv family=exec", "B3,B4,B5,B6,B9", "analyze.py", "measured", "3B receivers, 6-rule spec"), | ||
| 12 | − return p | 11 | + ("C05", "Structured evidence (A5) is below prose summary (A4) at the same 512-token budget (-27 points, synthetic)", "E1_core", "primary_tests T1", "T1", "analyze.py", "H1 rejected", "sender spends budget on quotes; ~8 facts of 62"), | ||
| 12 | + ("C06", "zstd shrinks text ~3.5x with no quality/latency effect; ~20% on bf16 caches", "E1_core, E6_core", "E1_core_primary.csv A7; E6_network.csv codec=zstd", "A7; B1 zstd", "analyze.py", "confirmed (H8)", "zstd level 3"), | ||||
| 13 | + ("C07", "Serialized 3B cache is 3-4 orders of magnitude larger than the text", "E1_core, E6_core", "E1_core_primary.csv payload_bytes_median; E6_network.csv bytes", "B0 vs A1", "analyze.py", "measured", "bf16, Qwen 215 MB vs 29 kB at ~8k tokens"), | ||||
| 14 | + ("C08", "On 1 GbE with an M3 Ultra receiver, moving the cache (bf16 or 8-bit) answers faster than remote text prefill at 2k-16k tokens", "E6_core", "E6_network.csv; fig6", "lan rows", "analyze.py", "measured", "one link, one receiver; break-even depends on prefill/link ratio"), | ||||
| 15 | + ("C09", "Repeated prose/structured relays lose facts at hop 1 and are nearly lossless afterwards (no monotone decay)", "E4_core", "E4_core_handoffs.csv; fig5", "hops 1-8", "analyze.py", "H5 rejected", "ledger metric = normalized value containment"), | ||||
| 16 | + ("C10", "Unsupported additions are near zero in 7,200 relayed messages", "E4_core", "E4_core_handoffs.csv unsupported_mean", "all chains", "analyze.py", "measured", "regex-based detection"), | ||||
| 17 | + ("C11", "Metered repair raises prose-chain retention 32->38% and accuracy 40->44% for ~5.9 kB cumulative fetch", "E4_core", "E4_core_handoffs.csv repairable", "A4 repairable", "analyze.py", "H6 partial", "repair limited to entities still named"), | ||||
| 18 | + ("C12", "Concatenated summaries compose as well as full context on multi-hop joins; merged structured records do not", "E5_core", "E5_core_fanin.csv; table_fanin", "concat_A4 vs merge_A5", "analyze.py", "measured", "k=2,4; 3B aggregator"), | ||||
| 19 | + ("C13", "Cache concatenation of independently prefilled sources yields plausible answers (70% multi-hop at k=2) despite invalid positions", "E5_core", "E5_core_fanin.csv cache_concat_negative_control", "k=2,4", "analyze.py", "negative control", "diagnostic only"), | ||||
| 20 | + ("C14", "Hosted receivers recover 100% from full text, ~30% from the local 512-token summary, 12.5% from structured JSON", "ED_hosted_core", "ED_hosted.csv; table_hosted", "synthetic rows", "analyze.py", "measured", "provider default sampling; 8 documents/family"), | ||||
| 21 | + ("C15", "Anthropic prompt caching did not engage below the documented 4,096-token minimum (2k docs) and halved estimated cost on 8k docs", "ED_hosted_core", "runs/raw/ED_hosted_core.jsonl provider_cached_usage", "A1 provider_cache rows", "hosted_run.py", "measured", "billing fields only"), | ||||
| 22 | + ("C16", "Dev-fitted router matches best static quality at half the amortized latency in the blind regime; no gain and higher cost in the aware regime", "E8_router (E1_core records)", "E8_router_summary.csv; E8_router_tests.csv; fig7", "router vs best_static_dev", "router_eval.py", "H9 mixed", "off-policy on full factorial; dev table from pilot"), | ||||
| 23 | + ("C17", "Linear ridge KV mapper (Qwen 1.5B->3B) yields coherent but uninformative receiver outputs; below sender-summary transfer", "E3_core", "E3_core tables", "C2 vs A4", "analyze.py", "confirmed (H10): C2 24.5% overall but 0-4% on content questions; negation yes/no at base rate", "reconstruction-only mapper; no SwaT reproduction"), | ||||
| 24 | + ("C18", "Identity round trip and 100% retention reproduce native logits exactly; cached-prefix equivalence holds within registered tolerance", "E0 tests", "tests/test_cache_correctness.py", "12 tests", "pytest", "confirmed", "MLX nondeterminism across chunking documented"), | ||||
| 25 | + ("C19", "Minimal reproduction reran 64 trials from a clean process with identical outputs and scores", "E9", "reproduction/report.json", "all", "reproduce.py", "confirmed", "same machine, same chunking"), | ||||
| 26 | + ("C20", "Cross-family cache transfer was not executed (no SwaT checkpoint/licence; mapper budget)", "coverage", "literature/audit_group1.md; table1_taxonomy", "SwaT row", "n/a", "coverage gap", "partial transfer study"), | ||||
| 27 | +] | ||||
| 28 | + | ||||
| 29 | +def write_ledger(path=ROOT / "results/claim_ledger.csv"): | ||||
| 30 | + path.parent.mkdir(parents=True, exist_ok=True) | ||||
| 31 | + with open(path, "w", newline="") as f: | ||||
| 32 | + w = csv.writer(f); w.writerow(["claim_id", "claim", "experiment_ids", "evidence_table_or_figure", "rows_or_filter", "script", "status", "limitation"]); w.writerows(CLAIMS) | ||||
| 33 | + return path | ||||
| 34 | + | ||||
| 35 | +if __name__ == "__main__": | ||||
| 36 | + print(write_ledger()) | ||||
modified
src/wp30/analysis/latex_tables.py
+23 −0
@@ -66,6 +66,29 @@ def main(): | |||||
| 66 | out = th[["model", "cond", "family", "n", "quality_ci", "cost_musd", "ttft_ms_p50", "total_ms_p50"]].rename(columns={"cond": "condition", "cost_musd": "cost (m\\$)", "ttft_ms_p50": "TTFT p50 (ms)", "total_ms_p50": "total p50 (ms)"}) | 66 | out = th[["model", "cond", "family", "n", "quality_ci", "cost_musd", "ttft_ms_p50", "total_ms_p50"]].rename(columns={"cond": "condition", "cost_musd": "cost (m\\$)", "ttft_ms_p50": "TTFT p50 (ms)", "total_ms_p50": "total p50 (ms)"}) | ||
| 67 | out["family"] = out["family"].str.replace("public_", "") | 67 | out["family"] = out["family"].str.replace("public_", "") | ||
| 68 | df_to_tex(out.sort_values(["model", "family", "condition"]), OUT / "table_hosted.tex", "llllrrrr", "{:,.0f}") | 68 | df_to_tex(out.sort_values(["model", "family", "condition"]), OUT / "table_hosted.tex", "llllrrrr", "{:,.0f}") | ||
| 69 | + fq = TAB / "E1_core_by_question_type.csv" | ||||
| 70 | + if fq.exists(): | ||||
| 71 | + tq = pd.read_csv(fq); tq["cell"] = tq.apply(lambda r: f"{100*r.quality:.0f} [{100*r.lo:.0f},{100*r.hi:.0f}]", axis=1) | ||||
| 72 | + tq["cond"] = tq["condition"].str.replace("budget_tokens=512", "512", regex=False).str.replace("keep_frac=0.25", "1/4", regex=False).str.replace("|max_fetch_bytes=2000|max_lookups=6", "", regex=False).str.replace("policy=attention", "att", regex=False).str.replace("codec=zstd", "zstd", regex=False).str.replace("|", " ", regex=False) | ||||
| 73 | + piv = tq.pivot_table(index="cond", columns="qtype", values="cell", aggfunc="first").reset_index().rename(columns={"cond": "condition"}).fillna("--") | ||||
| 74 | + df_to_tex(piv, OUT / "table_qtype_core.tex", "l" + "r" * (len(piv.columns) - 1)) | ||||
| 75 | + ff = TAB / "E1_core_failures.csv" | ||||
| 76 | + if ff.exists(): | ||||
| 77 | + tf = pd.read_csv(ff); df_to_tex(tf.rename(columns={tf.columns[0]: "method"}), OUT / "table_failures.tex", "l" + "r" * (len(tf.columns) - 1), "{:.0f}") | ||||
| 78 | + f7 = TAB / "E7_qtypes.csv" | ||||
| 79 | + if f7.exists(): | ||||
| 80 | + t7 = pd.read_csv(f7); t7["cell"] = t7.apply(lambda r: f"{100*r.quality:.0f} [{100*r.lo:.0f},{100*r.hi:.0f}]", axis=1) | ||||
| 81 | + t7["cond"] = t7["condition"].str.replace("budget_tokens=512", "512", regex=False).str.replace("keep_frac=0.25", "1/4", regex=False).str.replace("|", " ", regex=False) + " " + t7["pair"] | ||||
| 82 | + piv = t7.pivot_table(index="cond", columns="qtype", values="cell", aggfunc="first").reset_index().rename(columns={"cond": "condition / pair"}).fillna("--") | ||||
| 83 | + df_to_tex(piv, OUT / "table_qtypes_exploratory.tex", "l" + "r" * (len(piv.columns) - 1)) | ||||
| 84 | + f3 = TAB / "E3_core_transfer.csv" | ||||
| 85 | + if f3.exists(): | ||||
| 86 | + t3 = pd.read_csv(f3) | ||||
| 87 | + t3["quality_ci"] = t3.apply(lambda r: f"{100*r.quality:.0f} [{100*r.lo:.0f},{100*r.hi:.0f}]", axis=1) | ||||
| 88 | + cols = ["family", "condition", "n", "quality_ci", "unknown_share"] + [c for c in ["q_single_fact", "q_exact_copy", "q_multi_hop", "q_negation", "q_exec"] if c in t3.columns] + ["payload_bytes_median", "warm_ms_p50"] | ||||
| 89 | + out = t3[cols].rename(columns={"quality_ci": "accuracy (\\%)", "unknown_share": "`unknown' share", "payload_bytes_median": "payload B", "warm_ms_p50": "warm ms"}) | ||||
| 90 | + out.columns = [c.replace("q_", "") for c in out.columns] | ||||
| 91 | + df_to_tex(out.sort_values(["family", "condition"]), OUT / "table_transfer.tex", "ll" + "r" * (len(out.columns) - 2), "{:,.2f}") | ||||
| 69 | print("latex tables written") | 92 | print("latex tables written") | ||
| 70 | 93 | ||||
| 71 | if __name__ == "__main__": | 94 | if __name__ == "__main__": | ||
| 72 | 95 | ||||